2024-01-22T04:38:21.787 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-22T04:38:21.787 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --owner scheduled_vshankar@teuthology --name vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548 --verbose -- /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/orig.config.yaml 2024-01-22T04:38:21.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T04:38:21.913 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548 branch: wip-vshankar-testing-pacific-020240119.072505 description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: vshankar@redhat.com first_in_suite: false job_id: '7523548' kernel: flavor: default kdb: true sha1: 06652275eb934672217aaf9d4180f4a90395eb16 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-pacific-020240119.072505 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-pacific-020240119.072505 sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2977 sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 sleep_before_teardown: 0 subset: 749/1024 suite: fs suite_branch: wip-vshankar-testing-pacific-020240119.072505 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwSizrvfzR8Fk6c0OwIg3nxwin5xjeJagPPR62n77/6m+EfIVl9lOs+/hBP48MzFgVssA3OXOcEF7u9LsoXfKM= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC3AJjPlDunMOVr3M4j8HfyCqaM7PdUExu8sYm7XZNbpc7zDBKM8BTTjL9LkPZZVyk0KF1oHAB6RM1K9fY9uYLk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-19_15:47:44 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-22T04:38:21.913 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa; will attempt to use it 2024-01-22T04:38:21.914 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks 2024-01-22T04:38:21.914 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-22T04:38:21.916 INFO:teuthology.task.internal:Checking packages... 2024-01-22T04:38:21.940 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32' 2024-01-22T04:38:21.940 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-22T04:38:21.940 INFO:teuthology.packaging:ref: None 2024-01-22T04:38:21.940 INFO:teuthology.packaging:tag: None 2024-01-22T04:38:21.940 INFO:teuthology.packaging:branch: wip-vshankar-testing-pacific-020240119.072505 2024-01-22T04:38:21.940 INFO:teuthology.packaging:sha1: 9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T04:38:21.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-pacific-020240119.072505 2024-01-22T04:38:22.088 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-452.g9854ba8e 2024-01-22T04:38:22.090 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-22T04:38:22.096 INFO:teuthology.task.internal:no buildpackages task found 2024-01-22T04:38:22.096 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-22T04:38:22.101 INFO:teuthology.task.internal:Saving configuration 2024-01-22T04:38:22.116 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-22T04:38:22.122 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T04:38:22.145 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:32:58.469845', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwSizrvfzR8Fk6c0OwIg3nxwin5xjeJagPPR62n77/6m+EfIVl9lOs+/hBP48MzFgVssA3OXOcEF7u9LsoXfKM='} 2024-01-22T04:38:22.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:32:58.468174', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC3AJjPlDunMOVr3M4j8HfyCqaM7PdUExu8sYm7XZNbpc7zDBKM8BTTjL9LkPZZVyk0KF1oHAB6RM1K9fY9uYLk='} 2024-01-22T04:38:22.165 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-22T04:38:22.171 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-22T04:38:22.171 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-22T04:38:22.171 INFO:teuthology.run_tasks:Running task console_log... 2024-01-22T04:38:22.242 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f75dd8bf0d0>, signals=[15]) 2024-01-22T04:38:22.242 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-22T04:38:22.249 INFO:teuthology.task.internal:Opening connections... 2024-01-22T04:38:22.249 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T04:38:22.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:38:22.327 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T04:38:22.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:38:22.402 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-22T04:38:22.407 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-01-22T04:38:22.430 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-01-22T04:38:22.430 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T04:38:22.492 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-22T04:38:22.493 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-22T04:38:22.493 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-01-22T04:38:22.521 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-01-22T04:38:22.543 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-01-22T04:38:22.544 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-01-22T04:38:22.607 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-01-22T04:38:22.607 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2024-01-22T04:38:22.607 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-01-22T04:38:22.607 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-01-22T04:38:22.607 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-22T04:38:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-22T04:38:22.608 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-01-22T04:38:22.630 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-22T04:38:22.647 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-22T04:38:22.658 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-22T04:38:22.658 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-01-22T04:38:22.661 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-01-22T04:38:22.681 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-22T04:38:22.691 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-22T04:38:22.692 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-01-22T04:38:22.724 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-01-22T04:38:22.755 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-22T04:38:22.814 INFO:teuthology.run_tasks:Running task kernel... 2024-01-22T04:38:22.828 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'} 2024-01-22T04:38:22.828 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}}, timeout 300 2024-01-22T04:38:22.829 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-22T04:38:22.829 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-22T04:38:22.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T04:38:22.849 DEBUG:teuthology.task.kernel:sha1 for mon.b is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:38:22.850 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-22T04:38:22.850 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-01-22T04:38:22.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T04:38:22.851 DEBUG:teuthology.task.kernel:sha1 for mon.a is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:38:22.851 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-22T04:38:22.851 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-01-22T04:38:22.910 INFO:teuthology.orchestra.run.smithi169.stdout:4.18.0-489.el8.x86_64 2024-01-22T04:38:22.910 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:38:22.910 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-22T04:38:22.911 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:38:22.915 INFO:teuthology.orchestra.run.smithi100.stdout:4.18.0-489.el8.x86_64 2024-01-22T04:38:22.915 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:38:22.915 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-22T04:38:22.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:38:23.141 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum upgrade -y linux-firmware 2024-01-22T04:38:23.142 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2024-01-22T04:54:36.542 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - AppStream 28 kB/s | 26 MB 16:10 2024-01-22T04:54:42.042 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-01-22T04:54:44.233 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras 29 kB/s | 18 kB 00:00 2024-01-22T04:54:44.709 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2024-01-22T04:54:44.936 INFO:teuthology.orchestra.run.smithi169.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-01-22T04:54:46.653 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 16 MB 00:01 2024-01-22T04:54:50.453 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 544 kB/s | 24 kB 00:00 2024-01-22T04:54:53.482 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-01-22T04:54:53.483 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-01-22T04:54:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repo Size 2024-01-22T04:54:53.483 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-01-22T04:54:53.483 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-01-22T04:54:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: linux-firmware noarch 20231121-120.git9552083a.el8 baseos 347 M 2024-01-22T04:54:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T04:54:53.483 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-01-22T04:54:53.484 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-01-22T04:54:53.484 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 1 Package 2024-01-22T04:54:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T04:54:53.484 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 347 M 2024-01-22T04:54:53.484 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-01-22T04:55:02.595 INFO:teuthology.orchestra.run.smithi169.stdout:linux-firmware-20231121-120.git9552083a.el8.noa 38 MB/s | 347 MB 00:09 2024-01-22T04:55:02.595 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-01-22T04:55:02.595 INFO:teuthology.orchestra.run.smithi169.stdout:Total 38 MB/s | 347 MB 00:09 2024-01-22T04:55:04.643 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-01-22T04:55:04.713 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-01-22T04:55:04.713 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-01-22T04:55:06.854 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-01-22T04:55:06.891 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-01-22T04:55:29.275 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-01-22T04:55:29.621 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2024-01-22T04:55:29.835 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-01-22T04:55:30.080 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-01-22T04:55:30.081 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2024-01-22T04:55:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-01-22T04:55:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T04:55:30.576 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-01-22T04:55:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: linux-firmware-20231121-120.git9552083a.el8.noarch 2024-01-22T04:55:30.576 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T04:55:30.576 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-01-22T04:55:30.761 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on mon.b... 2024-01-22T04:55:30.762 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:55:30.917 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/8/flavors/default/x86_64/ 2024-01-22T04:55:30.918 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_g06652275eb93-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/8/flavors/default/x86_64/ --input-file=- 2024-01-22T04:55:30.920 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi169.front.sepia.ceph.com to complete... 2024-01-22T04:55:43.183 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - AppStream 26 kB/s | 26 MB 17:17 2024-01-22T04:55:47.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22 04:55:47 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/8/flavors/default/x86_64/kernel-6.7.0_g06652275eb93-1.x86_64.rpm [394674192/394674192] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-22T04:55:47.412 INFO:teuthology.orchestra.run.smithi169.stderr:FINISHED --2024-01-22 04:55:47-- 2024-01-22T04:55:47.412 INFO:teuthology.orchestra.run.smithi169.stderr:Total wall clock time: 16s 2024-01-22T04:55:47.412 INFO:teuthology.orchestra.run.smithi169.stderr:Downloaded: 1 files, 376M in 16s (23.4 MB/s) 2024-01-22T04:55:47.415 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on mon.b... 2024-01-22T04:55:47.415 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-22T04:55:48.709 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-01-22T04:55:49.119 INFO:teuthology.orchestra.run.smithi169.stdout:Verifying... ######################################## 2024-01-22T04:55:49.163 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing... ######################################## 2024-01-22T04:55:49.272 INFO:teuthology.orchestra.run.smithi169.stdout:Updating / installing... 2024-01-22T04:55:52.034 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras 10 kB/s | 18 kB 00:01 2024-01-22T04:55:52.385 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 6.9 kB 00:00 2024-01-22T04:55:52.611 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-01-22T04:55:55.411 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2024-01-22T04:55:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 442 kB/s | 24 kB 00:00 2024-01-22T04:56:02.210 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware noarch 20231121-120.git9552083a.el8 baseos 347 M 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-01-22T04:56:02.211 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-01-22T04:56:02.212 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 1 Package 2024-01-22T04:56:02.212 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T04:56:02.212 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 347 M 2024-01-22T04:56:02.212 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-01-22T04:56:11.724 INFO:teuthology.orchestra.run.smithi100.stdout:linux-firmware-20231121-120.git9552083a.el8.noa 38 MB/s | 347 MB 00:09 2024-01-22T04:56:11.724 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-01-22T04:56:11.725 INFO:teuthology.orchestra.run.smithi100.stdout:Total 36 MB/s | 347 MB 00:09 2024-01-22T04:56:13.774 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-01-22T04:56:13.852 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-01-22T04:56:13.852 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-01-22T04:56:15.996 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-01-22T04:56:16.028 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-01-22T04:56:29.000 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-6.7.0_g06652275eb93-1 ######################################## 2024-01-22T04:56:31.529 INFO:teuthology.orchestra.run.smithi169.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-22T04:56:38.364 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-01-22T04:56:38.801 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2024-01-22T04:56:39.072 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-01-22T04:56:39.295 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-01-22T04:56:39.295 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2024-01-22T04:56:39.802 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-01-22T04:56:39.802 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T04:56:39.802 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-01-22T04:56:39.802 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware-20231121-120.git9552083a.el8.noarch 2024-01-22T04:56:39.803 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T04:56:39.803 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-01-22T04:56:39.994 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on mon.a... 2024-01-22T04:56:39.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T04:56:40.215 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/8/flavors/default/x86_64/ 2024-01-22T04:56:40.215 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_g06652275eb93-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/8/flavors/default/x86_64/ --input-file=- 2024-01-22T04:56:40.218 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2024-01-22T04:56:51.158 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-22T04:56:51.159 DEBUG:teuthology.orchestra.run.smithi169:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-22T04:56:51.217 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/System.map-6.7.0-g06652275eb93 2024-01-22T04:56:51.217 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/config-6.7.0-g06652275eb93 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-22T04:56:51.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel 2024-01-22T04:56:51.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-22T04:56:51.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-22T04:56:51.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-22T04:56:51.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-22T04:56:51.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/custom_method.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ata_generic.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-22T04:56:51.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-22T04:56:51.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-22T04:56:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sis.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-22T04:56:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe 2024-01-22T04:56:51.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/brd.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/loop.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/virtio_blk.ko 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback 2024-01-22T04:56:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkfront.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-22T04:56:51.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-22T04:56:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/uv_mmtimer.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/virtio_console.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel 2024-01-22T04:56:51.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma 2024-01-22T04:56:51.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-22T04:56:51.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/edd.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-22T04:56:51.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-22T04:56:51.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-22T04:56:51.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-22T04:56:51.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv 2024-01-22T04:56:51.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-22T04:56:51.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-22T04:56:51.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-22T04:56:51.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-22T04:56:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-22T04:56:51.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-22T04:56:51.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-22T04:56:51.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-22T04:56:51.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-22T04:56:51.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-22T04:56:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-22T04:56:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-dev.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-22T04:56:51.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca 2024-01-22T04:56:51.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-22T04:56:51.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4 2024-01-22T04:56:51.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-22T04:56:51.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-22T04:56:51.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-22T04:56:51.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd 2024-01-22T04:56:51.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mfd-core.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-22T04:56:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-22T04:56:51.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-22T04:56:51.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-22T04:56:51.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-22T04:56:51.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-22T04:56:51.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-22T04:56:51.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-22T04:56:51.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-22T04:56:51.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet 2024-01-22T04:56:51.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-22T04:56:51.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-22T04:56:51.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-22T04:56:51.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-22T04:56:51.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-22T04:56:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-22T04:56:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-22T04:56:51.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-22T04:56:51.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker 2024-01-22T04:56:51.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-22T04:56:51.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet 2024-01-22T04:56:51.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio 2024-01-22T04:56:51.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/net_failover.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-22T04:56:51.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/dp83640.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-22T04:56:51.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slhc.ko 2024-01-22T04:56:51.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tun.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/virtio_net.ko 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3 2024-01-22T04:56:51.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netfront.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-22T04:56:51.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel 2024-01-22T04:56:51.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-22T04:56:51.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap 2024-01-22T04:56:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-22T04:56:51.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-22T04:56:51.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-22T04:56:51.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr 2024-01-22T04:56:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-22T04:56:51.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe 2024-01-22T04:56:51.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-22T04:56:51.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-22T04:56:51.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-22T04:56:51.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-22T04:56:51.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-22T04:56:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-22T04:56:51.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs 2024-01-22T04:56:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-22T04:56:51.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-22T04:56:51.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-22T04:56:51.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-22T04:56:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-22T04:56:51.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-22T04:56:51.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-22T04:56:51.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-22T04:56:51.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_balloon.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_mmio.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-22T04:56:51.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_ring.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-22T04:56:51.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-22T04:56:51.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-22T04:56:51.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs 2024-01-22T04:56:51.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs 2024-01-22T04:56:51.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/fat.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/vfat.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse 2024-01-22T04:56:51.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/fuse.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-22T04:56:51.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-22T04:56:51.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-22T04:56:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-22T04:56:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-22T04:56:51.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-22T04:56:51.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-22T04:56:51.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf 2024-01-22T04:56:51.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu/rcutorture.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/asn1_encoder.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-22T04:56:51.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon 2024-01-22T04:56:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd/zstd_compress.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-22T04:56:51.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-22T04:56:51.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-22T04:56:51.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-22T04:56:51.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/failover.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-22T04:56:51.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver/dns_resolver.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-22T04:56:51.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-22T04:56:51.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-22T04:56:51.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-22T04:56:51.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter 2024-01-22T04:56:51.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-22T04:56:51.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-22T04:56:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter 2024-01-22T04:56:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-22T04:56:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-22T04:56:51.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-22T04:56:51.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-22T04:56:51.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-22T04:56:51.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_quota.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tunnel.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-22T04:56:51.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-22T04:56:51.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-22T04:56:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-22T04:56:51.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-22T04:56:51.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-22T04:56:51.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-22T04:56:51.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-22T04:56:51.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-22T04:56:51.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-22T04:56:51.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-22T04:56:51.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys/trusted.ko 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-22T04:56:51.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-22T04:56:51.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-22T04:56:51.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-22T04:56:51.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-22T04:56:51.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-22T04:56:51.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-22T04:56:51.353 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-22T04:56:51.354 DEBUG:teuthology.orchestra.run.smithi169:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-22T04:56:51.378 INFO:teuthology.orchestra.run.smithi169.stdout:postinstall scriptlet (using /bin/sh): 2024-01-22T04:56:51.378 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-g06652275eb93 -a -r /boot/System.map-6.7.0-g06652275eb93 ]; then 2024-01-22T04:56:51.378 INFO:teuthology.orchestra.run.smithi169.stdout:cp /boot/vmlinuz-6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:cp /boot/System.map-6.7.0-g06652275eb93 /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:rm -f /boot/vmlinuz-6.7.0-g06652275eb93 /boot/System.map-6.7.0-g06652275eb93 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:/sbin/installkernel 6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:rm -f /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:new-kernel-pkg --remove 6.7.0-g06652275eb93 --rminitrd --initrdfile=/boot/initramfs-6.7.0-g06652275eb93.img 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-install remove 6.7.0-g06652275eb93 2024-01-22T04:56:51.379 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-01-22T04:56:51.380 INFO:teuthology.orchestra.run.smithi169.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-22T04:56:51.380 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-22T04:56:51.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sbin/update-bootloader --remove 6.7.0-g06652275eb93 2024-01-22T04:56:51.380 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-01-22T04:56:51.381 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -qi grub2-tools 2024-01-22T04:56:51.455 INFO:teuthology.orchestra.run.smithi169.stdout:Name : grub2-tools 2024-01-22T04:56:51.455 INFO:teuthology.orchestra.run.smithi169.stdout:Epoch : 1 2024-01-22T04:56:51.455 INFO:teuthology.orchestra.run.smithi169.stdout:Version : 2.02 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Release : 129.el8 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: x86_64 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Group : System Environment/Base 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Size : 9265586 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:License : GPLv3+ 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Build Host : kbuilder.bsys.centos.org 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Relocations : (not relocatable) 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Packager : CentOS BuildSystem 2024-01-22T04:56:51.456 INFO:teuthology.orchestra.run.smithi169.stdout:Vendor : CentOS 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:Summary : Support tools for GRUB. 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:Description : 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:hardware devices. 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T04:56:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:This subpackage provides tools for support of all platforms. 2024-01-22T04:56:51.458 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-22T04:56:51.458 INFO:teuthology.task.kernel:Updating grub on smithi169 to boot 6.7.0-g06652275eb93 2024-01-22T04:56:51.458 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-22T04:56:53.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22 04:56:53 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/8/flavors/default/x86_64/kernel-6.7.0_g06652275eb93-1.x86_64.rpm [394674192/394674192] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-22T04:56:53.724 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2024-01-22 04:56:53-- 2024-01-22T04:56:53.724 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 13s 2024-01-22T04:56:53.724 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 376M in 13s (28.7 MB/s) 2024-01-22T04:56:53.729 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on mon.a... 2024-01-22T04:56:53.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-22T04:56:55.428 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2024-01-22T04:56:55.471 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2024-01-22T04:56:55.580 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2024-01-22T04:56:57.102 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-01-22T04:56:58.922 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-01-22T04:56:58.923 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-01-22T04:56:58.956 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.YRhVykbP3W 2024-01-22T04:56:58.957 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YRhVykbP3W 2024-01-22T04:56:59.031 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.YRhVykbP3W 2024-01-22T04:56:59.207 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.YRhVykbP3W is 6KB 2024-01-22T04:56:59.256 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.YRhVykbP3W 2024-01-22T04:56:59.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo /bin/ls /boot/loader/entries || true 2024-01-22T04:56:59.346 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-01-22T04:56:59.346 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-01-22T04:56:59.346 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-01-22T04:56:59.346 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-6.7.0-g06652275eb93.conf 2024-01-22T04:56:59.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.7.0-g06652275eb93 2024-01-22T04:56:59.503 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-01-22T04:57:29.505 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-22T04:57:29.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-22T04:57:29.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:57:35.183 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.7.0_g06652275eb93-1 ######################################## 2024-01-22T04:57:39.423 INFO:teuthology.orchestra.run.smithi100.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-22T04:57:47.836 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-22T04:57:56.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-22T04:57:56.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:57:59.126 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-22T04:57:59.127 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/System.map-6.7.0-g06652275eb93 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/config-6.7.0-g06652275eb93 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-22T04:57:59.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-22T04:57:59.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto 2024-01-22T04:57:59.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-22T04:57:59.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-22T04:57:59.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-22T04:57:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/custom_method.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-22T04:57:59.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ata_generic.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-22T04:57:59.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-22T04:57:59.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sis.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-22T04:57:59.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap 2024-01-22T04:57:59.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/brd.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/loop.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-22T04:57:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/virtio_blk.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkfront.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random 2024-01-22T04:57:59.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-22T04:57:59.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/uv_mmtimer.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/virtio_console.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-22T04:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-22T04:57:59.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-22T04:57:59.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/edd.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-22T04:57:59.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-22T04:57:59.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-22T04:57:59.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-22T04:57:59.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-22T04:57:59.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon 2024-01-22T04:57:59.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-22T04:57:59.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-22T04:57:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-22T04:57:59.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-22T04:57:59.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-22T04:57:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-22T04:57:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-22T04:57:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-22T04:57:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-22T04:57:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-22T04:57:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-dev.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-22T04:57:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib 2024-01-22T04:57:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-22T04:57:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio 2024-01-22T04:57:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-22T04:57:59.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-22T04:57:59.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-22T04:57:59.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mfd-core.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc 2024-01-22T04:57:59.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-22T04:57:59.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-22T04:57:59.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-22T04:57:59.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere 2024-01-22T04:57:59.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-22T04:57:59.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio 2024-01-22T04:57:59.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip 2024-01-22T04:57:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-22T04:57:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-22T04:57:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom 2024-01-22T04:57:59.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-22T04:57:59.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan 2024-01-22T04:57:59.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-22T04:57:59.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-22T04:57:59.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-22T04:57:59.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/net_failover.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-22T04:57:59.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/dp83640.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-22T04:57:59.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slhc.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-22T04:57:59.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tun.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/virtio_net.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-22T04:57:59.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netfront.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-22T04:57:59.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-22T04:57:59.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-22T04:57:59.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-22T04:57:59.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-22T04:57:59.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-22T04:57:59.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-22T04:57:59.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor 2024-01-22T04:57:59.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-22T04:57:59.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi 2024-01-22T04:57:59.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-22T04:57:59.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-22T04:57:59.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-22T04:57:59.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-22T04:57:59.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-22T04:57:59.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-22T04:57:59.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-22T04:57:59.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-22T04:57:59.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-22T04:57:59.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-22T04:57:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-22T04:57:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty 2024-01-22T04:57:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-22T04:57:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image 2024-01-22T04:57:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-22T04:57:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-22T04:57:59.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-22T04:57:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-22T04:57:59.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-22T04:57:59.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-22T04:57:59.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-22T04:57:59.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_balloon.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_mmio.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_ring.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-22T04:57:59.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-22T04:57:59.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-22T04:57:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback 2024-01-22T04:57:59.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-22T04:57:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat 2024-01-22T04:57:59.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/fat.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/vfat.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/fuse.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-22T04:57:59.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-22T04:57:59.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-22T04:57:59.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-22T04:57:59.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-22T04:57:59.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster 2024-01-22T04:57:59.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-22T04:57:59.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs 2024-01-22T04:57:59.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu/rcutorture.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/asn1_encoder.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4 2024-01-22T04:57:59.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd/zstd_compress.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan 2024-01-22T04:57:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-22T04:57:59.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-22T04:57:59.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-22T04:57:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/failover.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver/dns_resolver.ko 2024-01-22T04:57:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-22T04:57:59.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-22T04:57:59.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-22T04:57:59.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-22T04:57:59.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-22T04:57:59.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-22T04:57:59.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154 2024-01-22T04:57:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-22T04:57:59.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-22T04:57:59.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-22T04:57:59.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-22T04:57:59.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-22T04:57:59.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_quota.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tunnel.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-22T04:57:59.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-22T04:57:59.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-22T04:57:59.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-22T04:57:59.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-22T04:57:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-22T04:57:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-22T04:57:59.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-22T04:57:59.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-22T04:57:59.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma 2024-01-22T04:57:59.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security 2024-01-22T04:57:59.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys/trusted.ko 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-22T04:57:59.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-22T04:57:59.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-22T04:57:59.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-22T04:57:59.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-22T04:57:59.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-22T04:57:59.320 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-22T04:57:59.321 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-22T04:57:59.349 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-g06652275eb93 -a -r /boot/System.map-6.7.0-g06652275eb93 ]; then 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/vmlinuz-6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/System.map-6.7.0-g06652275eb93 /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/vmlinuz-6.7.0-g06652275eb93 /boot/System.map-6.7.0-g06652275eb93 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/installkernel 6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:new-kernel-pkg --remove 6.7.0-g06652275eb93 --rminitrd --initrdfile=/boot/initramfs-6.7.0-g06652275eb93.img 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-22T04:57:59.350 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.7.0-g06652275eb93 2024-01-22T04:57:59.351 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-01-22T04:57:59.351 INFO:teuthology.orchestra.run.smithi100.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-22T04:57:59.351 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-22T04:57:59.351 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/update-bootloader --remove 6.7.0-g06652275eb93 2024-01-22T04:57:59.351 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-01-22T04:57:59.351 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-01-22T04:57:59.430 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.02 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 129.el8 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Group : System Environment/Base 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 9265586 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : kbuilder.bsys.centos.org 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Relocations : (not relocatable) 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : CentOS BuildSystem 2024-01-22T04:57:59.431 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T04:57:59.432 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-01-22T04:57:59.433 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-22T04:57:59.433 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.7.0-g06652275eb93 2024-01-22T04:57:59.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-22T04:57:59.900 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-22T04:58:04.000 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-01-22T04:58:06.602 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-01-22T04:58:06.604 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-22T04:58:06.636 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.2KcLZDVVqf 2024-01-22T04:58:06.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2KcLZDVVqf 2024-01-22T04:58:06.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.2KcLZDVVqf 2024-01-22T04:58:06.870 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.2KcLZDVVqf is 6KB 2024-01-22T04:58:06.918 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.2KcLZDVVqf 2024-01-22T04:58:06.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-01-22T04:58:07.001 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-01-22T04:58:07.001 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-01-22T04:58:07.001 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-01-22T04:58:07.001 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-6.7.0-g06652275eb93.conf 2024-01-22T04:58:07.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.7.0-g06652275eb93 2024-01-22T04:58:07.146 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-01-22T04:58:11.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-22T04:58:11.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:58:37.169 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-22T04:58:37.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-22T04:58:37.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:58:55.676 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-22T04:59:04.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-22T04:59:04.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:59:07.740 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-22T04:59:11.912 DEBUG:teuthology.orchestra.remote:timed out 2024-01-22T04:59:19.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-22T04:59:19.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:59:26.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-22T04:59:26.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:59:27.218 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-01-22T04:59:27.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-22T04:59:27.652 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.7.0-g06652275eb93"... 2024-01-22T04:59:27.652 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-01-22T04:59:27.695 INFO:teuthology.orchestra.run.smithi169.stdout:6.7.0-g06652275eb93 2024-01-22T04:59:27.699 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-22T04:59:27.699 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-22T04:59:27.699 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-22T04:59:28.700 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-22T04:59:28.700 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-22T04:59:28.820 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-01-22T04:59:28.841 DEBUG:teuthology.parallel:result is None 2024-01-22T04:59:38.172 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-22T04:59:53.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-22T04:59:53.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T04:59:53.539 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-01-22T04:59:53.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-22T04:59:53.932 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.7.0-g06652275eb93"... 2024-01-22T04:59:53.932 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-01-22T04:59:53.976 INFO:teuthology.orchestra.run.smithi100.stdout:6.7.0-g06652275eb93 2024-01-22T04:59:53.977 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-22T04:59:53.977 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-22T04:59:53.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-22T04:59:54.978 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-22T04:59:54.978 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-22T04:59:55.090 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2024-01-22T04:59:55.111 DEBUG:teuthology.parallel:result is None 2024-01-22T04:59:55.111 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-22T04:59:55.123 INFO:teuthology.task.internal:Creating test directory... 2024-01-22T04:59:55.123 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-22T04:59:55.127 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-22T04:59:55.176 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-22T04:59:55.183 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-22T04:59:55.189 INFO:teuthology.task.internal:Creating archive directory... 2024-01-22T04:59:55.189 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-22T04:59:55.212 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-22T04:59:55.271 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-22T04:59:55.278 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-22T04:59:55.278 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-22T04:59:55.282 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-22T04:59:55.352 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:59:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:59:55.377 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:59:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T04:59:55.381 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-22T04:59:55.389 INFO:teuthology.task.internal:Configuring sudo... 2024-01-22T04:59:55.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-22T04:59:55.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-22T04:59:55.459 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-22T04:59:55.467 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-22T04:59:55.468 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-22T04:59:55.472 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-22T04:59:55.515 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T04:59:55.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T04:59:55.711 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T04:59:55.782 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T04:59:55.866 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T04:59:55.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-22T04:59:55.932 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T04:59:56.006 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T04:59:56.074 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T04:59:56.145 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T04:59:56.271 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T04:59:56.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-22T04:59:56.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-01-22T04:59:56.340 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-01-22T04:59:56.453 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T04:59:56.498 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T04:59:56.944 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-22T04:59:56.952 INFO:teuthology.task.internal:Starting timer... 2024-01-22T04:59:56.952 INFO:teuthology.run_tasks:Running task pcp... 2024-01-22T04:59:56.961 INFO:teuthology.run_tasks:Running task selinux... 2024-01-22T04:59:56.970 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-01-22T04:59:56.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-01-22T04:59:57.080 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-01-22T04:59:57.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-01-22T04:59:57.235 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-01-22T04:59:57.239 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-22T04:59:57.239 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-01-22T04:59:57.290 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-01-22T04:59:57.290 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-01-22T04:59:57.347 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-01-22T04:59:57.348 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-01-22T04:59:57.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T04:59:57.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T04:59:57.414 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T04:59:57.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T04:59:57.482 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-22T04:59:57.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-01-22T04:59:57.546 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-01-22T04:59:57.613 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-22T04:59:57.623 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-22T04:59:57.629 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-22T04:59:57.742 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-22T04:59:57.759 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-22T04:59:57.760 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-22T05:16:44.632 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-01-22T05:16:44.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-22T05:16:44.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T05:16:44.726 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-01-22T05:16:44.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-22T05:16:44.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-22T05:16:44.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T05:16:44.922 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-01-22T05:16:45.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-22T05:16:45.040 INFO:teuthology.run_tasks:Running task clock... 2024-01-22T05:16:45.051 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-22T05:16:45.051 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-22T05:16:45.051 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:16:45.055 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-22T05:16:45.055 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:16:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-22T05:16:45.152 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-22T05:16:45.153 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-22T05:16:45.183 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-22T05:16:45.241 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-01-22T05:16:45.267 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-01-22T05:16:45.271 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-01-22T05:16:45.298 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-01-22T05:16:45.298 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-22T05:16:45.329 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-22T05:16:45.329 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-22T05:16:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-22T05:16:45.422 INFO:teuthology.orchestra.run.smithi100.stderr:bash: ntpq: command not found 2024-01-22T05:16:45.429 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T05:16:45.429 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-01-22T05:16:45.429 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.429 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.429 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.430 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.447 INFO:teuthology.orchestra.run.smithi169.stderr:bash: ntpq: command not found 2024-01-22T05:16:45.454 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T05:16:45.454 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-01-22T05:16:45.454 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.454 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.454 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.454 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:16:45.455 INFO:teuthology.run_tasks:Running task install... 2024-01-22T05:16:45.463 DEBUG:teuthology.task.install:project ceph 2024-01-22T05:16:45.463 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}} 2024-01-22T05:16:45.464 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'} 2024-01-22T05:16:45.464 INFO:teuthology.task.install:Using flavor: default 2024-01-22T05:16:45.470 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-22T05:16:45.470 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-22T05:16:45.470 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32', 'tag': None, 'wait_for_package': False} 2024-01-22T05:16:45.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:16:45.473 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32', 'tag': None, 'wait_for_package': False} 2024-01-22T05:16:45.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:16:45.714 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/ 2024-01-22T05:16:45.715 INFO:teuthology.task.install.rpm:Package version is 16.2.14-452.g9854ba8e 2024-01-22T05:16:45.718 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/ 2024-01-22T05:16:45.719 INFO:teuthology.task.install.rpm:Package version is 16.2.14-452.g9854ba8e 2024-01-22T05:16:45.896 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-22T05:16:45.896 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:16:45.896 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-22T05:16:45.911 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-020240119.072505/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-22T05:16:45.911 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:16:45.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-22T05:16:45.964 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-01-22T05:16:45.964 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-22T05:16:45.978 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-01-22T05:16:45.978 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-22T05:16:46.073 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-22T05:16:46.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-22T05:16:46.164 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-22T05:16:46.174 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-22T05:16:46.230 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-01-22T05:16:46.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-01-22T05:16:46.239 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-01-22T05:16:46.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-01-22T05:16:46.579 INFO:teuthology.orchestra.run.smithi169.stdout:76 files removed 2024-01-22T05:16:46.581 INFO:teuthology.orchestra.run.smithi100.stdout:76 files removed 2024-01-22T05:16:46.615 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-01-22T05:16:46.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-01-22T05:16:47.487 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 237 kB/s | 76 kB 00:00 2024-01-22T05:16:47.551 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 192 kB/s | 76 kB 00:00 2024-01-22T05:16:47.778 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 60 kB/s | 15 kB 00:00 2024-01-22T05:16:47.852 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 58 kB/s | 15 kB 00:00 2024-01-22T05:16:48.171 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2024-01-22T05:16:48.253 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 3.9 kB/s | 1.4 kB 00:00 2024-01-22T05:16:50.244 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - AppStream 13 MB/s | 26 MB 00:01 2024-01-22T05:16:55.887 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-01-22T05:16:58.171 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2024-01-22T05:16:58.521 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 6.9 kB 00:00 2024-01-22T05:17:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - PowerTools 982 kB/s | 4.7 MB 00:04 2024-01-22T05:17:04.632 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-01-22T05:17:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 16 MB 00:03 2024-01-22T05:17:12.999 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 284 kB/s | 24 kB 00:00 2024-01-22T05:17:16.499 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-22T05:17:16.500 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-22T05:17:16.509 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-01-22T05:17:16.509 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-01-22T05:17:16.510 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-01-22T05:17:16.511 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-01-22T05:17:16.512 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-01-22T05:17:16.515 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-01-22T05:17:16.515 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-01-22T05:17:16.590 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-01-22T05:17:16.608 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================================ 2024-01-22T05:17:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-01-22T05:17:16.608 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================================ 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 6.4 k 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 6.1 M 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 914 k 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 161 k 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 1.6 M 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 116 k 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 3.1 M 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 8.6 M 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 27 k 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 12 M 2024-01-22T05:17:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 52 M 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 85 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 257 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 19 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 25 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 828 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 131 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-01-22T05:17:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 215 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 389 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 369 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 114 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 88 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 3.7 M 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 175 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.40.16-14.el8 baseos 2.3 M 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.40.16-14.el8 baseos 1.9 M 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.40.16-14.el8 baseos 161 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.40.16-14.el8 baseos 356 k 2024-01-22T05:17:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2024-01-22T05:17:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 3.8 M 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 4.2 M 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 24 M 2024-01-22T05:17:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 24 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 2.4 M 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 245 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 5.0 M 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 18 M 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 15 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 26 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 174 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-01-22T05:17:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 494 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 3.8 M 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-01-22T05:17:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 45 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 99 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-22T05:17:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-22T05:17:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-01-22T05:17:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-22T05:17:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================================ 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout:Install 123 Packages 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 24 Packages 2024-01-22T05:17:16.620 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:17:16.621 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 217 M 2024-01-22T05:17:16.621 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-01-22T05:17:17.225 INFO:teuthology.orchestra.run.smithi100.stdout:(1/147): ceph-16.2.14-452.g9854ba8e.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2024-01-22T05:17:17.767 INFO:teuthology.orchestra.run.smithi100.stdout:(2/147): ceph-fuse-16.2.14-452.g9854ba8e.el8.x8 1.6 MB/s | 914 kB 00:00 2024-01-22T05:17:17.884 INFO:teuthology.orchestra.run.smithi100.stdout:(3/147): ceph-immutable-object-cache-16.2.14-45 1.4 MB/s | 161 kB 00:00 2024-01-22T05:17:18.526 INFO:teuthology.orchestra.run.smithi100.stdout:(4/147): ceph-base-16.2.14-452.g9854ba8e.el8.x8 4.1 MB/s | 6.1 MB 00:01 2024-01-22T05:17:18.735 INFO:teuthology.orchestra.run.smithi100.stdout:(5/147): ceph-mds-16.2.14-452.g9854ba8e.el8.x86 2.8 MB/s | 2.4 MB 00:00 2024-01-22T05:17:18.827 INFO:teuthology.orchestra.run.smithi100.stdout:(6/147): ceph-mgr-16.2.14-452.g9854ba8e.el8.x86 5.4 MB/s | 1.6 MB 00:00 2024-01-22T05:17:19.968 INFO:teuthology.orchestra.run.smithi100.stdout:(7/147): ceph-common-16.2.14-452.g9854ba8e.el8. 8.2 MB/s | 24 MB 00:02 2024-01-22T05:17:20.610 INFO:teuthology.orchestra.run.smithi100.stdout:(8/147): ceph-osd-16.2.14-452.g9854ba8e.el8.x86 10 MB/s | 18 MB 00:01 2024-01-22T05:17:20.694 INFO:teuthology.orchestra.run.smithi100.stdout:(9/147): ceph-selinux-16.2.14-452.g9854ba8e.el8 309 kB/s | 26 kB 00:00 2024-01-22T05:17:20.802 INFO:teuthology.orchestra.run.smithi100.stdout:(10/147): ceph-mon-16.2.14-452.g9854ba8e.el8.x8 2.4 MB/s | 5.0 MB 00:02 2024-01-22T05:17:21.236 INFO:teuthology.orchestra.run.smithi100.stdout:(11/147): ceph-radosgw-16.2.14-452.g9854ba8e.el 9.2 MB/s | 12 MB 00:01 2024-01-22T05:17:21.261 INFO:teuthology.orchestra.run.smithi100.stdout:(12/147): cephfs-mirror-16.2.14-452.g9854ba8e.e 562 kB/s | 257 kB 00:00 2024-01-22T05:17:21.354 INFO:teuthology.orchestra.run.smithi100.stdout:(13/147): libcephfs-devel-16.2.14-452.g9854ba8e 218 kB/s | 25 kB 00:00 2024-01-22T05:17:21.445 INFO:teuthology.orchestra.run.smithi100.stdout:(14/147): libcephsqlite-16.2.14-452.g9854ba8e.e 1.9 MB/s | 174 kB 00:00 2024-01-22T05:17:21.537 INFO:teuthology.orchestra.run.smithi100.stdout:(15/147): librados-devel-16.2.14-452.g9854ba8e. 1.4 MB/s | 131 kB 00:00 2024-01-22T05:17:21.637 INFO:teuthology.orchestra.run.smithi100.stdout:(16/147): libradosstriper1-16.2.14-452.g9854ba8 4.8 MB/s | 494 kB 00:00 2024-01-22T05:17:21.921 INFO:teuthology.orchestra.run.smithi100.stdout:(17/147): libcephfs2-16.2.14-452.g9854ba8e.el8. 1.2 MB/s | 828 kB 00:00 2024-01-22T05:17:22.005 INFO:teuthology.orchestra.run.smithi100.stdout:(18/147): python3-ceph-argparse-16.2.14-452.g98 542 kB/s | 45 kB 00:00 2024-01-22T05:17:22.072 INFO:teuthology.orchestra.run.smithi100.stdout:(19/147): librgw2-16.2.14-452.g9854ba8e.el8.x86 8.7 MB/s | 3.8 MB 00:00 2024-01-22T05:17:22.147 INFO:teuthology.orchestra.run.smithi100.stdout:(20/147): python3-ceph-common-16.2.14-452.g9854 696 kB/s | 99 kB 00:00 2024-01-22T05:17:22.172 INFO:teuthology.orchestra.run.smithi100.stdout:(21/147): python3-cephfs-16.2.14-452.g9854ba8e. 2.1 MB/s | 215 kB 00:00 2024-01-22T05:17:22.273 INFO:teuthology.orchestra.run.smithi100.stdout:(22/147): python3-rbd-16.2.14-452.g9854ba8e.el8 3.6 MB/s | 369 kB 00:00 2024-01-22T05:17:22.373 INFO:teuthology.orchestra.run.smithi100.stdout:(23/147): python3-rgw-16.2.14-452.g9854ba8e.el8 1.1 MB/s | 114 kB 00:00 2024-01-22T05:17:22.440 INFO:teuthology.orchestra.run.smithi100.stdout:(24/147): rbd-fuse-16.2.14-452.g9854ba8e.el8.x8 1.3 MB/s | 88 kB 00:00 2024-01-22T05:17:22.465 INFO:teuthology.orchestra.run.smithi100.stdout:(25/147): python3-rados-16.2.14-452.g9854ba8e.e 1.2 MB/s | 389 kB 00:00 2024-01-22T05:17:22.607 INFO:teuthology.orchestra.run.smithi100.stdout:(26/147): rbd-nbd-16.2.14-452.g9854ba8e.el8.x86 1.2 MB/s | 175 kB 00:00 2024-01-22T05:17:22.691 INFO:teuthology.orchestra.run.smithi100.stdout:(27/147): ceph-grafana-dashboards-16.2.14-452.g 292 kB/s | 24 kB 00:00 2024-01-22T05:17:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:(28/147): rbd-mirror-16.2.14-452.g9854ba8e.el8. 9.6 MB/s | 3.7 MB 00:00 2024-01-22T05:17:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:(29/147): ceph-mgr-cephadm-16.2.14-452.g9854ba8 733 kB/s | 116 kB 00:00 2024-01-22T05:17:23.159 INFO:teuthology.orchestra.run.smithi100.stdout:(30/147): ceph-mgr-dashboard-16.2.14-452.g9854b 9.4 MB/s | 3.1 MB 00:00 2024-01-22T05:17:23.225 INFO:teuthology.orchestra.run.smithi100.stdout:(31/147): ceph-mgr-modules-core-16.2.14-452.g98 3.6 MB/s | 245 kB 00:00 2024-01-22T05:17:23.309 INFO:teuthology.orchestra.run.smithi100.stdout:(32/147): ceph-mgr-rook-16.2.14-452.g9854ba8e.e 329 kB/s | 27 kB 00:00 2024-01-22T05:17:23.384 INFO:teuthology.orchestra.run.smithi100.stdout:(33/147): ceph-prometheus-alerts-16.2.14-452.g9 198 kB/s | 15 kB 00:00 2024-01-22T05:17:23.451 INFO:teuthology.orchestra.run.smithi100.stdout:(34/147): cephadm-16.2.14-452.g9854ba8e.el8.noa 1.3 MB/s | 85 kB 00:00 2024-01-22T05:17:23.558 INFO:teuthology.orchestra.run.smithi100.stdout:(35/147): cephfs-top-16.2.14-452.g9854ba8e.el8. 176 kB/s | 19 kB 00:00 2024-01-22T05:17:23.860 INFO:teuthology.orchestra.run.smithi100.stdout:(36/147): automake-1.16.1-8.el8.noarch.rpm 2.4 MB/s | 740 kB 00:00 2024-01-22T05:17:24.361 INFO:teuthology.orchestra.run.smithi100.stdout:(37/147): ceph-test-16.2.14-452.g9854ba8e.el8.x 14 MB/s | 52 MB 00:03 2024-01-22T05:17:24.395 INFO:teuthology.orchestra.run.smithi100.stdout:(38/147): bison-3.0.4-10.el8.x86_64.rpm 1.3 MB/s | 688 kB 00:00 2024-01-22T05:17:24.445 INFO:teuthology.orchestra.run.smithi100.stdout:(39/147): jq-1.6-8.el8.x86_64.rpm 4.0 MB/s | 203 kB 00:00 2024-01-22T05:17:24.545 INFO:teuthology.orchestra.run.smithi100.stdout:(40/147): librdkafka-1.6.1-1.el8.x86_64.rpm 6.6 MB/s | 677 kB 00:00 2024-01-22T05:17:24.587 INFO:teuthology.orchestra.run.smithi100.stdout:(41/147): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2024-01-22T05:17:24.637 INFO:teuthology.orchestra.run.smithi100.stdout:(42/147): libtool-2.4.6-25.el8.x86_64.rpm 7.6 MB/s | 709 kB 00:00 2024-01-22T05:17:24.662 INFO:teuthology.orchestra.run.smithi100.stdout:(43/147): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2024-01-22T05:17:24.696 INFO:teuthology.orchestra.run.smithi100.stdout:(44/147): oniguruma-6.8.2-3.el8.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-01-22T05:17:25.022 INFO:teuthology.orchestra.run.smithi100.stdout:(45/147): openblas-threads-0.3.15-4.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2024-01-22T05:17:25.105 INFO:teuthology.orchestra.run.smithi100.stdout:(46/147): openblas-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2024-01-22T05:17:25.172 INFO:teuthology.orchestra.run.smithi100.stdout:(47/147): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2024-01-22T05:17:25.231 INFO:teuthology.orchestra.run.smithi100.stdout:(48/147): python3-jsonpatch-1.21-2.el8.noarch.r 456 kB/s | 27 kB 00:00 2024-01-22T05:17:25.289 INFO:teuthology.orchestra.run.smithi100.stdout:(49/147): python3-jsonpointer-1.10-11.el8.noarc 344 kB/s | 20 kB 00:00 2024-01-22T05:17:25.365 INFO:teuthology.orchestra.run.smithi100.stdout:(50/147): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-01-22T05:17:25.390 INFO:teuthology.orchestra.run.smithi100.stdout:(51/147): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-01-22T05:17:25.424 INFO:teuthology.orchestra.run.smithi100.stdout:(52/147): python3-markupsafe-0.23-19.el8.x86_64 664 kB/s | 39 kB 00:00 2024-01-22T05:17:25.491 INFO:teuthology.orchestra.run.smithi100.stdout:(53/147): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2024-01-22T05:17:25.549 INFO:teuthology.orchestra.run.smithi100.stdout:(54/147): python3-prettytable-0.7.2-14.el8.noar 758 kB/s | 44 kB 00:00 2024-01-22T05:17:25.616 INFO:teuthology.orchestra.run.smithi100.stdout:(55/147): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2024-01-22T05:17:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:(56/147): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2024-01-22T05:17:25.742 INFO:teuthology.orchestra.run.smithi100.stdout:(57/147): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2024-01-22T05:17:25.800 INFO:teuthology.orchestra.run.smithi100.stdout:(58/147): python3-numpy-1.14.3-10.el8.x86_64.rp 9.1 MB/s | 3.7 MB 00:00 2024-01-22T05:17:25.826 INFO:teuthology.orchestra.run.smithi100.stdout:(59/147): python3-pytz-2017.2-11.el8.noarch.rpm 683 kB/s | 57 kB 00:00 2024-01-22T05:17:25.893 INFO:teuthology.orchestra.run.smithi100.stdout:(60/147): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2024-01-22T05:17:25.951 INFO:teuthology.orchestra.run.smithi100.stdout:(61/147): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-01-22T05:17:26.010 INFO:teuthology.orchestra.run.smithi100.stdout:(62/147): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-01-22T05:17:26.169 INFO:teuthology.orchestra.run.smithi100.stdout:(63/147): elfutils-libelf-devel-0.190-2.el8.x86 393 kB/s | 62 kB 00:00 2024-01-22T05:17:26.244 INFO:teuthology.orchestra.run.smithi100.stdout:(64/147): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-01-22T05:17:26.303 INFO:teuthology.orchestra.run.smithi100.stdout:(65/147): keyutils-libs-devel-1.5.10-9.el8.x86_ 823 kB/s | 48 kB 00:00 2024-01-22T05:17:26.695 INFO:teuthology.orchestra.run.smithi100.stdout:(66/147): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.4 MB/s | 561 kB 00:00 2024-01-22T05:17:26.762 INFO:teuthology.orchestra.run.smithi100.stdout:(67/147): libaio-devel-0.3.112-1.el8.x86_64.rpm 283 kB/s | 19 kB 00:00 2024-01-22T05:17:26.879 INFO:teuthology.orchestra.run.smithi100.stdout:(68/147): ceph-mgr-diskprediction-local-16.2.14 2.1 MB/s | 8.6 MB 00:04 2024-01-22T05:17:26.904 INFO:teuthology.orchestra.run.smithi100.stdout:(69/147): libcom_err-devel-1.45.6-5.el8.x86_64. 273 kB/s | 39 kB 00:00 2024-01-22T05:17:27.071 INFO:teuthology.orchestra.run.smithi100.stdout:(70/147): python3-scipy-1.0.0-21.module_el8+762 11 MB/s | 14 MB 00:01 2024-01-22T05:17:27.096 INFO:teuthology.orchestra.run.smithi100.stdout:(71/147): libquadmath-8.5.0-21.el8.x86_64.rpm 899 kB/s | 172 kB 00:00 2024-01-22T05:17:27.155 INFO:teuthology.orchestra.run.smithi100.stdout:(72/147): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-01-22T05:17:27.213 INFO:teuthology.orchestra.run.smithi100.stdout:(73/147): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-01-22T05:17:27.239 INFO:teuthology.orchestra.run.smithi100.stdout:(74/147): librabbitmq-0.9.0-5.el8.x86_64.rpm 281 kB/s | 47 kB 00:00 2024-01-22T05:17:27.272 INFO:teuthology.orchestra.run.smithi100.stdout:(75/147): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.7 MB/s | 100 kB 00:00 2024-01-22T05:17:27.324 INFO:teuthology.orchestra.run.smithi100.stdout:(76/147): libverto-devel-0.3.2-2.el8.x86_64.rpm 212 kB/s | 18 kB 00:00 2024-01-22T05:17:27.356 INFO:teuthology.orchestra.run.smithi100.stdout:(77/147): libzstd-devel-1.4.4-1.el8.x86_64.rpm 526 kB/s | 44 kB 00:00 2024-01-22T05:17:27.382 INFO:teuthology.orchestra.run.smithi100.stdout:(78/147): libgfortran-8.5.0-21.el8.x86_64.rpm 1.3 MB/s | 645 kB 00:00 2024-01-22T05:17:27.440 INFO:teuthology.orchestra.run.smithi100.stdout:(79/147): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-01-22T05:17:27.474 INFO:teuthology.orchestra.run.smithi100.stdout:(80/147): pcre2-devel-10.32-3.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2024-01-22T05:17:27.499 INFO:teuthology.orchestra.run.smithi100.stdout:(81/147): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2024-01-22T05:17:27.541 INFO:teuthology.orchestra.run.smithi100.stdout:(82/147): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.7 MB/s | 249 kB 00:00 2024-01-22T05:17:27.600 INFO:teuthology.orchestra.run.smithi100.stdout:(83/147): openssl-devel-1.1.1k-12.el8.x86_64.rp 12 MB/s | 3.2 MB 00:00 2024-01-22T05:17:27.617 INFO:teuthology.orchestra.run.smithi100.stdout:(84/147): python3-jwt-1.6.1-2.el8.noarch.rpm 569 kB/s | 43 kB 00:00 2024-01-22T05:17:27.650 INFO:teuthology.orchestra.run.smithi100.stdout:(85/147): python3-cryptography-3.2.1-7.el8.x86_ 4.2 MB/s | 641 kB 00:00 2024-01-22T05:17:27.676 INFO:teuthology.orchestra.run.smithi100.stdout:(86/147): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2024-01-22T05:17:27.701 INFO:teuthology.orchestra.run.smithi100.stdout:(87/147): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-01-22T05:17:27.718 INFO:teuthology.orchestra.run.smithi100.stdout:(88/147): python3-requests-oauthlib-1.0.0-1.el8 634 kB/s | 43 kB 00:00 2024-01-22T05:17:27.743 INFO:teuthology.orchestra.run.smithi100.stdout:(89/147): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2024-01-22T05:17:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:(90/147): zlib-devel-1.2.11-21.el8.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-01-22T05:17:28.277 INFO:teuthology.orchestra.run.smithi100.stdout:(91/147): liboath-2.6.2-3.el8.x86_64.rpm 116 kB/s | 59 kB 00:00 2024-01-22T05:17:28.411 INFO:teuthology.orchestra.run.smithi100.stdout:(92/147): leveldb-1.22-1.el8.x86_64.rpm 271 kB/s | 181 kB 00:00 2024-01-22T05:17:28.453 INFO:teuthology.orchestra.run.smithi100.stdout:(93/147): libunwind-1.3.1-3.el8.x86_64.rpm 428 kB/s | 75 kB 00:00 2024-01-22T05:17:28.513 INFO:teuthology.orchestra.run.smithi100.stdout:(94/147): python3-apipkg-1.5-6.el8.noarch.rpm 212 kB/s | 21 kB 00:00 2024-01-22T05:17:28.553 INFO:teuthology.orchestra.run.smithi100.stdout:(95/147): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 434 kB/s | 44 kB 00:00 2024-01-22T05:17:28.605 INFO:teuthology.orchestra.run.smithi100.stdout:(96/147): gperftools-libs-2.7-9.el8.x86_64.rpm 345 kB/s | 306 kB 00:00 2024-01-22T05:17:28.662 INFO:teuthology.orchestra.run.smithi100.stdout:(97/147): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2024-01-22T05:17:28.720 INFO:teuthology.orchestra.run.smithi100.stdout:(98/147): python3-certifi-2018.10.15-7.el8.noar 142 kB/s | 16 kB 00:00 2024-01-22T05:17:28.779 INFO:teuthology.orchestra.run.smithi100.stdout:(99/147): python3-beautifulsoup4-4.6.3-2.el8.1. 691 kB/s | 185 kB 00:00 2024-01-22T05:17:28.930 INFO:teuthology.orchestra.run.smithi100.stdout:(100/147): python3-cheroot-8.5.2-1.el8.noarch.r 646 kB/s | 173 kB 00:00 2024-01-22T05:17:29.113 INFO:teuthology.orchestra.run.smithi100.stdout:(101/147): python3-google-auth-1.1.1-10.el8.noa 444 kB/s | 81 kB 00:00 2024-01-22T05:17:29.221 INFO:teuthology.orchestra.run.smithi100.stdout:(102/147): python3-jaraco-6.2-6.el8.noarch.rpm 103 kB/s | 11 kB 00:00 2024-01-22T05:17:29.255 INFO:teuthology.orchestra.run.smithi100.stdout:(103/147): python3-cherrypy-18.4.0-1.el8.noarch 719 kB/s | 384 kB 00:00 2024-01-22T05:17:29.281 INFO:teuthology.orchestra.run.smithi100.stdout:(104/147): python3-execnet-1.7.1-1.el8.noarch.r 709 kB/s | 355 kB 00:00 2024-01-22T05:17:29.323 INFO:teuthology.orchestra.run.smithi100.stdout:(105/147): python3-jaraco-functools-2.0-4.el8.n 174 kB/s | 18 kB 00:00 2024-01-22T05:17:29.381 INFO:teuthology.orchestra.run.smithi100.stdout:(106/147): python3-logutils-0.3.5-11.el8.noarch 487 kB/s | 49 kB 00:00 2024-01-22T05:17:29.423 INFO:teuthology.orchestra.run.smithi100.stdout:(107/147): python3-more-itertools-7.2.0-3.el8.n 585 kB/s | 59 kB 00:00 2024-01-22T05:17:29.532 INFO:teuthology.orchestra.run.smithi100.stdout:(108/147): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2024-01-22T05:17:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:(109/147): python3-remoto-1.2.1-1.el8.noarch.rp 489 kB/s | 49 kB 00:00 2024-01-22T05:17:29.732 INFO:teuthology.orchestra.run.smithi100.stdout:(110/147): python3-pecan-1.3.2-9.el8.noarch.rpm 806 kB/s | 283 kB 00:00 2024-01-22T05:17:29.758 INFO:teuthology.orchestra.run.smithi100.stdout:(111/147): python3-repoze-lru-0.7-6.el8.noarch. 269 kB/s | 34 kB 00:00 2024-01-22T05:17:29.900 INFO:teuthology.orchestra.run.smithi100.stdout:(112/147): python3-rsa-4.9-2.el8.noarch.rpm 453 kB/s | 64 kB 00:00 2024-01-22T05:17:30.008 INFO:teuthology.orchestra.run.smithi100.stdout:(113/147): python3-routes-2.4.1-12.el8.noarch.r 713 kB/s | 196 kB 00:00 2024-01-22T05:17:30.034 INFO:teuthology.orchestra.run.smithi100.stdout:(114/147): python3-simplegeneric-0.8.1-17.el8.n 140 kB/s | 19 kB 00:00 2024-01-22T05:17:30.142 INFO:teuthology.orchestra.run.smithi100.stdout:(115/147): python3-singledispatch-3.4.0.3-18.el 179 kB/s | 24 kB 00:00 2024-01-22T05:17:30.167 INFO:teuthology.orchestra.run.smithi100.stdout:(116/147): python3-tempora-1.14.1-5.el8.noarch. 219 kB/s | 29 kB 00:00 2024-01-22T05:17:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:(117/147): python3-trustme-0.6.0-4.el8.noarch.r 194 kB/s | 27 kB 00:00 2024-01-22T05:17:30.676 INFO:teuthology.orchestra.run.smithi100.stdout:(118/147): python3-waitress-1.4.3-1.el8.noarch. 502 kB/s | 255 kB 00:00 2024-01-22T05:17:30.785 INFO:teuthology.orchestra.run.smithi100.stdout:(119/147): python3-webob-1.8.5-1.el8.1.noarch.r 502 kB/s | 251 kB 00:00 2024-01-22T05:17:30.810 INFO:teuthology.orchestra.run.smithi100.stdout:(120/147): python3-websocket-client-0.56.0-5.el 459 kB/s | 61 kB 00:00 2024-01-22T05:17:30.919 INFO:teuthology.orchestra.run.smithi100.stdout:(121/147): python3-zc-lockfile-2.0-2.el8.noarch 212 kB/s | 23 kB 00:00 2024-01-22T05:17:30.977 INFO:teuthology.orchestra.run.smithi100.stdout:(122/147): python3-kubernetes-11.0.0-6.el8.noar 693 kB/s | 1.2 MB 00:01 2024-01-22T05:17:31.002 INFO:teuthology.orchestra.run.smithi100.stdout:(123/147): python3-webtest-2.0.33-1.el8.noarch. 393 kB/s | 85 kB 00:00 2024-01-22T05:17:31.609 INFO:teuthology.orchestra.run.smithi100.stdout:(124/147): librbd1-16.2.14-452.g9854ba8e.el8.x8 6.6 MB/s | 4.2 MB 00:00 2024-01-22T05:17:31.870 INFO:teuthology.orchestra.run.smithi100.stdout:(125/147): NetworkManager-1.40.16-14.el8.x86_64 2.6 MB/s | 2.3 MB 00:00 2024-01-22T05:17:31.912 INFO:teuthology.orchestra.run.smithi100.stdout:(126/147): NetworkManager-libnm-1.40.16-14.el8. 6.3 MB/s | 1.9 MB 00:00 2024-01-22T05:17:31.962 INFO:teuthology.orchestra.run.smithi100.stdout:(127/147): NetworkManager-team-1.40.16-14.el8.x 1.7 MB/s | 161 kB 00:00 2024-01-22T05:17:31.987 INFO:teuthology.orchestra.run.smithi100.stdout:(128/147): NetworkManager-tui-1.40.16-14.el8.x8 4.6 MB/s | 356 kB 00:00 2024-01-22T05:17:32.021 INFO:teuthology.orchestra.run.smithi100.stdout:(129/147): acl-2.2.53-3.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-01-22T05:17:32.046 INFO:teuthology.orchestra.run.smithi100.stdout:(130/147): elfutils-debuginfod-client-0.190-2.e 1.3 MB/s | 77 kB 00:00 2024-01-22T05:17:32.114 INFO:teuthology.orchestra.run.smithi100.stdout:(131/147): elfutils-libs-0.190-2.el8.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-01-22T05:17:32.130 INFO:teuthology.orchestra.run.smithi100.stdout:(132/147): elfutils-libelf-0.190-2.el8.x86_64.r 2.1 MB/s | 233 kB 00:00 2024-01-22T05:17:32.181 INFO:teuthology.orchestra.run.smithi100.stdout:(133/147): iproute-6.2.0-5.el8.x86_64.rpm 13 MB/s | 854 kB 00:00 2024-01-22T05:17:32.206 INFO:teuthology.orchestra.run.smithi100.stdout:(134/147): libacl-2.2.53-3.el8.x86_64.rpm 463 kB/s | 35 kB 00:00 2024-01-22T05:17:32.240 INFO:teuthology.orchestra.run.smithi100.stdout:(135/147): libacl-devel-2.2.53-3.el8.x86_64.rpm 1.4 MB/s | 85 kB 00:00 2024-01-22T05:17:32.348 INFO:teuthology.orchestra.run.smithi100.stdout:(136/147): librados2-16.2.14-452.g9854ba8e.el8. 2.6 MB/s | 3.8 MB 00:01 2024-01-22T05:17:32.374 INFO:teuthology.orchestra.run.smithi100.stdout:(137/147): libblkid-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2024-01-22T05:17:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:(138/147): libfdisk-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 254 kB 00:00 2024-01-22T05:17:32.458 INFO:teuthology.orchestra.run.smithi100.stdout:(139/147): libuuid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2024-01-22T05:17:32.483 INFO:teuthology.orchestra.run.smithi100.stdout:(140/147): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2024-01-22T05:17:32.533 INFO:teuthology.orchestra.run.smithi100.stdout:(141/147): openssl-1.1.1k-12.el8.x86_64.rpm 9.6 MB/s | 738 kB 00:00 2024-01-22T05:17:32.558 INFO:teuthology.orchestra.run.smithi100.stdout:(142/147): libmount-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 236 kB 00:00 2024-01-22T05:17:32.617 INFO:teuthology.orchestra.run.smithi100.stdout:(143/147): util-linux-user-2.32.1-43.el8.x86_64 1.7 MB/s | 103 kB 00:00 2024-01-22T05:17:32.676 INFO:teuthology.orchestra.run.smithi100.stdout:(144/147): util-linux-2.32.1-43.el8.x86_64.rpm 17 MB/s | 2.5 MB 00:00 2024-01-22T05:17:32.709 INFO:teuthology.orchestra.run.smithi100.stdout:(145/147): xfsdump-3.1.8-7.el8.x86_64.rpm 3.6 MB/s | 334 kB 00:00 2024-01-22T05:17:32.751 INFO:teuthology.orchestra.run.smithi100.stdout:(146/147): xfsprogs-5.0.0-12.el8.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-01-22T05:17:33.051 INFO:teuthology.orchestra.run.smithi100.stdout:(147/147): openssl-libs-1.1.1k-12.el8.x86_64.rp 2.6 MB/s | 1.5 MB 00:00 2024-01-22T05:17:33.056 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-01-22T05:17:33.056 INFO:teuthology.orchestra.run.smithi100.stdout:Total 13 MB/s | 217 MB 00:16 2024-01-22T05:17:34.852 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-01-22T05:17:35.307 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-01-22T05:17:35.307 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-01-22T05:17:36.861 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-01-22T05:17:36.864 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-01-22T05:17:42.502 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-01-22T05:17:42.703 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-01-22T05:17:42.942 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/171 2024-01-22T05:17:43.019 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/171 2024-01-22T05:17:43.189 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/171 2024-01-22T05:17:43.289 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/171 2024-01-22T05:17:43.514 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/171 2024-01-22T05:17:43.585 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/171 2024-01-22T05:17:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/171 2024-01-22T05:17:44.112 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : leveldb-1.22-1.el8.x86_64 5/171 2024-01-22T05:17:44.321 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/171 2024-01-22T05:17:44.547 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/171 2024-01-22T05:17:44.858 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/171 2024-01-22T05:17:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/171 2024-01-22T05:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/171 2024-01-22T05:17:45.722 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 10/171 2024-01-22T05:17:46.172 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 10/171 2024-01-22T05:17:46.430 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 11/171 2024-01-22T05:17:46.571 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 11/171 2024-01-22T05:17:46.780 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 12/171 2024-01-22T05:17:46.890 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 12/171 2024-01-22T05:17:47.491 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:16.2.14-452.g9854ba8e.el8.x86_64 13/171 2024-01-22T05:17:47.647 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 14/171 2024-01-22T05:17:47.872 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 14/171 2024-01-22T05:17:48.113 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 15/171 2024-01-22T05:17:48.202 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 15/171 2024-01-22T05:17:48.436 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/171 2024-01-22T05:17:48.622 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/171 2024-01-22T05:17:48.854 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 18/171 2024-01-22T05:17:48.953 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 18/171 2024-01-22T05:17:49.138 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86 19/171 2024-01-22T05:17:49.212 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86 19/171 2024-01-22T05:17:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 20/171 2024-01-22T05:17:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-14.el8.x86_64 21/171 2024-01-22T05:17:50.121 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-14.el8.x86_64 21/171 2024-01-22T05:17:50.385 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.40.16-14.el8.x86_64 22/171 2024-01-22T05:17:50.616 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.40.16-14.el8.x86_64 22/171 2024-01-22T05:17:51.108 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.40.16-14.el8.x86_64 22/171 2024-01-22T05:17:51.388 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/171 2024-01-22T05:17:51.586 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 24/171 2024-01-22T05:17:51.771 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 25/171 2024-01-22T05:17:51.921 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 25/171 2024-01-22T05:17:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 26/171 2024-01-22T05:17:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 26/171 2024-01-22T05:17:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.15-4.el8.x86_64 27/171 2024-01-22T05:17:53.700 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 27/171 2024-01-22T05:17:53.929 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 28/171 2024-01-22T05:17:54.730 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 28/171 2024-01-22T05:17:55.078 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 29/171 2024-01-22T05:17:55.271 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 30/171 2024-01-22T05:17:55.452 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 31/171 2024-01-22T05:17:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 32/171 2024-01-22T05:17:55.894 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:16.2.14-452.g9854ba8e.el8. 33/171 2024-01-22T05:17:56.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:16.2.14-452.g9854ba8e.el 34/171 2024-01-22T05:17:56.335 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:16.2.14-452.g9854ba8e.el8.x86_6 35/171 2024-01-22T05:17:57.454 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/171 2024-01-22T05:17:57.991 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/171 2024-01-22T05:17:58.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/171 2024-01-22T05:17:58.537 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 39/171 2024-01-22T05:18:00.594 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 39/171 2024-01-22T05:18:00.930 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 40/171 2024-01-22T05:18:01.168 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/171 2024-01-22T05:18:01.341 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el8.noarch 42/171 2024-01-22T05:18:01.615 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:16.2.14-452.g9854ba8e.el8.x86_64 43/171 2024-01-22T05:18:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:16.2.14-452.g9854ba8e.el8.x86_64 44/171 2024-01-22T05:18:02.061 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:16.2.14-452.g9854ba8e.el8.x86_6 45/171 2024-01-22T05:18:02.272 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 46/171 2024-01-22T05:18:02.481 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 47/171 2024-01-22T05:18:02.769 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 48/171 2024-01-22T05:18:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 48/171 2024-01-22T05:18:03.078 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 49/171 2024-01-22T05:18:03.163 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 49/171 2024-01-22T05:18:03.345 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 50/171 2024-01-22T05:18:03.540 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 51/171 2024-01-22T05:18:03.744 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 52/171 2024-01-22T05:18:04.312 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 52/171 2024-01-22T05:18:04.662 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 53/171 2024-01-22T05:18:04.689 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 53/171 2024-01-22T05:18:04.918 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/171 2024-01-22T05:18:05.207 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/171 2024-01-22T05:18:05.427 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 56/171 2024-01-22T05:18:05.591 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 57/171 2024-01-22T05:18:05.773 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 58/171 2024-01-22T05:18:05.981 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 59/171 2024-01-22T05:18:06.182 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 60/171 2024-01-22T05:18:06.381 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 61/171 2024-01-22T05:18:06.592 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 62/171 2024-01-22T05:18:06.841 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 63/171 2024-01-22T05:18:07.009 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 64/171 2024-01-22T05:18:07.237 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-2.6-1.el8.noarch 65/171 2024-01-22T05:18:07.439 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 66/171 2024-01-22T05:18:07.670 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 67/171 2024-01-22T05:18:07.975 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 68/171 2024-01-22T05:18:08.218 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 69/171 2024-01-22T05:18:08.612 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 70/171 2024-01-22T05:18:08.885 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 71/171 2024-01-22T05:18:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 72/171 2024-01-22T05:18:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 73/171 2024-01-22T05:18:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 74/171 2024-01-22T05:18:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 75/171 2024-01-22T05:18:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 76/171 2024-01-22T05:18:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 77/171 2024-01-22T05:18:10.801 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 78/171 2024-01-22T05:18:11.091 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 79/171 2024-01-22T05:18:11.320 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 80/171 2024-01-22T05:18:11.628 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 81/171 2024-01-22T05:18:11.852 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 82/171 2024-01-22T05:18:13.122 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 83/171 2024-01-22T05:18:13.386 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 84/171 2024-01-22T05:18:13.656 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 85/171 2024-01-22T05:18:13.973 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 86/171 2024-01-22T05:18:14.229 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/171 2024-01-22T05:18:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 88/171 2024-01-22T05:18:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 89/171 2024-01-22T05:18:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 90/171 2024-01-22T05:18:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 91/171 2024-01-22T05:18:15.562 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 92/171 2024-01-22T05:18:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 93/171 2024-01-22T05:18:16.132 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 94/171 2024-01-22T05:18:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 95/171 2024-01-22T05:18:16.558 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 96/171 2024-01-22T05:18:16.791 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 97/171 2024-01-22T05:18:17.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 98/171 2024-01-22T05:18:17.271 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.7-17.el8.x86_64 99/171 2024-01-22T05:18:17.486 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 100/171 2024-01-22T05:18:17.668 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 101/171 2024-01-22T05:18:20.895 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 102/171 2024-01-22T05:18:21.176 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 102/171 2024-01-22T05:18:21.967 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 102/171 2024-01-22T05:18:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 103/171 2024-01-22T05:18:22.524 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 103/171 2024-01-22T05:18:22.708 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 104/171 2024-01-22T05:18:43.350 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 104/171 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /run 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2024-01-22T05:18:43.351 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:18:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 105/171 2024-01-22T05:18:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 105/171 2024-01-22T05:18:44.513 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 106/171 2024-01-22T05:18:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 106/171 2024-01-22T05:18:46.413 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 107/171 2024-01-22T05:18:46.471 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 107/171 2024-01-22T05:18:46.696 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 108/171 2024-01-22T05:18:46.929 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 109/171 2024-01-22T05:18:47.112 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 110/171 2024-01-22T05:18:47.205 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 110/171 2024-01-22T05:18:47.539 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : jq-1.6-8.el8.x86_64 111/171 2024-01-22T05:18:47.837 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.1-8.el8.noarch 112/171 2024-01-22T05:18:48.476 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 113/171 2024-01-22T05:18:48.676 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 113/171 2024-01-22T05:18:48.845 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-452.g9854ba8e.e 114/171 2024-01-22T05:18:49.077 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-452.g9854ba8e. 115/171 2024-01-22T05:18:49.337 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noa 116/171 2024-01-22T05:18:50.422 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noa 116/171 2024-01-22T05:18:50.722 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.n 117/171 2024-01-22T05:18:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.n 117/171 2024-01-22T05:18:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-452.g985 118/171 2024-01-22T05:18:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-452.g985 118/171 2024-01-22T05:18:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-452.g9854ba8e.el 119/171 2024-01-22T05:18:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 120/171 2024-01-22T05:18:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 120/171 2024-01-22T05:18:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 121/171 2024-01-22T05:18:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 121/171 2024-01-22T05:18:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:16.2.14-452.g9854ba8e.el8.x86_64 122/171 2024-01-22T05:18:53.544 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/171 2024-01-22T05:18:58.426 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/171 2024-01-22T05:18:59.813 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:16.2.14-452.g9854ba8e.el8.x86_64 124/171 2024-01-22T05:19:00.130 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 125/171 2024-01-22T05:19:00.255 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 125/171 2024-01-22T05:19:00.503 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-452.g9854b 126/171 2024-01-22T05:19:00.570 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-452.g9854b 126/171 2024-01-22T05:19:00.819 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 127/171 2024-01-22T05:19:01.211 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 127/171 2024-01-22T05:19:01.512 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 128/171 2024-01-22T05:19:01.637 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 128/171 2024-01-22T05:19:02.907 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 129/171 2024-01-22T05:19:03.257 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 130/171 2024-01-22T05:19:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 131/171 2024-01-22T05:19:03.683 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/171 2024-01-22T05:19:03.931 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/171 2024-01-22T05:19:04.140 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:16.2.14-452.g9854ba8e.el8.x86_ 134/171 2024-01-22T05:19:04.375 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.40.16-14.el8.x86_64 135/171 2024-01-22T05:19:04.638 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.40.16-14.el8.x86_64 136/171 2024-01-22T05:19:04.939 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 137/171 2024-01-22T05:19:05.222 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 138/171 2024-01-22T05:19:05.466 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 139/171 2024-01-22T05:19:05.693 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:16.2.14-452.g9854ba8e.el8.noarch 140/171 2024-01-22T05:19:05.977 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 141/171 2024-01-22T05:19:06.506 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:16.2.14-452.g9854ba8e.el8.x86_64 142/171 2024-01-22T05:19:06.938 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 143/171 2024-01-22T05:19:07.219 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 144/171 2024-01-22T05:19:07.409 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/171 2024-01-22T05:19:07.725 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.1-9.el8.x86_64 146/171 2024-01-22T05:19:07.834 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 146/171 2024-01-22T05:19:08.109 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.0.4-10.el8.x86_64 147/171 2024-01-22T05:19:08.134 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 147/171 2024-01-22T05:19:08.277 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 148/171 2024-01-22T05:19:08.494 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 149/171 2024-01-22T05:19:08.708 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 150/171 2024-01-22T05:19:08.994 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 151/171 2024-01-22T05:19:09.164 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 152/171 2024-01-22T05:19:09.164 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 153/171 2024-01-22T05:19:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 153/171 2024-01-22T05:19:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 154/171 2024-01-22T05:19:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 154/171 2024-01-22T05:19:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 155/171 2024-01-22T05:19:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 155/171 2024-01-22T05:19:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 156/171 2024-01-22T05:19:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 157/171 2024-01-22T05:19:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 158/171 2024-01-22T05:19:10.665 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 159/171 2024-01-22T05:19:10.919 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 160/171 2024-01-22T05:19:10.919 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 161/171 2024-01-22T05:19:11.162 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 161/171 2024-01-22T05:19:11.162 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 162/171 2024-01-22T05:19:11.395 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 162/171 2024-01-22T05:19:11.395 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 163/171 2024-01-22T05:19:11.645 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 163/171 2024-01-22T05:19:11.786 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 164/171 2024-01-22T05:19:11.807 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 165/171 2024-01-22T05:19:11.807 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 165/171 2024-01-22T05:19:12.324 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 165/171 2024-01-22T05:19:12.324 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 166/171 2024-01-22T05:19:12.561 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 166/171 2024-01-22T05:19:12.561 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 167/171 2024-01-22T05:19:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 167/171 2024-01-22T05:19:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 168/171 2024-01-22T05:19:13.069 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 168/171 2024-01-22T05:19:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 169/171 2024-01-22T05:19:13.377 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 170/171 2024-01-22T05:19:13.377 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 171/171 2024-01-22T05:19:13.849 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 171/171 2024-01-22T05:19:13.849 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-22T05:19:13.849 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:19:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:16.2.14-452.g9854ba8e.el8.x86_64 1/171 2024-01-22T05:19:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 2/171 2024-01-22T05:19:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 3/171 2024-01-22T05:19:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 4/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-452.g9854b 5/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 6/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 7/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 8/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 9/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 10/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 11/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:16.2.14-452.g9854ba8e.el8.x86_64 12/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 13/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:16.2.14-452.g9854ba8e.el8.x86_ 14/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 15/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 16/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:16.2.14-452.g9854ba8e.el8.x86_6 17/171 2024-01-22T05:19:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86 18/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 19/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:16.2.14-452.g9854ba8e.el 20/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:16.2.14-452.g9854ba8e.el8. 21/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:16.2.14-452.g9854ba8e.el8.x86_6 22/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:16.2.14-452.g9854ba8e.el8.x86_64 23/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:16.2.14-452.g9854ba8e.el8.x86_64 24/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:16.2.14-452.g9854ba8e.el8.x86_64 25/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 26/171 2024-01-22T05:19:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 27/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:16.2.14-452.g9854ba8e.el8.x86_64 28/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-452.g9854ba8e. 29/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noa 30/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.n 31/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-452.g985 32/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-452.g9854ba8e.el 33/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 34/171 2024-01-22T05:19:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-452.g9854ba8e.e 35/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 36/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:16.2.14-452.g9854ba8e.el8.noarch 37/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.1-8.el8.noarch 38/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : jq-1.6-8.el8.x86_64 41/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 42/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 45/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/171 2024-01-22T05:19:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 60/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 61/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/171 2024-01-22T05:19:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 65/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 71/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 72/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 73/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 76/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/171 2024-01-22T05:19:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 79/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 84/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/171 2024-01-22T05:19:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/171 2024-01-22T05:19:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/171 2024-01-22T05:19:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 124/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 126/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.40.16-14.el8.x86_64 128/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 129/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.40.16-14.el8.x86_64 130/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 131/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.40.16-14.el8.x86_64 132/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 133/171 2024-01-22T05:19:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.40.16-14.el8.x86_64 134/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 135/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : acl-2.2.53-3.el8.x86_64 136/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : acl-2.2.53-1.el8.x86_64 137/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 138/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 139/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 140/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 141/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 142/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 143/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 144/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 145/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 146/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 147/171 2024-01-22T05:19:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 148/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 149/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 150/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 151/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 152/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 153/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 154/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 155/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 156/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 157/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 158/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 159/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 160/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 161/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 162/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 163/171 2024-01-22T05:19:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 164/171 2024-01-22T05:19:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 165/171 2024-01-22T05:19:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 166/171 2024-01-22T05:19:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 167/171 2024-01-22T05:19:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 168/171 2024-01-22T05:19:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 169/171 2024-01-22T05:19:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 170/171 2024-01-22T05:19:17.277 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 171/171 2024-01-22T05:19:17.277 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:19:17.277 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.40.16-14.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.40.16-14.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.40.16-14.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.40.16-14.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: acl-2.2.53-3.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: iproute-6.2.0-5.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-2.2.53-3.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-devel-2.2.53-3.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: libblkid-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.278 INFO:teuthology.orchestra.run.smithi100.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: libmount-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump-3.1.8-7.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-01-22T05:19:17.279 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.1-8.el8.noarch 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.0.4-10.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.280 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-01-22T05:19:17.281 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.1-9.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: jq-1.6-8.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: leveldb-1.22-1.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-01-22T05:19:17.282 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-25.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-01-22T05:19:17.283 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.15-4.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: python3-apipkg-1.5-6.el8.noarch 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-22T05:19:17.284 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-22T05:19:17.285 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-2.6-1.el8.noarch 2024-01-22T05:19:17.286 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-22T05:19:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.288 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:19:17.289 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-22T05:19:17.289 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-01-22T05:19:17.289 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-22T05:19:17.289 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-01-22T05:19:17.289 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:19:17.289 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-01-22T05:19:17.574 DEBUG:teuthology.parallel:result is None 2024-01-22T05:34:27.376 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - AppStream 25 kB/s | 26 MB 17:39 2024-01-22T05:34:33.767 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - BaseOS 8.3 MB/s | 10 MB 00:01 2024-01-22T05:34:35.768 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras 52 kB/s | 18 kB 00:00 2024-01-22T05:34:36.243 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2024-01-22T05:34:43.060 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - PowerTools 722 kB/s | 4.7 MB 00:06 2024-01-22T05:34:44.220 INFO:teuthology.orchestra.run.smithi169.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-01-22T05:34:51.423 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 16 MB 00:07 2024-01-22T05:34:55.812 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 391 kB/s | 24 kB 00:00 2024-01-22T05:34:59.345 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-22T05:34:59.345 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-22T05:34:59.355 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-01-22T05:34:59.356 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-01-22T05:34:59.356 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-01-22T05:34:59.357 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-01-22T05:34:59.359 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-01-22T05:34:59.361 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-01-22T05:34:59.362 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-01-22T05:34:59.440 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================================ 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================================ 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 6.4 k 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 6.1 M 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 914 k 2024-01-22T05:34:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 161 k 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 1.6 M 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 116 k 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 3.1 M 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 8.6 M 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 27 k 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 12 M 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 52 M 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 85 k 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 257 k 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 19 k 2024-01-22T05:34:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-01-22T05:34:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-01-22T05:34:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-01-22T05:34:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 25 k 2024-01-22T05:34:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 828 k 2024-01-22T05:34:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 131 k 2024-01-22T05:34:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 215 k 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 389 k 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 369 k 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 114 k 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 88 k 2024-01-22T05:34:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 3.7 M 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 175 k 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.40.16-14.el8 baseos 2.3 M 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.40.16-14.el8 baseos 1.9 M 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.40.16-14.el8 baseos 161 k 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.40.16-14.el8 baseos 356 k 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-01-22T05:34:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 3.8 M 2024-01-22T05:34:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 4.2 M 2024-01-22T05:34:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2024-01-22T05:34:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2024-01-22T05:34:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-01-22T05:34:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-01-22T05:34:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2024-01-22T05:34:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2024-01-22T05:34:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2024-01-22T05:34:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-01-22T05:34:59.462 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-01-22T05:34:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-01-22T05:34:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 24 M 2024-01-22T05:34:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 24 k 2024-01-22T05:34:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 2.4 M 2024-01-22T05:34:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 245 k 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 5.0 M 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 18 M 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:16.2.14-452.g9854ba8e.el8 ceph-noarch 15 k 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 26 k 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-01-22T05:34:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-01-22T05:34:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-01-22T05:34:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-01-22T05:34:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 174 k 2024-01-22T05:34:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-01-22T05:34:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-01-22T05:34:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-22T05:34:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-01-22T05:34:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-01-22T05:34:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 494 k 2024-01-22T05:34:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-01-22T05:34:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 3.8 M 2024-01-22T05:34:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-01-22T05:34:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-01-22T05:34:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-22T05:34:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-01-22T05:34:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-01-22T05:34:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-01-22T05:34:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-01-22T05:34:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-01-22T05:34:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-01-22T05:34:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-01-22T05:34:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-01-22T05:34:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-01-22T05:34:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-01-22T05:34:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-01-22T05:34:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-22T05:34:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-22T05:34:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-22T05:34:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 45 k 2024-01-22T05:34:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:16.2.14-452.g9854ba8e.el8 ceph 99 k 2024-01-22T05:34:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-22T05:34:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-01-22T05:34:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-22T05:34:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-22T05:34:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-01-22T05:34:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-01-22T05:34:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-22T05:34:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-22T05:34:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-22T05:34:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2024-01-22T05:34:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-01-22T05:34:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-01-22T05:34:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-01-22T05:34:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-22T05:34:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-22T05:34:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-01-22T05:34:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-01-22T05:34:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-22T05:34:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-01-22T05:34:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-01-22T05:34:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-01-22T05:34:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-22T05:34:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-22T05:34:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-01-22T05:34:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-01-22T05:34:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-01-22T05:34:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-01-22T05:34:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:34:59.474 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-01-22T05:34:59.475 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================================ 2024-01-22T05:34:59.475 INFO:teuthology.orchestra.run.smithi169.stdout:Install 123 Packages 2024-01-22T05:34:59.475 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 24 Packages 2024-01-22T05:34:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:34:59.475 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 217 M 2024-01-22T05:34:59.475 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-01-22T05:34:59.854 INFO:teuthology.orchestra.run.smithi169.stdout:(1/147): ceph-16.2.14-452.g9854ba8e.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2024-01-22T05:35:00.371 INFO:teuthology.orchestra.run.smithi169.stdout:(2/147): ceph-fuse-16.2.14-452.g9854ba8e.el8.x8 1.7 MB/s | 914 kB 00:00 2024-01-22T05:35:00.446 INFO:teuthology.orchestra.run.smithi169.stdout:(3/147): ceph-base-16.2.14-452.g9854ba8e.el8.x8 7.8 MB/s | 6.1 MB 00:00 2024-01-22T05:35:00.472 INFO:teuthology.orchestra.run.smithi169.stdout:(4/147): ceph-immutable-object-cache-16.2.14-45 1.6 MB/s | 161 kB 00:00 2024-01-22T05:35:00.697 INFO:teuthology.orchestra.run.smithi169.stdout:(5/147): ceph-mds-16.2.14-452.g9854ba8e.el8.x86 9.6 MB/s | 2.4 MB 00:00 2024-01-22T05:35:01.239 INFO:teuthology.orchestra.run.smithi169.stdout:(6/147): ceph-mgr-16.2.14-452.g9854ba8e.el8.x86 2.1 MB/s | 1.6 MB 00:00 2024-01-22T05:35:01.314 INFO:teuthology.orchestra.run.smithi169.stdout:(7/147): ceph-mon-16.2.14-452.g9854ba8e.el8.x86 8.2 MB/s | 5.0 MB 00:00 2024-01-22T05:35:01.890 INFO:teuthology.orchestra.run.smithi169.stdout:(8/147): ceph-common-16.2.14-452.g9854ba8e.el8. 11 MB/s | 24 MB 00:02 2024-01-22T05:35:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:(9/147): ceph-selinux-16.2.14-452.g9854ba8e.el8 624 kB/s | 26 kB 00:00 2024-01-22T05:35:02.465 INFO:teuthology.orchestra.run.smithi169.stdout:(10/147): ceph-radosgw-16.2.14-452.g9854ba8e.el 10 MB/s | 12 MB 00:01 2024-01-22T05:35:02.632 INFO:teuthology.orchestra.run.smithi169.stdout:(11/147): cephfs-mirror-16.2.14-452.g9854ba8e.e 1.5 MB/s | 257 kB 00:00 2024-01-22T05:35:02.715 INFO:teuthology.orchestra.run.smithi169.stdout:(12/147): libcephfs-devel-16.2.14-452.g9854ba8e 307 kB/s | 25 kB 00:00 2024-01-22T05:35:03.083 INFO:teuthology.orchestra.run.smithi169.stdout:(13/147): libcephfs2-16.2.14-452.g9854ba8e.el8. 2.2 MB/s | 828 kB 00:00 2024-01-22T05:35:03.182 INFO:teuthology.orchestra.run.smithi169.stdout:(14/147): libcephsqlite-16.2.14-452.g9854ba8e.e 1.7 MB/s | 174 kB 00:00 2024-01-22T05:35:03.300 INFO:teuthology.orchestra.run.smithi169.stdout:(15/147): librados-devel-16.2.14-452.g9854ba8e. 1.1 MB/s | 131 kB 00:00 2024-01-22T05:35:03.534 INFO:teuthology.orchestra.run.smithi169.stdout:(16/147): libradosstriper1-16.2.14-452.g9854ba8 2.1 MB/s | 494 kB 00:00 2024-01-22T05:35:03.801 INFO:teuthology.orchestra.run.smithi169.stdout:(17/147): ceph-osd-16.2.14-452.g9854ba8e.el8.x8 7.2 MB/s | 18 MB 00:02 2024-01-22T05:35:03.892 INFO:teuthology.orchestra.run.smithi169.stdout:(18/147): python3-ceph-argparse-16.2.14-452.g98 492 kB/s | 45 kB 00:00 2024-01-22T05:35:04.009 INFO:teuthology.orchestra.run.smithi169.stdout:(19/147): python3-ceph-common-16.2.14-452.g9854 849 kB/s | 99 kB 00:00 2024-01-22T05:35:04.134 INFO:teuthology.orchestra.run.smithi169.stdout:(20/147): python3-cephfs-16.2.14-452.g9854ba8e. 1.7 MB/s | 215 kB 00:00 2024-01-22T05:35:04.285 INFO:teuthology.orchestra.run.smithi169.stdout:(21/147): librgw2-16.2.14-452.g9854ba8e.el8.x86 5.1 MB/s | 3.8 MB 00:00 2024-01-22T05:35:04.302 INFO:teuthology.orchestra.run.smithi169.stdout:(22/147): python3-rados-16.2.14-452.g9854ba8e.e 2.3 MB/s | 389 kB 00:00 2024-01-22T05:35:04.394 INFO:teuthology.orchestra.run.smithi169.stdout:(23/147): python3-rbd-16.2.14-452.g9854ba8e.el8 3.3 MB/s | 369 kB 00:00 2024-01-22T05:35:04.419 INFO:teuthology.orchestra.run.smithi169.stdout:(24/147): python3-rgw-16.2.14-452.g9854ba8e.el8 981 kB/s | 114 kB 00:00 2024-01-22T05:35:04.486 INFO:teuthology.orchestra.run.smithi169.stdout:(25/147): rbd-fuse-16.2.14-452.g9854ba8e.el8.x8 963 kB/s | 88 kB 00:00 2024-01-22T05:35:04.545 INFO:teuthology.orchestra.run.smithi169.stdout:(26/147): rbd-nbd-16.2.14-452.g9854ba8e.el8.x86 2.9 MB/s | 175 kB 00:00 2024-01-22T05:35:04.637 INFO:teuthology.orchestra.run.smithi169.stdout:(27/147): ceph-grafana-dashboards-16.2.14-452.g 265 kB/s | 24 kB 00:00 2024-01-22T05:35:04.720 INFO:teuthology.orchestra.run.smithi169.stdout:(28/147): ceph-mgr-cephadm-16.2.14-452.g9854ba8 1.4 MB/s | 116 kB 00:00 2024-01-22T05:35:04.820 INFO:teuthology.orchestra.run.smithi169.stdout:(29/147): rbd-mirror-16.2.14-452.g9854ba8e.el8. 9.2 MB/s | 3.7 MB 00:00 2024-01-22T05:35:06.146 INFO:teuthology.orchestra.run.smithi169.stdout:(30/147): ceph-test-16.2.14-452.g9854ba8e.el8.x 12 MB/s | 52 MB 00:04 2024-01-22T05:35:06.205 INFO:teuthology.orchestra.run.smithi169.stdout:(31/147): ceph-mgr-dashboard-16.2.14-452.g9854b 2.1 MB/s | 3.1 MB 00:01 2024-01-22T05:35:06.230 INFO:teuthology.orchestra.run.smithi169.stdout:(32/147): ceph-mgr-modules-core-16.2.14-452.g98 2.9 MB/s | 245 kB 00:00 2024-01-22T05:35:06.263 INFO:teuthology.orchestra.run.smithi169.stdout:(33/147): ceph-mgr-rook-16.2.14-452.g9854ba8e.e 471 kB/s | 27 kB 00:00 2024-01-22T05:35:06.289 INFO:teuthology.orchestra.run.smithi169.stdout:(34/147): ceph-prometheus-alerts-16.2.14-452.g9 254 kB/s | 15 kB 00:00 2024-01-22T05:35:06.406 INFO:teuthology.orchestra.run.smithi169.stdout:(35/147): ceph-mgr-diskprediction-local-16.2.14 5.4 MB/s | 8.6 MB 00:01 2024-01-22T05:35:06.431 INFO:teuthology.orchestra.run.smithi169.stdout:(36/147): cephfs-top-16.2.14-452.g9854ba8e.el8. 132 kB/s | 19 kB 00:00 2024-01-22T05:35:06.456 INFO:teuthology.orchestra.run.smithi169.stdout:(37/147): cephadm-16.2.14-452.g9854ba8e.el8.noa 443 kB/s | 85 kB 00:00 2024-01-22T05:35:06.731 INFO:teuthology.orchestra.run.smithi169.stdout:(38/147): flex-2.6.1-9.el8.x86_64.rpm 1.1 MB/s | 320 kB 00:00 2024-01-22T05:35:06.765 INFO:teuthology.orchestra.run.smithi169.stdout:(39/147): bison-3.0.4-10.el8.x86_64.rpm 2.0 MB/s | 688 kB 00:00 2024-01-22T05:35:06.798 INFO:teuthology.orchestra.run.smithi169.stdout:(40/147): automake-1.16.1-8.el8.noarch.rpm 1.8 MB/s | 740 kB 00:00 2024-01-22T05:35:06.823 INFO:teuthology.orchestra.run.smithi169.stdout:(41/147): jq-1.6-8.el8.x86_64.rpm 2.2 MB/s | 203 kB 00:00 2024-01-22T05:35:06.874 INFO:teuthology.orchestra.run.smithi169.stdout:(42/147): librdkafka-1.6.1-1.el8.x86_64.rpm 6.1 MB/s | 677 kB 00:00 2024-01-22T05:35:06.899 INFO:teuthology.orchestra.run.smithi169.stdout:(43/147): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2024-01-22T05:35:06.933 INFO:teuthology.orchestra.run.smithi169.stdout:(44/147): libtool-2.4.6-25.el8.x86_64.rpm 6.4 MB/s | 709 kB 00:00 2024-01-22T05:35:06.958 INFO:teuthology.orchestra.run.smithi169.stdout:(45/147): oniguruma-6.8.2-3.el8.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-01-22T05:35:07.192 INFO:teuthology.orchestra.run.smithi169.stdout:(46/147): openblas-0.3.15-4.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2024-01-22T05:35:07.267 INFO:teuthology.orchestra.run.smithi169.stdout:(47/147): openblas-threads-0.3.15-4.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2024-01-22T05:35:07.301 INFO:teuthology.orchestra.run.smithi169.stdout:(48/147): python3-jinja2-2.10.1-3.el8.noarch.rp 4.9 MB/s | 538 kB 00:00 2024-01-22T05:35:07.326 INFO:teuthology.orchestra.run.smithi169.stdout:(49/147): python3-jsonpatch-1.21-2.el8.noarch.r 456 kB/s | 27 kB 00:00 2024-01-22T05:35:07.410 INFO:teuthology.orchestra.run.smithi169.stdout:(50/147): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2024-01-22T05:35:07.435 INFO:teuthology.orchestra.run.smithi169.stdout:(51/147): python3-jsonpointer-1.10-11.el8.noarc 149 kB/s | 20 kB 00:00 2024-01-22T05:35:07.460 INFO:teuthology.orchestra.run.smithi169.stdout:(52/147): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-01-22T05:35:07.486 INFO:teuthology.orchestra.run.smithi169.stdout:(53/147): python3-markupsafe-0.23-19.el8.x86_64 512 kB/s | 39 kB 00:00 2024-01-22T05:35:07.519 INFO:teuthology.orchestra.run.smithi169.stdout:(54/147): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2024-01-22T05:35:07.544 INFO:teuthology.orchestra.run.smithi169.stdout:(55/147): python3-prettytable-0.7.2-14.el8.noar 753 kB/s | 44 kB 00:00 2024-01-22T05:35:07.578 INFO:teuthology.orchestra.run.smithi169.stdout:(56/147): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2024-01-22T05:35:07.603 INFO:teuthology.orchestra.run.smithi169.stdout:(57/147): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2024-01-22T05:35:07.670 INFO:teuthology.orchestra.run.smithi169.stdout:(58/147): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2024-01-22T05:35:07.695 INFO:teuthology.orchestra.run.smithi169.stdout:(59/147): python3-pytz-2017.2-11.el8.noarch.rpm 622 kB/s | 57 kB 00:00 2024-01-22T05:35:07.720 INFO:teuthology.orchestra.run.smithi169.stdout:(60/147): python3-pyasn1-modules-0.3.7-6.el8.no 773 kB/s | 110 kB 00:00 2024-01-22T05:35:07.754 INFO:teuthology.orchestra.run.smithi169.stdout:(61/147): python3-werkzeug-0.12.2-4.el8.noarch. 7.6 MB/s | 457 kB 00:00 2024-01-22T05:35:07.821 INFO:teuthology.orchestra.run.smithi169.stdout:(62/147): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2024-01-22T05:35:07.846 INFO:teuthology.orchestra.run.smithi169.stdout:(63/147): xmlstarlet-1.6.1-20.el8.x86_64.rpm 771 kB/s | 71 kB 00:00 2024-01-22T05:35:07.904 INFO:teuthology.orchestra.run.smithi169.stdout:[MIRROR] fuse-2.9.7-17.el8.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/BaseOS/x86_64/os/Packages/fuse-2.9.7-17.el8.x86_64.rpm (IP: 152.19.134.43) 2024-01-22T05:35:07.907 INFO:teuthology.orchestra.run.smithi169.stdout:[MIRROR] elfutils-libelf-devel-0.190-2.el8.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-devel-0.190-2.el8.x86_64.rpm (IP: 152.19.134.43) 2024-01-22T05:35:08.005 INFO:teuthology.orchestra.run.smithi169.stdout:(64/147): elfutils-libelf-devel-0.190-2.el8.x86 339 kB/s | 62 kB 00:00 2024-01-22T05:35:08.030 INFO:teuthology.orchestra.run.smithi169.stdout:(65/147): fuse-2.9.7-17.el8.x86_64.rpm 452 kB/s | 83 kB 00:00 2024-01-22T05:35:08.035 INFO:teuthology.orchestra.run.smithi169.stdout:[MIRROR] keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/BaseOS/x86_64/os/Packages/keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm (IP: 152.19.134.43) 2024-01-22T05:35:08.066 INFO:teuthology.orchestra.run.smithi169.stdout:[MIRROR] krb5-devel-1.18.2-22.el8.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/BaseOS/x86_64/os/Packages/krb5-devel-1.18.2-22.el8.x86_64.rpm (IP: 152.19.134.43) 2024-01-22T05:35:08.123 INFO:teuthology.orchestra.run.smithi169.stdout:(66/147): keyutils-libs-devel-1.5.10-9.el8.x86_ 411 kB/s | 48 kB 00:00 2024-01-22T05:35:08.281 INFO:teuthology.orchestra.run.smithi169.stdout:(67/147): python3-scipy-1.0.0-21.module_el8+762 23 MB/s | 14 MB 00:00 2024-01-22T05:35:08.306 INFO:teuthology.orchestra.run.smithi169.stdout:(68/147): libaio-devel-0.3.112-1.el8.x86_64.rpm 102 kB/s | 19 kB 00:00 2024-01-22T05:35:08.365 INFO:teuthology.orchestra.run.smithi169.stdout:(69/147): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2024-01-22T05:35:08.399 INFO:teuthology.orchestra.run.smithi169.stdout:(70/147): libcom_err-devel-1.45.6-5.el8.x86_64. 331 kB/s | 39 kB 00:00 2024-01-22T05:35:08.441 INFO:teuthology.orchestra.run.smithi169.stdout:(71/147): librabbitmq-0.9.0-5.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-01-22T05:35:08.533 INFO:teuthology.orchestra.run.smithi169.stdout:(72/147): libquadmath-8.5.0-21.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2024-01-22T05:35:08.600 INFO:teuthology.orchestra.run.smithi169.stdout:(73/147): libselinux-devel-2.9-8.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2024-01-22T05:35:08.633 INFO:teuthology.orchestra.run.smithi169.stdout:(74/147): libsepol-devel-2.9-3.el8.x86_64.rpm 865 kB/s | 87 kB 00:00 2024-01-22T05:35:08.683 INFO:teuthology.orchestra.run.smithi169.stdout:(75/147): libgfortran-8.5.0-21.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2024-01-22T05:35:08.709 INFO:teuthology.orchestra.run.smithi169.stdout:(76/147): libverto-devel-0.3.2-2.el8.x86_64.rpm 240 kB/s | 18 kB 00:00 2024-01-22T05:35:08.734 INFO:teuthology.orchestra.run.smithi169.stdout:(77/147): libzstd-devel-1.4.4-1.el8.x86_64.rpm 872 kB/s | 44 kB 00:00 2024-01-22T05:35:08.759 INFO:teuthology.orchestra.run.smithi169.stdout:(78/147): libuuid-devel-2.32.1-43.el8.x86_64.rp 625 kB/s | 100 kB 00:00 2024-01-22T05:35:08.893 INFO:teuthology.orchestra.run.smithi169.stdout:(79/147): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2024-01-22T05:35:08.951 INFO:teuthology.orchestra.run.smithi169.stdout:(80/147): pcre2-devel-10.32-3.el8.x86_64.rpm 2.7 MB/s | 605 kB 00:00 2024-01-22T05:35:09.036 INFO:teuthology.orchestra.run.smithi169.stdout:(81/147): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2024-01-22T05:35:09.086 INFO:teuthology.orchestra.run.smithi169.stdout:(82/147): openssl-devel-1.1.1k-12.el8.x86_64.rp 8.5 MB/s | 3.2 MB 00:00 2024-01-22T05:35:09.119 INFO:teuthology.orchestra.run.smithi169.stdout:(83/147): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 249 kB 00:00 2024-01-22T05:35:09.144 INFO:teuthology.orchestra.run.smithi169.stdout:(84/147): python3-jwt-1.6.1-2.el8.noarch.rpm 730 kB/s | 43 kB 00:00 2024-01-22T05:35:09.195 INFO:teuthology.orchestra.run.smithi169.stdout:(85/147): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2024-01-22T05:35:09.220 INFO:teuthology.orchestra.run.smithi169.stdout:(86/147): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2024-01-22T05:35:09.254 INFO:teuthology.orchestra.run.smithi169.stdout:(87/147): python3-cryptography-3.2.1-7.el8.x86_ 2.9 MB/s | 641 kB 00:00 2024-01-22T05:35:09.279 INFO:teuthology.orchestra.run.smithi169.stdout:(88/147): python3-requests-oauthlib-1.0.0-1.el8 508 kB/s | 43 kB 00:00 2024-01-22T05:35:09.305 INFO:teuthology.orchestra.run.smithi169.stdout:(89/147): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 887 kB/s | 74 kB 00:00 2024-01-22T05:35:09.329 INFO:teuthology.orchestra.run.smithi169.stdout:(90/147): zlib-devel-1.2.11-21.el8.x86_64.rpm 771 kB/s | 58 kB 00:00 2024-01-22T05:35:09.438 INFO:teuthology.orchestra.run.smithi169.stdout:(91/147): liboath-2.6.2-3.el8.x86_64.rpm 544 kB/s | 59 kB 00:00 2024-01-22T05:35:09.472 INFO:teuthology.orchestra.run.smithi169.stdout:(92/147): leveldb-1.22-1.el8.x86_64.rpm 1.2 MB/s | 181 kB 00:00 2024-01-22T05:35:09.497 INFO:teuthology.orchestra.run.smithi169.stdout:(93/147): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-01-22T05:35:09.523 INFO:teuthology.orchestra.run.smithi169.stdout:(94/147): python3-apipkg-1.5-6.el8.noarch.rpm 424 kB/s | 21 kB 00:00 2024-01-22T05:35:09.547 INFO:teuthology.orchestra.run.smithi169.stdout:(95/147): libunwind-1.3.1-3.el8.x86_64.rpm 690 kB/s | 75 kB 00:00 2024-01-22T05:35:09.573 INFO:teuthology.orchestra.run.smithi169.stdout:(96/147): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 579 kB/s | 44 kB 00:00 2024-01-22T05:35:09.598 INFO:teuthology.orchestra.run.smithi169.stdout:(97/147): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2024-01-22T05:35:09.623 INFO:teuthology.orchestra.run.smithi169.stdout:(98/147): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2024-01-22T05:35:09.648 INFO:teuthology.orchestra.run.smithi169.stdout:(99/147): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2024-01-22T05:35:09.682 INFO:teuthology.orchestra.run.smithi169.stdout:(100/147): python3-cheroot-8.5.2-1.el8.noarch.r 2.0 MB/s | 173 kB 00:00 2024-01-22T05:35:09.716 INFO:teuthology.orchestra.run.smithi169.stdout:(101/147): python3-cherrypy-18.4.0-1.el8.noarch 4.1 MB/s | 384 kB 00:00 2024-01-22T05:35:09.741 INFO:teuthology.orchestra.run.smithi169.stdout:(102/147): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2024-01-22T05:35:09.775 INFO:teuthology.orchestra.run.smithi169.stdout:(103/147): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2024-01-22T05:35:09.800 INFO:teuthology.orchestra.run.smithi169.stdout:(104/147): python3-jaraco-functools-2.0-4.el8.n 301 kB/s | 18 kB 00:00 2024-01-22T05:35:09.825 INFO:teuthology.orchestra.run.smithi169.stdout:(105/147): python3-execnet-1.7.1-1.el8.noarch.r 2.0 MB/s | 355 kB 00:00 2024-01-22T05:35:09.851 INFO:teuthology.orchestra.run.smithi169.stdout:(106/147): python3-logutils-0.3.5-11.el8.noarch 976 kB/s | 49 kB 00:00 2024-01-22T05:35:09.876 INFO:teuthology.orchestra.run.smithi169.stdout:(107/147): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2024-01-22T05:35:09.918 INFO:teuthology.orchestra.run.smithi169.stdout:(108/147): python3-kubernetes-11.0.0-6.el8.noar 8.2 MB/s | 1.2 MB 00:00 2024-01-22T05:35:09.973 INFO:teuthology.orchestra.run.smithi169.stdout:(109/147): python3-portend-2.6-1.el8.noarch.rpm 161 kB/s | 16 kB 00:00 2024-01-22T05:35:10.001 INFO:teuthology.orchestra.run.smithi169.stdout:(110/147): python3-remoto-1.2.1-1.el8.noarch.rp 588 kB/s | 49 kB 00:00 2024-01-22T05:35:10.027 INFO:teuthology.orchestra.run.smithi169.stdout:(111/147): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2024-01-22T05:35:10.044 INFO:teuthology.orchestra.run.smithi169.stdout:(112/147): python3-repoze-lru-0.7-6.el8.noarch. 477 kB/s | 34 kB 00:00 2024-01-22T05:35:10.069 INFO:teuthology.orchestra.run.smithi169.stdout:(113/147): python3-routes-2.4.1-12.el8.noarch.r 2.9 MB/s | 196 kB 00:00 2024-01-22T05:35:10.086 INFO:teuthology.orchestra.run.smithi169.stdout:(114/147): python3-simplegeneric-0.8.1-17.el8.n 447 kB/s | 19 kB 00:00 2024-01-22T05:35:10.111 INFO:teuthology.orchestra.run.smithi169.stdout:(115/147): python3-singledispatch-3.4.0.3-18.el 574 kB/s | 24 kB 00:00 2024-01-22T05:35:10.137 INFO:teuthology.orchestra.run.smithi169.stdout:(116/147): python3-tempora-1.14.1-5.el8.noarch. 585 kB/s | 29 kB 00:00 2024-01-22T05:35:10.162 INFO:teuthology.orchestra.run.smithi169.stdout:(117/147): python3-rsa-4.9-2.el8.noarch.rpm 478 kB/s | 64 kB 00:00 2024-01-22T05:35:10.187 INFO:teuthology.orchestra.run.smithi169.stdout:(118/147): python3-trustme-0.6.0-4.el8.noarch.r 364 kB/s | 27 kB 00:00 2024-01-22T05:35:10.212 INFO:teuthology.orchestra.run.smithi169.stdout:(119/147): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2024-01-22T05:35:10.238 INFO:teuthology.orchestra.run.smithi169.stdout:(120/147): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2024-01-22T05:35:10.263 INFO:teuthology.orchestra.run.smithi169.stdout:(121/147): python3-websocket-client-0.56.0-5.el 815 kB/s | 61 kB 00:00 2024-01-22T05:35:10.305 INFO:teuthology.orchestra.run.smithi169.stdout:(122/147): python3-zc-lockfile-2.0-2.el8.noarch 344 kB/s | 23 kB 00:00 2024-01-22T05:35:10.347 INFO:teuthology.orchestra.run.smithi169.stdout:(123/147): python3-webtest-2.0.33-1.el8.noarch. 637 kB/s | 85 kB 00:00 2024-01-22T05:35:10.564 INFO:teuthology.orchestra.run.smithi169.stdout:(124/147): librados2-16.2.14-452.g9854ba8e.el8. 13 MB/s | 3.8 MB 00:00 2024-01-22T05:35:10.739 INFO:teuthology.orchestra.run.smithi169.stdout:(125/147): librbd1-16.2.14-452.g9854ba8e.el8.x8 9.6 MB/s | 4.2 MB 00:00 2024-01-22T05:35:10.798 INFO:teuthology.orchestra.run.smithi169.stdout:(126/147): NetworkManager-1.40.16-14.el8.x86_64 5.1 MB/s | 2.3 MB 00:00 2024-01-22T05:35:10.823 INFO:teuthology.orchestra.run.smithi169.stdout:(127/147): NetworkManager-team-1.40.16-14.el8.x 1.9 MB/s | 161 kB 00:00 2024-01-22T05:35:10.873 INFO:teuthology.orchestra.run.smithi169.stdout:(128/147): NetworkManager-libnm-1.40.16-14.el8. 6.2 MB/s | 1.9 MB 00:00 2024-01-22T05:35:10.899 INFO:teuthology.orchestra.run.smithi169.stdout:(129/147): acl-2.2.53-3.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-01-22T05:35:10.924 INFO:teuthology.orchestra.run.smithi169.stdout:(130/147): NetworkManager-tui-1.40.16-14.el8.x8 2.8 MB/s | 356 kB 00:00 2024-01-22T05:35:10.949 INFO:teuthology.orchestra.run.smithi169.stdout:(131/147): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 77 kB 00:00 2024-01-22T05:35:10.974 INFO:teuthology.orchestra.run.smithi169.stdout:(132/147): elfutils-libelf-0.190-2.el8.x86_64.r 3.0 MB/s | 233 kB 00:00 2024-01-22T05:35:11.059 INFO:teuthology.orchestra.run.smithi169.stdout:(133/147): elfutils-libs-0.190-2.el8.x86_64.rpm 2.2 MB/s | 305 kB 00:00 2024-01-22T05:35:11.084 INFO:teuthology.orchestra.run.smithi169.stdout:(134/147): libacl-2.2.53-3.el8.x86_64.rpm 320 kB/s | 35 kB 00:00 2024-01-22T05:35:11.109 INFO:teuthology.orchestra.run.smithi169.stdout:(135/147): libacl-devel-2.2.53-3.el8.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2024-01-22T05:35:11.143 INFO:teuthology.orchestra.run.smithi169.stdout:(136/147): iproute-6.2.0-5.el8.x86_64.rpm 4.3 MB/s | 854 kB 00:00 2024-01-22T05:35:11.168 INFO:teuthology.orchestra.run.smithi169.stdout:(137/147): libblkid-2.32.1-43.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2024-01-22T05:35:11.193 INFO:teuthology.orchestra.run.smithi169.stdout:(138/147): libfdisk-2.32.1-43.el8.x86_64.rpm 3.0 MB/s | 254 kB 00:00 2024-01-22T05:35:11.244 INFO:teuthology.orchestra.run.smithi169.stdout:(139/147): libmount-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 236 kB 00:00 2024-01-22T05:35:11.269 INFO:teuthology.orchestra.run.smithi169.stdout:(140/147): libsmartcols-2.32.1-43.el8.x86_64.rp 1.7 MB/s | 179 kB 00:00 2024-01-22T05:35:11.302 INFO:teuthology.orchestra.run.smithi169.stdout:(141/147): libuuid-2.32.1-43.el8.x86_64.rpm 913 kB/s | 99 kB 00:00 2024-01-22T05:35:11.336 INFO:teuthology.orchestra.run.smithi169.stdout:(142/147): openssl-1.1.1k-12.el8.x86_64.rpm 7.9 MB/s | 738 kB 00:00 2024-01-22T05:35:11.386 INFO:teuthology.orchestra.run.smithi169.stdout:(143/147): util-linux-user-2.32.1-43.el8.x86_64 2.0 MB/s | 103 kB 00:00 2024-01-22T05:35:11.445 INFO:teuthology.orchestra.run.smithi169.stdout:(144/147): xfsdump-3.1.8-7.el8.x86_64.rpm 5.6 MB/s | 334 kB 00:00 2024-01-22T05:35:11.487 INFO:teuthology.orchestra.run.smithi169.stdout:(145/147): openssl-libs-1.1.1k-12.el8.x86_64.rp 6.8 MB/s | 1.5 MB 00:00 2024-01-22T05:35:11.562 INFO:teuthology.orchestra.run.smithi169.stdout:(146/147): xfsprogs-5.0.0-12.el8.x86_64.rpm 9.3 MB/s | 1.1 MB 00:00 2024-01-22T05:35:11.745 INFO:teuthology.orchestra.run.smithi169.stdout:(147/147): util-linux-2.32.1-43.el8.x86_64.rpm 5.6 MB/s | 2.5 MB 00:00 2024-01-22T05:35:11.748 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-01-22T05:35:11.749 INFO:teuthology.orchestra.run.smithi169.stdout:Total 18 MB/s | 217 MB 00:12 2024-01-22T05:35:13.561 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-01-22T05:35:14.024 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-01-22T05:35:14.024 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-01-22T05:35:15.607 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-01-22T05:35:15.610 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-01-22T05:35:21.266 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-01-22T05:35:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-01-22T05:35:21.701 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/171 2024-01-22T05:35:21.780 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/171 2024-01-22T05:35:21.925 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/171 2024-01-22T05:35:22.025 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/171 2024-01-22T05:35:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/171 2024-01-22T05:35:22.365 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/171 2024-01-22T05:35:22.586 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/171 2024-01-22T05:35:22.850 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : leveldb-1.22-1.el8.x86_64 5/171 2024-01-22T05:35:23.023 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/171 2024-01-22T05:35:23.217 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/171 2024-01-22T05:35:23.521 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/171 2024-01-22T05:35:23.692 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/171 2024-01-22T05:35:24.109 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/171 2024-01-22T05:35:24.325 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 10/171 2024-01-22T05:35:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 10/171 2024-01-22T05:35:24.991 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 11/171 2024-01-22T05:35:25.140 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 11/171 2024-01-22T05:35:25.342 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 12/171 2024-01-22T05:35:25.459 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 12/171 2024-01-22T05:35:25.999 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:16.2.14-452.g9854ba8e.el8.x86_64 13/171 2024-01-22T05:35:26.158 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 14/171 2024-01-22T05:35:26.391 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 14/171 2024-01-22T05:35:26.591 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 15/171 2024-01-22T05:35:26.860 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 15/171 2024-01-22T05:35:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/171 2024-01-22T05:35:27.541 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/171 2024-01-22T05:35:27.715 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 18/171 2024-01-22T05:35:27.842 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 18/171 2024-01-22T05:35:28.000 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86 19/171 2024-01-22T05:35:28.081 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86 19/171 2024-01-22T05:35:28.536 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 20/171 2024-01-22T05:35:28.816 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-14.el8.x86_64 21/171 2024-01-22T05:35:28.881 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-14.el8.x86_64 21/171 2024-01-22T05:35:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.40.16-14.el8.x86_64 22/171 2024-01-22T05:35:29.376 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.40.16-14.el8.x86_64 22/171 2024-01-22T05:35:29.880 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.40.16-14.el8.x86_64 22/171 2024-01-22T05:35:30.159 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/171 2024-01-22T05:35:30.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 24/171 2024-01-22T05:35:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 25/171 2024-01-22T05:35:30.650 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 25/171 2024-01-22T05:35:30.841 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 26/171 2024-01-22T05:35:31.515 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 26/171 2024-01-22T05:35:31.715 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.15-4.el8.x86_64 27/171 2024-01-22T05:35:32.384 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 27/171 2024-01-22T05:35:32.565 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 28/171 2024-01-22T05:35:33.382 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 28/171 2024-01-22T05:35:33.705 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 29/171 2024-01-22T05:35:33.882 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 30/171 2024-01-22T05:35:34.039 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 31/171 2024-01-22T05:35:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 32/171 2024-01-22T05:35:34.430 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:16.2.14-452.g9854ba8e.el8. 33/171 2024-01-22T05:35:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:16.2.14-452.g9854ba8e.el 34/171 2024-01-22T05:35:34.864 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:16.2.14-452.g9854ba8e.el8.x86_6 35/171 2024-01-22T05:35:35.941 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/171 2024-01-22T05:35:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/171 2024-01-22T05:35:36.583 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/171 2024-01-22T05:35:36.832 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 39/171 2024-01-22T05:35:38.902 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 39/171 2024-01-22T05:35:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 40/171 2024-01-22T05:35:39.446 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/171 2024-01-22T05:35:39.603 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el8.noarch 42/171 2024-01-22T05:35:39.809 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:16.2.14-452.g9854ba8e.el8.x86_64 43/171 2024-01-22T05:35:39.995 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:16.2.14-452.g9854ba8e.el8.x86_64 44/171 2024-01-22T05:35:40.240 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:16.2.14-452.g9854ba8e.el8.x86_6 45/171 2024-01-22T05:35:40.431 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 46/171 2024-01-22T05:35:40.608 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 47/171 2024-01-22T05:35:40.806 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 48/171 2024-01-22T05:35:40.905 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 48/171 2024-01-22T05:35:41.089 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 49/171 2024-01-22T05:35:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 49/171 2024-01-22T05:35:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 50/171 2024-01-22T05:35:41.578 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 51/171 2024-01-22T05:35:41.755 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 52/171 2024-01-22T05:35:42.284 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 52/171 2024-01-22T05:35:42.649 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 53/171 2024-01-22T05:35:42.676 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 53/171 2024-01-22T05:35:42.888 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/171 2024-01-22T05:35:43.163 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/171 2024-01-22T05:35:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 56/171 2024-01-22T05:35:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 57/171 2024-01-22T05:35:43.718 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 58/171 2024-01-22T05:35:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 59/171 2024-01-22T05:35:44.111 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 60/171 2024-01-22T05:35:44.292 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 61/171 2024-01-22T05:35:44.454 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 62/171 2024-01-22T05:35:44.661 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 63/171 2024-01-22T05:35:44.820 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 64/171 2024-01-22T05:35:44.999 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-2.6-1.el8.noarch 65/171 2024-01-22T05:35:45.176 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 66/171 2024-01-22T05:35:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 67/171 2024-01-22T05:35:45.618 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 68/171 2024-01-22T05:35:45.872 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 69/171 2024-01-22T05:35:46.251 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 70/171 2024-01-22T05:35:46.496 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 71/171 2024-01-22T05:35:46.730 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 72/171 2024-01-22T05:35:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 73/171 2024-01-22T05:35:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 74/171 2024-01-22T05:35:47.343 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 75/171 2024-01-22T05:35:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 76/171 2024-01-22T05:35:47.773 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 77/171 2024-01-22T05:35:48.165 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 78/171 2024-01-22T05:35:48.419 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 79/171 2024-01-22T05:35:48.620 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 80/171 2024-01-22T05:35:48.874 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 81/171 2024-01-22T05:35:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 82/171 2024-01-22T05:35:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 83/171 2024-01-22T05:35:50.631 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 84/171 2024-01-22T05:35:50.889 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 85/171 2024-01-22T05:35:51.203 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 86/171 2024-01-22T05:35:51.507 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/171 2024-01-22T05:35:51.795 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 88/171 2024-01-22T05:35:52.009 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 89/171 2024-01-22T05:35:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 90/171 2024-01-22T05:35:52.568 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 91/171 2024-01-22T05:35:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 92/171 2024-01-22T05:35:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 93/171 2024-01-22T05:35:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 94/171 2024-01-22T05:35:53.500 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 95/171 2024-01-22T05:35:53.677 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 96/171 2024-01-22T05:35:53.872 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 97/171 2024-01-22T05:35:54.081 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 98/171 2024-01-22T05:35:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.7-17.el8.x86_64 99/171 2024-01-22T05:35:54.505 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 100/171 2024-01-22T05:35:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 101/171 2024-01-22T05:35:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 102/171 2024-01-22T05:35:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 102/171 2024-01-22T05:35:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 102/171 2024-01-22T05:35:59.070 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 103/171 2024-01-22T05:35:59.274 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 103/171 2024-01-22T05:35:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 104/171 2024-01-22T05:36:21.233 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 104/171 2024-01-22T05:36:21.233 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-01-22T05:36:21.233 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /dev 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /run 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /dev 2024-01-22T05:36:21.234 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:21.709 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 105/171 2024-01-22T05:36:22.181 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 105/171 2024-01-22T05:36:22.399 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 106/171 2024-01-22T05:36:23.992 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 106/171 2024-01-22T05:36:24.208 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 107/171 2024-01-22T05:36:24.267 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 107/171 2024-01-22T05:36:24.466 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 108/171 2024-01-22T05:36:24.662 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 109/171 2024-01-22T05:36:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 110/171 2024-01-22T05:36:24.928 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 110/171 2024-01-22T05:36:25.283 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : jq-1.6-8.el8.x86_64 111/171 2024-01-22T05:36:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.1-8.el8.noarch 112/171 2024-01-22T05:36:26.119 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 113/171 2024-01-22T05:36:26.286 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 113/171 2024-01-22T05:36:26.398 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-452.g9854ba8e.e 114/171 2024-01-22T05:36:26.587 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-452.g9854ba8e. 115/171 2024-01-22T05:36:26.798 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noa 116/171 2024-01-22T05:36:27.898 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noa 116/171 2024-01-22T05:36:28.157 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.n 117/171 2024-01-22T05:36:29.305 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.n 117/171 2024-01-22T05:36:29.498 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-452.g985 118/171 2024-01-22T05:36:29.622 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-452.g985 118/171 2024-01-22T05:36:30.016 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-452.g9854ba8e.el 119/171 2024-01-22T05:36:30.257 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 120/171 2024-01-22T05:36:30.309 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 120/171 2024-01-22T05:36:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 121/171 2024-01-22T05:36:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 121/171 2024-01-22T05:36:30.749 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:16.2.14-452.g9854ba8e.el8.x86_64 122/171 2024-01-22T05:36:30.898 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/171 2024-01-22T05:36:35.726 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/171 2024-01-22T05:36:37.061 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:16.2.14-452.g9854ba8e.el8.x86_64 124/171 2024-01-22T05:36:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 125/171 2024-01-22T05:36:37.459 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 125/171 2024-01-22T05:36:37.706 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-452.g9854b 126/171 2024-01-22T05:36:37.774 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-452.g9854b 126/171 2024-01-22T05:36:38.014 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 127/171 2024-01-22T05:36:38.403 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 127/171 2024-01-22T05:36:38.659 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 128/171 2024-01-22T05:36:38.790 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 128/171 2024-01-22T05:36:40.041 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 129/171 2024-01-22T05:36:40.343 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 130/171 2024-01-22T05:36:40.604 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 131/171 2024-01-22T05:36:40.819 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/171 2024-01-22T05:36:40.992 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/171 2024-01-22T05:36:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:16.2.14-452.g9854ba8e.el8.x86_ 134/171 2024-01-22T05:36:41.403 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.40.16-14.el8.x86_64 135/171 2024-01-22T05:36:41.673 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.40.16-14.el8.x86_64 136/171 2024-01-22T05:36:41.942 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 137/171 2024-01-22T05:36:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 138/171 2024-01-22T05:36:42.386 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 139/171 2024-01-22T05:36:42.588 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:16.2.14-452.g9854ba8e.el8.noarch 140/171 2024-01-22T05:36:42.855 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 141/171 2024-01-22T05:36:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:16.2.14-452.g9854ba8e.el8.x86_64 142/171 2024-01-22T05:36:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 143/171 2024-01-22T05:36:44.005 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 144/171 2024-01-22T05:36:44.200 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/171 2024-01-22T05:36:44.470 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.1-9.el8.x86_64 146/171 2024-01-22T05:36:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 146/171 2024-01-22T05:36:44.829 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.0.4-10.el8.x86_64 147/171 2024-01-22T05:36:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 147/171 2024-01-22T05:36:45.039 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 148/171 2024-01-22T05:36:45.222 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 149/171 2024-01-22T05:36:45.425 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 150/171 2024-01-22T05:36:45.656 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 151/171 2024-01-22T05:36:45.838 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 152/171 2024-01-22T05:36:45.838 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 153/171 2024-01-22T05:36:46.159 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 153/171 2024-01-22T05:36:46.159 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 154/171 2024-01-22T05:36:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 154/171 2024-01-22T05:36:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 155/171 2024-01-22T05:36:46.716 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 155/171 2024-01-22T05:36:46.882 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 156/171 2024-01-22T05:36:47.022 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 157/171 2024-01-22T05:36:47.247 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 158/171 2024-01-22T05:36:47.446 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 159/171 2024-01-22T05:36:47.672 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 160/171 2024-01-22T05:36:47.672 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 161/171 2024-01-22T05:36:47.915 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 161/171 2024-01-22T05:36:47.915 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 162/171 2024-01-22T05:36:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 162/171 2024-01-22T05:36:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 163/171 2024-01-22T05:36:48.407 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 163/171 2024-01-22T05:36:48.548 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 164/171 2024-01-22T05:36:48.569 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 165/171 2024-01-22T05:36:48.570 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 165/171 2024-01-22T05:36:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 165/171 2024-01-22T05:36:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 166/171 2024-01-22T05:36:49.382 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 166/171 2024-01-22T05:36:49.382 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 167/171 2024-01-22T05:36:49.589 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 167/171 2024-01-22T05:36:49.590 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 168/171 2024-01-22T05:36:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 168/171 2024-01-22T05:36:50.013 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 169/171 2024-01-22T05:36:50.139 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 170/171 2024-01-22T05:36:50.139 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 171/171 2024-01-22T05:36:50.686 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 171/171 2024-01-22T05:36:50.687 INFO:teuthology.orchestra.run.smithi169.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-22T05:36:50.687 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:16.2.14-452.g9854ba8e.el8.x86_64 1/171 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 2/171 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 3/171 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 4/171 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-452.g9854b 5/171 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 6/171 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 7/171 2024-01-22T05:36:51.390 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 8/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 9/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 10/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 11/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:16.2.14-452.g9854ba8e.el8.x86_64 12/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 13/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:16.2.14-452.g9854ba8e.el8.x86_ 14/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 15/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 16/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:16.2.14-452.g9854ba8e.el8.x86_6 17/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86 18/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 19/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:16.2.14-452.g9854ba8e.el 20/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:16.2.14-452.g9854ba8e.el8. 21/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:16.2.14-452.g9854ba8e.el8.x86_6 22/171 2024-01-22T05:36:51.391 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:16.2.14-452.g9854ba8e.el8.x86_64 23/171 2024-01-22T05:36:51.392 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:16.2.14-452.g9854ba8e.el8.x86_64 24/171 2024-01-22T05:36:51.392 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:16.2.14-452.g9854ba8e.el8.x86_64 25/171 2024-01-22T05:36:51.392 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 26/171 2024-01-22T05:36:51.392 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 27/171 2024-01-22T05:36:51.392 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:16.2.14-452.g9854ba8e.el8.x86_64 28/171 2024-01-22T05:36:51.392 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-452.g9854ba8e. 29/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noa 30/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.n 31/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-452.g985 32/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-452.g9854ba8e.el 33/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 34/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-452.g9854ba8e.e 35/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 36/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:16.2.14-452.g9854ba8e.el8.noarch 37/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.1-8.el8.noarch 38/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/171 2024-01-22T05:36:51.405 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : jq-1.6-8.el8.x86_64 41/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 42/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 45/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/171 2024-01-22T05:36:51.406 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 60/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 61/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 65/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/171 2024-01-22T05:36:51.407 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 71/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 72/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 73/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 76/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 79/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/171 2024-01-22T05:36:51.408 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 84/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/171 2024-01-22T05:36:51.409 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/171 2024-01-22T05:36:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/171 2024-01-22T05:36:51.411 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 124/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 126/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.40.16-14.el8.x86_64 128/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 129/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.40.16-14.el8.x86_64 130/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 131/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.40.16-14.el8.x86_64 132/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 133/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.40.16-14.el8.x86_64 134/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 135/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : acl-2.2.53-3.el8.x86_64 136/171 2024-01-22T05:36:51.412 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : acl-2.2.53-1.el8.x86_64 137/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 138/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 139/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 140/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 141/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 142/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 143/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 144/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 145/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 146/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 147/171 2024-01-22T05:36:51.413 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 148/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 149/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 150/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 151/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 152/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 153/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 154/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 155/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 156/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 157/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 158/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 159/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 160/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 161/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 162/171 2024-01-22T05:36:51.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 163/171 2024-01-22T05:36:51.415 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 164/171 2024-01-22T05:36:51.415 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 165/171 2024-01-22T05:36:51.415 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 166/171 2024-01-22T05:36:51.415 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 167/171 2024-01-22T05:36:51.415 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 168/171 2024-01-22T05:36:51.415 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 169/171 2024-01-22T05:36:51.415 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 170/171 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 171/171 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.40.16-14.el8.x86_64 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.40.16-14.el8.x86_64 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.40.16-14.el8.x86_64 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.40.16-14.el8.x86_64 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: acl-2.2.53-3.el8.x86_64 2024-01-22T05:36:53.429 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: iproute-6.2.0-5.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: libacl-2.2.53-3.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: libacl-devel-2.2.53-3.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: libblkid-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: libmount-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-01-22T05:36:53.430 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: xfsdump-3.1.8-7.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.1-8.el8.noarch 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.0.4-10.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.431 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:16.2.14-452.g9854ba8e.el8.noarch 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.1-9.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: jq-1.6-8.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: leveldb-1.22-1.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-22T05:36:53.433 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-01-22T05:36:53.434 INFO:teuthology.orchestra.run.smithi169.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-25.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.15-4.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-01-22T05:36:53.435 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-apipkg-1.5-6.el8.noarch 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-22T05:36:53.436 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-22T05:36:53.437 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-2.6-1.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.438 INFO:teuthology.orchestra.run.smithi169.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-22T05:36:53.439 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:16.2.14-452.g9854ba8e.el8.x86_64 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-01-22T05:36:53.440 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-22T05:36:53.441 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-01-22T05:36:53.441 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:53.441 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-01-22T05:36:53.779 DEBUG:teuthology.parallel:result is None 2024-01-22T05:36:53.780 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:36:53.996 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-22T05:36:54.057 INFO:teuthology.orchestra.run.smithi100.stdout:16.2.14-452.g9854ba8e.el8 2024-01-22T05:36:54.058 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-452.g9854ba8e.el8 2024-01-22T05:36:54.058 INFO:teuthology.task.install:The correct ceph version 16.2.14-452.g9854ba8e is installed. 2024-01-22T05:36:54.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9854ba8e5f82e4476d4c6c06dd8feefca92b8b32 2024-01-22T05:36:54.280 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-22T05:36:54.335 INFO:teuthology.orchestra.run.smithi169.stdout:16.2.14-452.g9854ba8e.el8 2024-01-22T05:36:54.335 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-452.g9854ba8e.el8 2024-01-22T05:36:54.335 INFO:teuthology.task.install:The correct ceph version 16.2.14-452.g9854ba8e is installed. 2024-01-22T05:36:54.337 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-22T05:36:54.337 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:54.337 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-22T05:36:54.412 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:54.412 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-22T05:36:54.485 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-22T05:36:54.485 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:54.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-01-22T05:36:54.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-22T05:36:54.659 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:54.660 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-01-22T05:36:54.727 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-22T05:36:54.838 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-22T05:36:54.838 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:54.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-22T05:36:54.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-22T05:36:55.009 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:55.009 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-22T05:36:55.077 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-22T05:36:55.185 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-22T05:36:55.185 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:55.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-01-22T05:36:55.250 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-22T05:36:55.356 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:55.356 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-01-22T05:36:55.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-22T05:36:55.532 INFO:teuthology.run_tasks:Running task ceph... 2024-01-22T05:36:55.601 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-22T05:36:55.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-01-22T05:36:55.606 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-01-22T05:36:55.675 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-22T05:36:55.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-22T05:36:55.679 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-22T05:36:55.747 INFO:tasks.ceph:Creating extra log directories... 2024-01-22T05:36:55.748 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-22T05:36:55.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-22T05:36:55.826 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-22T05:36:55.826 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-22T05:36:55.826 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-22T05:36:55.827 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:55.827 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-22T05:36:55.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-22T05:36:56.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-22T05:36:56.138 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:56.138 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-22T05:36:56.185 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-22T05:36:56.382 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-22T05:36:56.455 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-22T05:36:56.455 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-22T05:36:56.455 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548', 'branch': 'wip-vshankar-testing-pacific-020240119.072505', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7523548', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-pacific-020240119.072505'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-pacific-020240119.072505', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2977, 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32', 'sleep_before_teardown': 0, 'subset': '749/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-pacific-020240119.072505', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32', 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwSizrvfzR8Fk6c0OwIg3nxwin5xjeJagPPR62n77/6m+EfIVl9lOs+/hBP48MzFgVssA3OXOcEF7u9LsoXfKM=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC3AJjPlDunMOVr3M4j8HfyCqaM7PdUExu8sYm7XZNbpc7zDBKM8BTTjL9LkPZZVyk0KF1oHAB6RM1K9fY9uYLk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9854ba8e5f82e4476d4c6c06dd8feefca92b8b32'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-19_15:47:44', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-22T05:36:56.456 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-22T05:36:56.460 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-22T05:36:56.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-01-22T05:36:56.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-01-22T05:36:56.612 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:56.612 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-01-22T05:36:56.655 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-22T05:36:56.656 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-01-22T05:36:56.739 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 448 Links: 1 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-22 05:19:14.055112829 +0000 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-22 05:12:31.090839057 +0000 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-22 05:12:31.090839057 +0000 2024-01-22T05:36:56.740 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-22 05:12:31.063839751 +0000 2024-01-22T05:36:56.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-22T05:36:56.842 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-22T05:36:56.843 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-22T05:36:56.843 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000323302 s, 1.6 MB/s 2024-01-22T05:36:56.845 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-22T05:36:56.891 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 454 Links: 1 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-22 05:19:14.055112829 +0000 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-22 05:12:31.559827005 +0000 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-22 05:12:31.559827005 +0000 2024-01-22T05:36:56.975 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-22 05:12:31.532827699 +0000 2024-01-22T05:36:56.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-22T05:36:57.078 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-22T05:36:57.078 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-22T05:36:57.078 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000304941 s, 1.7 MB/s 2024-01-22T05:36:57.080 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-22T05:36:57.126 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 460 Links: 1 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-22 05:19:14.055112829 +0000 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-22 05:12:32.015815287 +0000 2024-01-22T05:36:57.170 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-22 05:12:32.015815287 +0000 2024-01-22T05:36:57.171 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-22 05:12:31.989815955 +0000 2024-01-22T05:36:57.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-22T05:36:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-22T05:36:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-22T05:36:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000287429 s, 1.8 MB/s 2024-01-22T05:36:57.275 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-22T05:36:57.321 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-01-22T05:36:57.404 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-22T05:36:57.404 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:57.404 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 466 Links: 1 2024-01-22T05:36:57.404 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:57.405 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:57.405 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-22 05:19:14.055112829 +0000 2024-01-22T05:36:57.405 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-22 05:12:32.501802798 +0000 2024-01-22T05:36:57.405 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-22 05:12:32.501802798 +0000 2024-01-22T05:36:57.405 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-22 05:12:32.476803440 +0000 2024-01-22T05:36:57.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-22T05:36:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-22T05:36:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-22T05:36:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000313257 s, 1.6 MB/s 2024-01-22T05:36:57.510 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-22T05:36:57.555 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:36:57.555 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:57.555 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-01-22T05:36:57.599 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-22T05:36:57.599 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-01-22T05:36:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 444 Links: 1 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-01-22 05:36:50.889228205 +0000 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-01-22 05:16:06.616407899 +0000 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-01-22 05:16:06.616407899 +0000 2024-01-22T05:36:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-01-22 05:16:06.590408466 +0000 2024-01-22T05:36:57.688 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-22T05:36:57.793 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-01-22T05:36:57.793 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-01-22T05:36:57.794 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.00029066 s, 1.8 MB/s 2024-01-22T05:36:57.796 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-22T05:36:57.843 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 450 Links: 1 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-01-22 05:36:50.889228205 +0000 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-01-22 05:16:07.082397727 +0000 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-01-22 05:16:07.082397727 +0000 2024-01-22T05:36:57.889 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-01-22 05:16:07.056398295 +0000 2024-01-22T05:36:57.890 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-22T05:36:57.953 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-01-22T05:36:57.954 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-01-22T05:36:57.954 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000282955 s, 1.8 MB/s 2024-01-22T05:36:57.956 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-22T05:36:58.005 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-01-22T05:36:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 456 Links: 1 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-01-22 05:36:50.889228205 +0000 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-01-22 05:16:07.561387272 +0000 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-01-22 05:16:07.561387272 +0000 2024-01-22T05:36:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-01-22 05:16:07.537387796 +0000 2024-01-22T05:36:58.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-22T05:36:58.114 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-01-22T05:36:58.114 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-01-22T05:36:58.114 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000280036 s, 1.8 MB/s 2024-01-22T05:36:58.116 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-22T05:36:58.163 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-01-22T05:36:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-22T05:36:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T05:36:58.208 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 462 Links: 1 2024-01-22T05:36:58.208 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T05:36:58.208 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T05:36:58.208 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-01-22 05:36:50.889228205 +0000 2024-01-22T05:36:58.208 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-01-22 05:16:08.045376698 +0000 2024-01-22T05:36:58.209 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-01-22 05:16:08.045376698 +0000 2024-01-22T05:36:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-01-22 05:16:08.018377290 +0000 2024-01-22T05:36:58.209 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-22T05:36:58.314 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-01-22T05:36:58.314 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-01-22T05:36:58.314 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000303685 s, 1.7 MB/s 2024-01-22T05:36:58.316 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-22T05:36:58.363 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:36:58.363 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-22T05:36:58.363 INFO:tasks.ceph:Generating config... 2024-01-22T05:36:58.365 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-22T05:36:58.365 INFO:tasks.ceph:[client] debug client = 20 2024-01-22T05:36:58.365 INFO:tasks.ceph:[client] debug ms = 1 2024-01-22T05:36:58.365 INFO:tasks.ceph:[client] pid file = 2024-01-22T05:36:58.365 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-22T05:36:58.365 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-22T05:36:58.365 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-22T05:36:58.366 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-22T05:36:58.367 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-22T05:36:58.368 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-22T05:36:58.368 INFO:tasks.ceph:Setting up mon.a... 2024-01-22T05:36:58.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-22T05:36:58.553 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2024-01-22T05:36:58.558 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-22T05:36:58.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T05:36:58.716 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2024-01-22T05:36:58.717 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-22T05:36:58.717 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:58.718 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-22T05:36:58.761 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:36:58.880 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid 2373e7ef-4ea1-4c09-a2b1-243cb5e8dade 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 2373e7ef-4ea1-4c09-a2b1-243cb5e8dade 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2024-01-22T05:36:58.881560+0000 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-01-22T05:36:58.881560+0000 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 0 (unknown) 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2024-01-22T05:36:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-22T05:36:58.883 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-22T05:36:58.926 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2373e7ef-4ea1-4c09-a2b1-243cb5e8dade... 2024-01-22T05:36:58.927 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:36:58.971 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T05:36:59.077 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-01-22T05:36:59.077 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-01-22T05:36:59.077 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:36:59.077 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-01-22T05:36:59.077 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.077 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-01-22T05:36:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:36:59.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 2373e7ef-4ea1-4c09-a2b1-243cb5e8dade 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.080 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-01-22T05:36:59.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-01-22T05:36:59.082 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-01-22T05:36:59.083 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-01-22T05:36:59.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:36:59.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-01-22T05:36:59.086 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-01-22T05:36:59.087 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-01-22T05:36:59.088 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-01-22T05:36:59.088 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-01-22T05:36:59.136 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-01-22T05:36:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-01-22T05:36:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T05:36:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-01-22T05:36:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-01-22T05:36:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.100,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 2373e7ef-4ea1-4c09-a2b1-243cb5e8dade 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-01-22T05:36:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-01-22T05:36:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-01-22T05:36:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-01-22T05:36:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-01-22T05:36:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-01-22T05:36:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-01-22T05:36:59.146 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-01-22T05:36:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-01-22T05:36:59.165 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-22T05:36:59.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-22T05:36:59.265 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-22T05:36:59.265 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:59.266 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-22T05:36:59.309 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:59.309 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-22T05:36:59.392 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:36:59.393 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:59.393 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-22T05:36:59.393 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T05:36:59.521 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:36:59.521 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:36:59.605 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:36:59.605 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:59.605 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-22T05:36:59.605 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T05:36:59.703 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:36:59.703 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:36:59.787 INFO:tasks.ceph:Setting up mon nodes... 2024-01-22T05:36:59.787 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-22T05:36:59.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-22T05:36:59.896 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-22T05:36:59.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-22T05:37:00.207 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-22T05:37:00.213 INFO:tasks.ceph:Setting up mds nodes... 2024-01-22T05:37:00.213 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-22T05:37:00.324 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-22T05:37:00.328 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-22T05:37:00.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-22T05:37:00.504 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-22T05:37:00.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-22T05:37:00.575 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-22T05:37:00.685 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-22T05:37:00.691 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-22T05:37:00.757 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-22T05:37:00.866 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-22T05:37:00.871 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-22T05:37:00.935 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-22T05:37:00.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-22T05:37:01.022 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-22T05:37:01.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-22T05:37:01.135 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-22T05:37:01.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-22T05:37:01.250 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-22T05:37:01.471 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-22T05:37:01.557 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-22T05:37:01.584 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-22T05:37:01.585 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-22T05:37:01.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-22T05:37:01.651 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:01.651 INFO:tasks.ceph:role: osd.0 2024-01-22T05:37:01.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:37:01.651 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-22T05:37:01.723 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:01.724 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:02.148 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-22T05:37:02.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-22T05:37:02.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-22T05:37:02.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-22T05:37:02.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-22T05:37:02.489 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:02.489 INFO:tasks.ceph:role: osd.1 2024-01-22T05:37:02.490 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:37:02.490 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-22T05:37:02.562 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:02.562 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:02.562 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:02.562 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:02.562 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:02.562 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:02.563 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:02.563 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:02.563 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:02.563 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:02.971 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-22T05:37:02.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-22T05:37:02.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-22T05:37:03.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-22T05:37:03.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-22T05:37:03.238 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:03.239 INFO:tasks.ceph:role: osd.2 2024-01-22T05:37:03.239 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:37:03.239 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-22T05:37:03.311 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:03.312 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:03.312 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:03.312 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:03.312 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:03.759 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-22T05:37:03.763 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-22T05:37:03.763 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-22T05:37:03.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-22T05:37:03.985 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-22T05:37:04.051 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:04.051 INFO:tasks.ceph:role: osd.3 2024-01-22T05:37:04.051 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:37:04.051 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-22T05:37:04.124 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:04.124 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:04.124 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:04.124 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:04.125 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:04.125 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:04.125 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:04.125 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:04.125 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:04.125 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:04.556 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-22T05:37:04.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-22T05:37:04.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-22T05:37:04.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-22T05:37:04.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:04.928+0000 7f6db4ede380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-22T05:37:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:04.929+0000 7f6db4ede380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-22T05:37:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:04.929+0000 7f6db4ede380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T05:37:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:04.929+0000 7f6db4ede380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T05:37:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:04.929+0000 7f6db4ede380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T05:37:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:04.932+0000 7f6db4ede380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-22T05:37:08.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-22T05:37:08.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:08.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:08.228+0000 7f8cb28e7380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-22T05:37:08.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:08.228+0000 7f8cb28e7380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-22T05:37:08.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:08.228+0000 7f8cb28e7380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T05:37:08.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:08.228+0000 7f8cb28e7380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T05:37:08.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:08.228+0000 7f8cb28e7380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T05:37:08.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:08.230+0000 7f8cb28e7380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-22T05:37:11.358 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-22T05:37:11.427 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:11.521+0000 7f9f5138b380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-22T05:37:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:11.522+0000 7f9f5138b380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-22T05:37:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:11.522+0000 7f9f5138b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T05:37:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:11.522+0000 7f9f5138b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T05:37:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:11.522+0000 7f9f5138b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T05:37:11.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:11.523+0000 7f9f5138b380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-22T05:37:14.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-22T05:37:14.714 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:14.807+0000 7f434b371380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-22T05:37:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:14.807+0000 7f434b371380 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-22T05:37:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:14.807+0000 7f434b371380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T05:37:14.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:14.807+0000 7f434b371380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T05:37:14.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:14.807+0000 7f434b371380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T05:37:14.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:14.809+0000 7f434b371380 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-22T05:37:17.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-22T05:37:17.999 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-22T05:37:18.074 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:18.074 INFO:tasks.ceph:role: osd.4 2024-01-22T05:37:18.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:37:18.074 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:18.149 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:18.150 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:18.150 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:18.574 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-01-22T05:37:18.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-01-22T05:37:18.578 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-22T05:37:18.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-22T05:37:18.862 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-22T05:37:18.929 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:18.929 INFO:tasks.ceph:role: osd.5 2024-01-22T05:37:18.929 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:37:18.929 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-22T05:37:19.002 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:19.002 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:19.002 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:19.002 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:19.002 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:19.002 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:19.003 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:19.003 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:19.003 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:19.003 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:19.416 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-01-22T05:37:19.420 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-01-22T05:37:19.420 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-22T05:37:19.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-22T05:37:19.660 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-22T05:37:19.726 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:19.726 INFO:tasks.ceph:role: osd.6 2024-01-22T05:37:19.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:37:19.727 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-22T05:37:19.799 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:19.800 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:20.251 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-01-22T05:37:20.255 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-01-22T05:37:20.255 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-22T05:37:20.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-22T05:37:20.498 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-22T05:37:20.564 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T05:37:20.564 INFO:tasks.ceph:role: osd.7 2024-01-22T05:37:20.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:37:20.564 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-22T05:37:20.637 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T05:37:20.637 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T05:37:20.637 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T05:37:20.637 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-22T05:37:20.638 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T05:37:20.638 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-01-22T05:37:20.638 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T05:37:20.638 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-22T05:37:20.638 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T05:37:20.638 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T05:37:21.074 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-01-22T05:37:21.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-01-22T05:37:21.079 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-22T05:37:21.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-22T05:37:21.303 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:21.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:21.452+0000 7f0c99214380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-22T05:37:21.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:21.452+0000 7f0c99214380 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-22T05:37:21.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:21.452+0000 7f0c99214380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T05:37:21.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:21.452+0000 7f0c99214380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T05:37:21.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:21.452+0000 7f0c99214380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T05:37:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:21.454+0000 7f0c99214380 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-22T05:37:24.587 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-22T05:37:24.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:24.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:24.748+0000 7f61398d2380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-22T05:37:24.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:24.748+0000 7f61398d2380 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-22T05:37:24.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:24.748+0000 7f61398d2380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T05:37:24.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:24.748+0000 7f61398d2380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T05:37:24.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:24.748+0000 7f61398d2380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T05:37:24.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:24.750+0000 7f61398d2380 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-22T05:37:26.457 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:37:26.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:37:27.871 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-22T05:37:27.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:28.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:28.032+0000 7fc781eb7380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-22T05:37:28.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:28.033+0000 7fc781eb7380 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-22T05:37:28.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:28.033+0000 7fc781eb7380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T05:37:28.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:28.033+0000 7fc781eb7380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T05:37:28.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:28.033+0000 7fc781eb7380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T05:37:28.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:28.034+0000 7fc781eb7380 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-22T05:37:31.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-22T05:37:31.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:31.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:31.324+0000 7f2461f7c380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-22T05:37:31.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:31.325+0000 7f2461f7c380 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-22T05:37:31.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:31.325+0000 7f2461f7c380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T05:37:31.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:31.325+0000 7f2461f7c380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T05:37:31.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:31.325+0000 7f2461f7c380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T05:37:31.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:31.327+0000 7f2461f7c380 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-22T05:37:34.463 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-22T05:37:34.533 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-22T05:37:34.533 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:34.533 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-22T05:37:34.605 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:34.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-22T05:37:34.672 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:34.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-22T05:37:34.777 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:34.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-22T05:37:34.882 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:34.882 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-22T05:37:34.988 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:34.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-22T05:37:35.094 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:35.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-22T05:37:35.199 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:35.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-22T05:37:35.269 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:35.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-22T05:37:35.376 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:35.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-22T05:37:35.482 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:35.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-22T05:37:35.587 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:35.587 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-22T05:37:35.693 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:35.693 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-22T05:37:35.798 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:35.798 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-22T05:37:35.904 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:35.904 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-22T05:37:35.953 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:35.953 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-22T05:37:36.038 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:36.038 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-22T05:37:36.082 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:36.082 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-22T05:37:36.165 INFO:tasks.ceph:Adding keys to all mons... 2024-01-22T05:37:36.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-22T05:37:36.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD7/q1lKDyANRAALG48jCFnVwioSX/dTJfBNQ== 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD8/q1lKhBbExAAP1BrokBcKT5wpIYo2LQizA== 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD8/q1ldUwfHhAAGDh9/oyieZZj+nYGld/h5w== 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAA/61l9LR1NxAAx58Vl+r8QVwCEFHkEv4HJw== 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAE/61lSe6xDRAAaFPsyQZNCGPUSo/m2jqETQ== 2024-01-22T05:37:36.229 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAH/61lK8MxHxAACcVEookX0aW2movigxC2rQ== 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAK/61lnYc0MBAAOR9vmCTVgAEbjys3KinSew== 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD8/q1lBYNsDBAAy201tfKKfFR4d3U8DtGtoQ== 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD8/q1l5WvtKBAAGBD5pmKa1sf0TSX+OYjENw== 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD8/q1lo2avMxAAz3VifArccipq4F2K0FH9Kw== 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAR/61l6P8NGxAA/DPstaukdx0isfDgWNW4MA== 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAU/61lWuCvLBAA8Cd63Y9QlhRZHSJy/DUb8g== 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-01-22T05:37:36.230 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAY/61lYmcMAhAA3ghp6xyqtWETmgFA/Szq8A== 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAb/61lr2xlExAANagHPAeO/tTQ4KPxCuU6tw== 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD9/q1l5dFcARAAc8i3e2d9UpF5QQY4na57gg== 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout:[client.2] 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD9/q1lq1AhCBAAmkMcm5COJ2MY+F+ZusDcrw== 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD9/q1lFHj8DhAAz0WTKY0O3XjPGv5O0PRvCQ== 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout:[client.3] 2024-01-22T05:37:36.231 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD9/q1lKApFIRAASzUDqwNZORbBGJ0T3aTCKg== 2024-01-22T05:37:36.268 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2024-01-22T05:37:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD7/q1lKDyANRAALG48jCFnVwioSX/dTJfBNQ== 2024-01-22T05:37:36.268 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-01-22T05:37:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD8/q1lKhBbExAAP1BrokBcKT5wpIYo2LQizA== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD8/q1ldUwfHhAAGDh9/oyieZZj+nYGld/h5w== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAA/61l9LR1NxAAx58Vl+r8QVwCEFHkEv4HJw== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAE/61lSe6xDRAAaFPsyQZNCGPUSo/m2jqETQ== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAH/61lK8MxHxAACcVEookX0aW2movigxC2rQ== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAK/61lnYc0MBAAOR9vmCTVgAEbjys3KinSew== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD8/q1lBYNsDBAAy201tfKKfFR4d3U8DtGtoQ== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD8/q1l5WvtKBAAGBD5pmKa1sf0TSX+OYjENw== 2024-01-22T05:37:36.269 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD8/q1lo2avMxAAz3VifArccipq4F2K0FH9Kw== 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAR/61l6P8NGxAA/DPstaukdx0isfDgWNW4MA== 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAU/61lWuCvLBAA8Cd63Y9QlhRZHSJy/DUb8g== 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAY/61lYmcMAhAA3ghp6xyqtWETmgFA/Szq8A== 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAb/61lr2xlExAANagHPAeO/tTQ4KPxCuU6tw== 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD9/q1l5dFcARAAc8i3e2d9UpF5QQY4na57gg== 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout:[client.2] 2024-01-22T05:37:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD9/q1lq1AhCBAAmkMcm5COJ2MY+F+ZusDcrw== 2024-01-22T05:37:36.271 INFO:teuthology.orchestra.run.smithi169.stdout:[client.1] 2024-01-22T05:37:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD9/q1lFHj8DhAAz0WTKY0O3XjPGv5O0PRvCQ== 2024-01-22T05:37:36.271 INFO:teuthology.orchestra.run.smithi169.stdout:[client.3] 2024-01-22T05:37:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD9/q1lKApFIRAASzUDqwNZORbBGJ0T3aTCKg== 2024-01-22T05:37:36.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:37:36.277 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:37:36.409 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:36.414 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:36.514 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:36.519 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:36.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:36.622 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:36.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:36.723 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:36.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:36.825 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:36.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:36.927 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:37:37.029 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T05:37:37.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:37.131 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:37.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:37.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T05:37:37.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.340 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.442 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.540 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.544 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.642 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.646 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T05:37:37.743 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:37.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:37.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:37.853 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:37.953 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:37.959 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:38.059 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:38.064 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T05:37:38.165 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-22T05:37:38.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-22T05:37:38.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T05:37:38.344 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-22T05:37:38.409 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-22T05:37:38.477 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T05:37:38.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-22T05:37:38.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-22T05:37:38.720 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T05:37:38.831 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-22T05:37:38.897 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:38.902 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-22T05:37:38.945 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-22T05:37:38.945 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-22T05:37:38.946 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-22T05:37:38.987 INFO:tasks.ceph.mon.a:Started 2024-01-22T05:37:38.987 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-22T05:37:38.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-22T05:37:38.991 INFO:tasks.ceph.mon.b:Started 2024-01-22T05:37:38.991 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-22T05:37:38.991 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-22T05:37:38.995 INFO:tasks.ceph.mon.c:Started 2024-01-22T05:37:38.995 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-22T05:37:38.995 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-22T05:37:38.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-22T05:37:38.999 INFO:tasks.ceph.mgr.y:Started 2024-01-22T05:37:38.999 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-22T05:37:38.999 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-22T05:37:39.004 INFO:tasks.ceph.mgr.x:Started 2024-01-22T05:37:39.004 INFO:tasks.ceph:Setting crush tunables to default 2024-01-22T05:37:39.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2024-01-22T05:37:39.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.189+0000 7f2fe8400700 1 Processor -- start 2024-01-22T05:37:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.189+0000 7f2fe8400700 1 -- start start 2024-01-22T05:37:39.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe8400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fe0158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:39.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe8400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00c1a40 con 0x7f2fe01586f0 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe8400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00cbd30 con 0x7f2fe0154260 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe8400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0158b80 con 0x7f2fe0157d80 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fe0158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fe0158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:37966/0 (socket says 172.21.15.100:37966) 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe5000700 1 -- 172.21.15.100:0/3409842293 learned_addr learned my addr 172.21.15.100:0/3409842293 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe5000700 1 -- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 msgr2=0x7f2fe0158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe5000700 1 -- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 msgr2=0x7f2fe0158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe5000700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fe0158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-01-22T05:37:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.191+0000 7f2fe5000700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fe0158200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-01-22T05:37:39.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.378+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831707219 0 0) 0x7f2fe00cbd30 con 0x7f2fe0154260 2024-01-22T05:37:39.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.378+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc00033f0 con 0x7f2fe0154260 2024-01-22T05:37:39.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.378+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939152656 0 0) 0x7f2fe00c1a40 con 0x7f2fe01586f0 2024-01-22T05:37:39.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.378+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe00cbd30 con 0x7f2fe01586f0 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.378+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 144337297 0 0) 0x7f2fe00cbd30 con 0x7f2fe01586f0 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 msgr2=0x7f2fe0158200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fe0158200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 >> v1:172.21.15.169:6789/0 conn(0x7f2fe0154260 legacy=0x7f2fe00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00c1110 con 0x7f2fe01586f0 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f2fd80017f0 con 0x7f2fe01586f0 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 >> v1:172.21.15.100:6789/0 conn(0x7f2fe01586f0 legacy=0x7f2fe00c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fc0004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fc0003630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc0003b20 0x7f2fc0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0158b80 con 0x7f2fc0005010 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc000ba10 con 0x7f2fc0003b20 2024-01-22T05:37:39.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc000bbd0 con 0x7f2fe0157d80 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fe5a00700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fc0004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fe5000700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fc0003630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.379+0000 7f2fe6400700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc0003b20 0x7f2fc0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fe5000700 1 -- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 msgr2=0x7f2fc0004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fe5000700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe0157d80 0x7f2fc0004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fe5000700 1 -- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc0003b20 msgr2=0x7f2fc0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fe5000700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc0003b20 0x7f2fc0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fe5000700 1 -- 172.21.15.100:0/3409842293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00c1110 con 0x7f2fc0005010 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fe5000700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fc0003630 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2fc800ba80 tx=0x7f2fc8008040).ready entity=mon.0 client_cookie=9c0ea5939af90467 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800b3f0 con 0x7f2fc0005010 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc800d5d0 con 0x7f2fc0005010 2024-01-22T05:37:39.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.380+0000 7f2fdfe00700 1 -- 172.21.15.100:0/3409842293 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800d970 con 0x7f2fc0005010 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.381+0000 7f2fe8400700 1 -- 172.21.15.100:0/3409842293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 msgr2=0x7f2fc0003630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.381+0000 7f2fe8400700 1 --2- 172.21.15.100:0/3409842293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fc0003630 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2fc800ba80 tx=0x7f2fc8008040).stop 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.381+0000 7f2fe6400700 1 -- 172.21.15.100:0/3409842293 reap_dead start 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.381+0000 7f2fe8400700 1 -- 172.21.15.100:0/3409842293 shutdown_connections 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.381+0000 7f2fe8400700 1 -- 172.21.15.100:0/3409842293 >> 172.21.15.100:0/3409842293 conn(0x7f2fe005e9d0 msgr2=0x7f2fe00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.381+0000 7f2fe8400700 1 -- 172.21.15.100:0/3409842293 shutdown_connections 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.381+0000 7f2fe8400700 1 -- 172.21.15.100:0/3409842293 wait complete. 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.383+0000 7f2fe8400700 1 Processor -- start 2024-01-22T05:37:39.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.383+0000 7f2fe8400700 1 -- start start 2024-01-22T05:37:39.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.384+0000 7f2fe8400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fe01652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:39.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.384+0000 7f2fe8400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe00af650 0x7f2fe00afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:39.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.384+0000 7f2fe8400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe00c74a0 0x7f2fe00c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:39.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.384+0000 7f2fe8400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00aa6d0 con 0x7f2fc0005010 2024-01-22T05:37:39.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.384+0000 7f2fe8400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00affc0 con 0x7f2fe00c74a0 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.384+0000 7f2fe8400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00c7df0 con 0x7f2fe00af650 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe00af650 0x7f2fe00afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe00af650 0x7f2fe00afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:38006/0 (socket says 172.21.15.100:38006) 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 -- 172.21.15.100:0/2367463413 learned_addr learned my addr 172.21.15.100:0/2367463413 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5a00700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fe01652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe6400700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe00c74a0 0x7f2fe00c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 -- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe00c74a0 msgr2=0x7f2fe00c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe00c74a0 0x7f2fe00c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 -- 172.21.15.100:0/2367463413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 msgr2=0x7f2fe01652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fe01652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5000700 1 -- 172.21.15.100:0/2367463413 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00b0230 con 0x7f2fe00af650 2024-01-22T05:37:39.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.385+0000 7f2fe5a00700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fe01652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:39.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.386+0000 7f2fe5000700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe00af650 0x7f2fe00afad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2fc800d440 tx=0x7f2fc8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:39.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.387+0000 7f2fdcc00700 1 -- 172.21.15.100:0/2367463413 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800b3f0 con 0x7f2fe00af650 2024-01-22T05:37:39.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.387+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe00b0510 con 0x7f2fe00af650 2024-01-22T05:37:39.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.387+0000 7f2fdcc00700 1 -- 172.21.15.100:0/2367463413 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc8021070 con 0x7f2fe00af650 2024-01-22T05:37:39.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.387+0000 7f2fdcc00700 1 -- 172.21.15.100:0/2367463413 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800dce0 con 0x7f2fe00af650 2024-01-22T05:37:39.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.387+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe00b0ad0 con 0x7f2fe00af650 2024-01-22T05:37:39.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.387+0000 7f2fdcc00700 1 -- 172.21.15.100:0/2367463413 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2fc8005880 con 0x7f2fe00af650 2024-01-22T05:37:39.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.387+0000 7f2fdcc00700 1 -- 172.21.15.100:0/2367463413 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2fc80063a0 con 0x7f2fe00af650 2024-01-22T05:37:39.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.388+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe00aa840 con 0x7f2fe00af650 2024-01-22T05:37:39.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.395+0000 7f2fdcc00700 1 -- 172.21.15.100:0/2367463413 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f2fc8045e50 con 0x7f2fe00af650 2024-01-22T05:37:39.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.468+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2fe0084940 con 0x7f2fe00af650 2024-01-22T05:37:39.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.479+0000 7f2fdcc00700 1 -- 172.21.15.100:0/2367463413 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2fc8034070 con 0x7f2fe00af650 2024-01-22T05:37:39.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe00af650 msgr2=0x7f2fe00afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:39.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe00af650 0x7f2fe00afad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2fc800d440 tx=0x7f2fc8008040).stop 2024-01-22T05:37:39.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 shutdown_connections 2024-01-22T05:37:39.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe00c74a0 0x7f2fe00c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc0005010 0x7f2fe01652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 --2- 172.21.15.100:0/2367463413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe00af650 0x7f2fe00afad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:39.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 >> 172.21.15.100:0/2367463413 conn(0x7f2fe005e9d0 msgr2=0x7f2fe00c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:39.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 shutdown_connections 2024-01-22T05:37:39.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:39.480+0000 7f2fe8400700 1 -- 172.21.15.100:0/2367463413 wait complete. 2024-01-22T05:37:39.482 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-01-22T05:37:39.498 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-22T05:37:39.498 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:39.498 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-22T05:37:39.560 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:39.560+0000 7fc831da4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-22T05:37:39.564 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:39.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-22T05:37:39.587 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:39.586+0000 7f3e8642a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-22T05:37:39.647 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:39.647+0000 7fc831da4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-22T05:37:39.651 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:39.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-22T05:37:39.678 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:39.677+0000 7f3e8642a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-22T05:37:39.745 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-22T05:37:39.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-22T05:37:39.851 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:39.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-22T05:37:39.916 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:39.917 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-22T05:37:40.023 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:40.023 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-22T05:37:40.134 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-01-22T05:37:40.134 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-22T05:37:40.180 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:40.179+0000 7f3e8642a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-22T05:37:40.204 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:40.204+0000 7fc831da4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-22T05:37:40.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a 0 2024-01-22T05:37:40.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.430+0000 7f3a98a00700 1 Processor -- start 2024-01-22T05:37:40.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.430+0000 7f3a98a00700 1 -- start start 2024-01-22T05:37:40.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.431+0000 7f3a98a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a900c9c10 0x7f3a9015f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a98a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900c1a40 con 0x7f3a90157d80 2024-01-22T05:37:40.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a98a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900cbd30 con 0x7f3a90154260 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a98a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900c1110 con 0x7f3a900c9c10 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a96000700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f3a90154260 0x7f3a900cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:60968/0 (socket says 172.21.15.169:60968) 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a96000700 1 -- 172.21.15.169:0/2401715152 learned_addr learned my addr 172.21.15.169:0/2401715152 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a96a00700 1 --2- 172.21.15.169:0/2401715152 >> v2:172.21.15.100:3300/0 conn(0x7f3a900c9c10 0x7f3a9015f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a94c00700 1 -- 172.21.15.169:0/2401715152 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388138888 0 0) 0x7f3a900cbd30 con 0x7f3a90154260 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a94c00700 1 -- 172.21.15.169:0/2401715152 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a700033f0 con 0x7f3a90154260 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a96a00700 1 -- 172.21.15.169:0/2401715152 >> v1:172.21.15.169:6789/0 conn(0x7f3a90154260 legacy=0x7f3a900cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a96a00700 1 -- 172.21.15.169:0/2401715152 >> v1:172.21.15.100:6789/0 conn(0x7f3a90157d80 legacy=0x7f3a90158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.432+0000 7f3a96a00700 1 -- 172.21.15.169:0/2401715152 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900c13f0 con 0x7f3a900c9c10 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a96a00700 1 --2- 172.21.15.169:0/2401715152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a900c9c10 0x7f3a9015f0c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f3a88009760 tx=0x7f3a88009060).ready entity=mon.0 client_cookie=1542acefc3c524d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a94c00700 1 -- 172.21.15.169:0/2401715152 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800f510 con 0x7f3a900c9c10 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a94c00700 1 -- 172.21.15.169:0/2401715152 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800f670 con 0x7f3a900c9c10 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a94c00700 1 -- 172.21.15.169:0/2401715152 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800f9f0 con 0x7f3a900c9c10 2024-01-22T05:37:40.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a98a00700 1 -- 172.21.15.169:0/2401715152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a900c9c10 msgr2=0x7f3a9015f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a98a00700 1 --2- 172.21.15.169:0/2401715152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a900c9c10 0x7f3a9015f0c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f3a88009760 tx=0x7f3a88009060).stop 2024-01-22T05:37:40.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a98a00700 1 -- 172.21.15.169:0/2401715152 shutdown_connections 2024-01-22T05:37:40.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a98a00700 1 --2- 172.21.15.169:0/2401715152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a900c9c10 0x7f3a9015f0c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.433+0000 7f3a98a00700 1 -- 172.21.15.169:0/2401715152 >> 172.21.15.169:0/2401715152 conn(0x7f3a9005e9d0 msgr2=0x7f3a900cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:40.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.434+0000 7f3a98a00700 1 -- 172.21.15.169:0/2401715152 shutdown_connections 2024-01-22T05:37:40.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.434+0000 7f3a98a00700 1 -- 172.21.15.169:0/2401715152 wait complete. 2024-01-22T05:37:40.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.435+0000 7f3a98a00700 1 Processor -- start 2024-01-22T05:37:40.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.435+0000 7f3a98a00700 1 -- start start 2024-01-22T05:37:40.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a98a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a900c9c10 0x7f3a901489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a98a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a90154260 0x7f3a900ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a98a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a90157d80 0x7f3a90154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a98a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900ac7d0 con 0x7f3a90154260 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a98a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900abbc0 con 0x7f3a90157d80 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a98a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900abea0 con 0x7f3a900c9c10 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a96000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a900c9c10 0x7f3a901489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a96a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a90157d80 0x7f3a90154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a96a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a90157d80 0x7f3a90154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54462/0 (socket says 172.21.15.169:54462) 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a96a00700 1 -- 172.21.15.169:0/1533348998 learned_addr learned my addr 172.21.15.169:0/1533348998 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.436+0000 7f3a95600700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a90154260 0x7f3a900ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a96a00700 1 -- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a900c9c10 msgr2=0x7f3a901489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a96a00700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a900c9c10 0x7f3a901489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a96a00700 1 -- 172.21.15.169:0/1533348998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a90154260 msgr2=0x7f3a900ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a96a00700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a90154260 0x7f3a900ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a96a00700 1 -- 172.21.15.169:0/1533348998 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880092a0 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a96000700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a900c9c10 0x7f3a901489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a96a00700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a90157d80 0x7f3a90154ee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3a90083620 tx=0x7f3a88017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a8d600700 1 -- 172.21.15.169:0/1533348998 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800f9f0 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a8d600700 1 -- 172.21.15.169:0/1533348998 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800fe80 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a8d600700 1 -- 172.21.15.169:0/1533348998 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8801b660 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a900ac180 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.437+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a90148e90 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.438+0000 7f3a8d600700 1 -- 172.21.15.169:0/1533348998 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3a8801bcb0 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.438+0000 7f3a8d600700 1 -- 172.21.15.169:0/1533348998 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3a88023b30 con 0x7f3a90157d80 2024-01-22T05:37:40.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.439+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a900ac940 con 0x7f3a90157d80 2024-01-22T05:37:40.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.441+0000 7f3a8d600700 1 -- 172.21.15.169:0/1533348998 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f3a88028020 con 0x7f3a90157d80 2024-01-22T05:37:40.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.523+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a", "id": 0} v 0) v1 -- 0x7f3a900c16d0 con 0x7f3a90157d80 2024-01-22T05:37:40.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.532+0000 7f3a8d600700 1 -- 172.21.15.169:0/1533348998 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a88023d70 con 0x7f3a90157d80 2024-01-22T05:37:40.532 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a90157d80 msgr2=0x7f3a90154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a90157d80 0x7f3a90154ee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3a90083620 tx=0x7f3a88017000).stop 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 shutdown_connections 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a90157d80 0x7f3a90154ee0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a900c9c10 0x7f3a901489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 --2- 172.21.15.169:0/1533348998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a90154260 0x7f3a900ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 >> 172.21.15.169:0/1533348998 conn(0x7f3a9005e9d0 msgr2=0x7f3a900c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:40.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 shutdown_connections 2024-01-22T05:37:40.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.533+0000 7f3a98a00700 1 -- 172.21.15.169:0/1533348998 wait complete. 2024-01-22T05:37:40.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new e3fa0f3d-b64f-4171-8e6e-e9a05c475621 1 2024-01-22T05:37:40.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.728+0000 7fd884800700 1 Processor -- start 2024-01-22T05:37:40.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.728+0000 7fd884800700 1 -- start start 2024-01-22T05:37:40.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd884800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c0c54d0 0x7fd87c15f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd884800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c065720 con 0x7fd87c154fa0 2024-01-22T05:37:40.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd884800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c064b10 con 0x7fd87c155380 2024-01-22T05:37:40.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd884800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c066640 con 0x7fd87c0c54d0 2024-01-22T05:37:40.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd881400700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd87c155380 0x7fd87c0c4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:60984/0 (socket says 172.21.15.169:60984) 2024-01-22T05:37:40.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd881400700 1 -- 172.21.15.169:0/1456938830 learned_addr learned my addr 172.21.15.169:0/1456938830 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-01-22T05:37:40.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd882800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c0c54d0 0x7fd87c15f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd880a00700 1 -- 172.21.15.169:0/1456938830 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984184727 0 0) 0x7fd87c064b10 con 0x7fd87c155380 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd880a00700 1 -- 172.21.15.169:0/1456938830 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd85c0033f0 con 0x7fd87c155380 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd880a00700 1 -- 172.21.15.169:0/1456938830 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991296927 0 0) 0x7fd87c065720 con 0x7fd87c154fa0 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd882800700 1 -- 172.21.15.169:0/1456938830 >> v1:172.21.15.169:6789/0 conn(0x7fd87c155380 legacy=0x7fd87c0c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd882800700 1 -- 172.21.15.169:0/1456938830 >> v1:172.21.15.100:6789/0 conn(0x7fd87c154fa0 legacy=0x7fd87c065f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.730+0000 7fd882800700 1 -- 172.21.15.169:0/1456938830 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c064df0 con 0x7fd87c0c54d0 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.731+0000 7fd882800700 1 --2- 172.21.15.169:0/1456938830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c0c54d0 0x7fd87c15f0e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fd874009e90 tx=0x7fd874009780).ready entity=mon.2 client_cookie=5b230a78c67e560f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.731+0000 7fd880a00700 1 -- 172.21.15.169:0/1456938830 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400e070 con 0x7fd87c0c54d0 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.731+0000 7fd880a00700 1 -- 172.21.15.169:0/1456938830 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400bb60 con 0x7fd87c0c54d0 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.731+0000 7fd880a00700 1 -- 172.21.15.169:0/1456938830 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400bee0 con 0x7fd87c0c54d0 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.731+0000 7fd884800700 1 -- 172.21.15.169:0/1456938830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c0c54d0 msgr2=0x7fd87c15f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.731+0000 7fd884800700 1 --2- 172.21.15.169:0/1456938830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c0c54d0 0x7fd87c15f0e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fd874009e90 tx=0x7fd874009780).stop 2024-01-22T05:37:40.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.731+0000 7fd884800700 1 -- 172.21.15.169:0/1456938830 shutdown_connections 2024-01-22T05:37:40.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.732+0000 7fd884800700 1 --2- 172.21.15.169:0/1456938830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c0c54d0 0x7fd87c15f0e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.732+0000 7fd884800700 1 -- 172.21.15.169:0/1456938830 >> 172.21.15.169:0/1456938830 conn(0x7fd87c0630c0 msgr2=0x7fd87c0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:40.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.732+0000 7fd884800700 1 -- 172.21.15.169:0/1456938830 shutdown_connections 2024-01-22T05:37:40.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.732+0000 7fd884800700 1 -- 172.21.15.169:0/1456938830 wait complete. 2024-01-22T05:37:40.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.733+0000 7fd884800700 1 Processor -- start 2024-01-22T05:37:40.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.733+0000 7fd884800700 1 -- start start 2024-01-22T05:37:40.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd884800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87c0c54d0 0x7fd87c1414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd884800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c154fa0 0x7fd87c0bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd884800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87c155380 0x7fd87c0bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd884800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0bd540 con 0x7fd87c0c54d0 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd884800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0a91a0 con 0x7fd87c155380 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd884800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c151720 con 0x7fd87c154fa0 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd881400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c154fa0 0x7fd87c0bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd882800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87c155380 0x7fd87c0bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd882800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87c155380 0x7fd87c0bd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54466/0 (socket says 172.21.15.169:54466) 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd882800700 1 -- 172.21.15.169:0/558682565 learned_addr learned my addr 172.21.15.169:0/558682565 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.734+0000 7fd881e00700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87c0c54d0 0x7fd87c1414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd882800700 1 -- 172.21.15.169:0/558682565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c154fa0 msgr2=0x7fd87c0bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd882800700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c154fa0 0x7fd87c0bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd882800700 1 -- 172.21.15.169:0/558682565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87c0c54d0 msgr2=0x7fd87c1414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd882800700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87c0c54d0 0x7fd87c1414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd882800700 1 -- 172.21.15.169:0/558682565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874009a20 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd882800700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87c155380 0x7fd87c0bd050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd87c0c7950 tx=0x7fd874009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd879600700 1 -- 172.21.15.169:0/558682565 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87401d630 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd879600700 1 -- 172.21.15.169:0/558682565 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87401d7b0 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c150b10 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd879600700 1 -- 172.21.15.169:0/558682565 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87401db70 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.735+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c1510d0 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.736+0000 7fd879600700 1 -- 172.21.15.169:0/558682565 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd874003040 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.736+0000 7fd879600700 1 -- 172.21.15.169:0/558682565 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fd874008780 con 0x7fd87c155380 2024-01-22T05:37:40.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.737+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c151890 con 0x7fd87c155380 2024-01-22T05:37:40.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.739+0000 7fd879600700 1 -- 172.21.15.169:0/558682565 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fd874017070 con 0x7fd87c155380 2024-01-22T05:37:40.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.822+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e3fa0f3d-b64f-4171-8e6e-e9a05c475621", "id": 1} v 0) v1 -- 0x7fd87c05fdb0 con 0x7fd87c155380 2024-01-22T05:37:40.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.831+0000 7fd879600700 1 -- 172.21.15.169:0/558682565 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3fa0f3d-b64f-4171-8e6e-e9a05c475621", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd874026850 con 0x7fd87c155380 2024-01-22T05:37:40.831 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87c155380 msgr2=0x7fd87c0bd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87c155380 0x7fd87c0bd050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd87c0c7950 tx=0x7fd874009780).stop 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 shutdown_connections 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87c155380 0x7fd87c0bd050 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87c0c54d0 0x7fd87c1414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 --2- 172.21.15.169:0/558682565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd87c154fa0 0x7fd87c0bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 >> 172.21.15.169:0/558682565 conn(0x7fd87c0630c0 msgr2=0x7fd87c153130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:40.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 shutdown_connections 2024-01-22T05:37:40.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:40.832+0000 7fd884800700 1 -- 172.21.15.169:0/558682565 wait complete. 2024-01-22T05:37:40.849 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new eeb3045c-1006-4507-81b8-f3e5aa64f58d 2 2024-01-22T05:37:41.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.031+0000 7fef37400700 1 Processor -- start 2024-01-22T05:37:41.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.032+0000 7fef37400700 1 -- start start 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef37400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fef30154260 0x7fef300cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef37400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c5c80 0x7fef300c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef37400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300c1a40 con 0x7fef300c65f0 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef37400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300cbd30 con 0x7fef30154260 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef37400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300c6a80 con 0x7fef300c5c80 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef2fe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c5c80 0x7fef300c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef35400700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fef300c65f0 0x7fef30157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:60998/0 (socket says 172.21.15.169:60998) 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef35400700 1 -- 172.21.15.169:0/1741494357 learned_addr learned my addr 172.21.15.169:0/1741494357 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef34a00700 1 --2- 172.21.15.169:0/1741494357 >> v2:172.21.15.100:3300/0 conn(0x7fef30154260 0x7fef300cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef2fe00700 1 -- 172.21.15.169:0/1741494357 >> v2:172.21.15.100:3300/0 conn(0x7fef30154260 msgr2=0x7fef300cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef2fe00700 1 --2- 172.21.15.169:0/1741494357 >> v2:172.21.15.100:3300/0 conn(0x7fef30154260 0x7fef300cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef2fe00700 1 -- 172.21.15.169:0/1741494357 >> v1:172.21.15.169:6789/0 conn(0x7fef300c65f0 legacy=0x7fef30157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef2fe00700 1 -- 172.21.15.169:0/1741494357 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300c1110 con 0x7fef300c5c80 2024-01-22T05:37:41.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.034+0000 7fef2f400700 1 -- 172.21.15.169:0/1741494357 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570516492 0 0) 0x7fef300c1a40 con 0x7fef300c65f0 2024-01-22T05:37:41.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.035+0000 7fef2fe00700 1 --2- 172.21.15.169:0/1741494357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c5c80 0x7fef300c6100 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fef18009790 tx=0x7fef18009060).ready entity=mon.2 client_cookie=6ee3d1e6a248f14 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.035+0000 7fef2f400700 1 -- 172.21.15.169:0/1741494357 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800b580 con 0x7fef300c5c80 2024-01-22T05:37:41.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.035+0000 7fef2f400700 1 -- 172.21.15.169:0/1741494357 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800b6e0 con 0x7fef300c5c80 2024-01-22T05:37:41.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.035+0000 7fef2f400700 1 -- 172.21.15.169:0/1741494357 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800ba60 con 0x7fef300c5c80 2024-01-22T05:37:41.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.035+0000 7fef37400700 1 -- 172.21.15.169:0/1741494357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c5c80 msgr2=0x7fef300c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.035+0000 7fef37400700 1 --2- 172.21.15.169:0/1741494357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c5c80 0x7fef300c6100 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fef18009790 tx=0x7fef18009060).stop 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.036+0000 7fef37400700 1 -- 172.21.15.169:0/1741494357 shutdown_connections 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.036+0000 7fef37400700 1 --2- 172.21.15.169:0/1741494357 >> v2:172.21.15.100:3300/0 conn(0x7fef30154260 0x7fef300cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.036+0000 7fef37400700 1 --2- 172.21.15.169:0/1741494357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c5c80 0x7fef300c6100 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.036+0000 7fef37400700 1 -- 172.21.15.169:0/1741494357 >> 172.21.15.169:0/1741494357 conn(0x7fef3005e9d0 msgr2=0x7fef300cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.036+0000 7fef37400700 1 -- 172.21.15.169:0/1741494357 shutdown_connections 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.036+0000 7fef37400700 1 -- 172.21.15.169:0/1741494357 wait complete. 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.037+0000 7fef37400700 1 Processor -- start 2024-01-22T05:37:41.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.037+0000 7fef37400700 1 -- start start 2024-01-22T05:37:41.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef37400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef300c5c80 0x7fef300ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef37400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c65f0 0x7fef300aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef37400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30154260 0x7fef30164270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef37400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300ab0e0 con 0x7fef300c5c80 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef37400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300ab3c0 con 0x7fef30154260 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef37400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300ab6a0 con 0x7fef300c65f0 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef35400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30154260 0x7fef30164270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef2fe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c65f0 0x7fef300aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef2fe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c65f0 0x7fef300aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:39480/0 (socket says 172.21.15.169:39480) 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef35400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30154260 0x7fef30164270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54476/0 (socket says 172.21.15.169:54476) 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef2fe00700 1 -- 172.21.15.169:0/2980143344 learned_addr learned my addr 172.21.15.169:0/2980143344 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.038+0000 7fef34a00700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef300c5c80 0x7fef300ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef2fe00700 1 -- 172.21.15.169:0/2980143344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30154260 msgr2=0x7fef30164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef2fe00700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30154260 0x7fef30164270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef2fe00700 1 -- 172.21.15.169:0/2980143344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef300c5c80 msgr2=0x7fef300ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef2fe00700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef300c5c80 0x7fef300ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef2fe00700 1 -- 172.21.15.169:0/2980143344 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180092a0 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef2fe00700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c65f0 0x7fef300aa8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fef18009ee0 tx=0x7fef18017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef27e00700 1 -- 172.21.15.169:0/2980143344 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800b850 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef27e00700 1 -- 172.21.15.169:0/2980143344 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800b9b0 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300ab980 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.039+0000 7fef27e00700 1 -- 172.21.15.169:0/2980143344 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1801b660 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.040+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef300aada0 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.040+0000 7fef27e00700 1 -- 172.21.15.169:0/2980143344 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fef1801bc70 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.040+0000 7fef27e00700 1 -- 172.21.15.169:0/2980143344 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fef18024c60 con 0x7fef300c65f0 2024-01-22T05:37:41.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.041+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef300abe80 con 0x7fef300c65f0 2024-01-22T05:37:41.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.046+0000 7fef27e00700 1 -- 172.21.15.169:0/2980143344 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fef18029060 con 0x7fef300c65f0 2024-01-22T05:37:41.059 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:41.058+0000 7f3e8642a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-22T05:37:41.143 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:41.142+0000 7f3e8642a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-22T05:37:41.147 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:41.147+0000 7fc831da4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-22T05:37:41.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.161+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eeb3045c-1006-4507-81b8-f3e5aa64f58d", "id": 2} v 0) v1 -- 0x7fef3005fdb0 con 0x7fef300c65f0 2024-01-22T05:37:41.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.170+0000 7fef27e00700 1 -- 172.21.15.169:0/2980143344 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eeb3045c-1006-4507-81b8-f3e5aa64f58d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fef1801f070 con 0x7fef300c65f0 2024-01-22T05:37:41.170 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c65f0 msgr2=0x7fef300aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c65f0 0x7fef300aa8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fef18009ee0 tx=0x7fef18017000).stop 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 shutdown_connections 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30154260 0x7fef30164270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef300c5c80 0x7fef300ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 --2- 172.21.15.169:0/2980143344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef300c65f0 0x7fef300aa8b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 >> 172.21.15.169:0/2980143344 conn(0x7fef3005e9d0 msgr2=0x7fef300c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 shutdown_connections 2024-01-22T05:37:41.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.171+0000 7fef37400700 1 -- 172.21.15.169:0/2980143344 wait complete. 2024-01-22T05:37:41.187 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a 3 2024-01-22T05:37:41.236 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:41.236+0000 7fc831da4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-22T05:37:41.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.369+0000 7f0b29e00700 1 Processor -- start 2024-01-22T05:37:41.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.369+0000 7f0b29e00700 1 -- start start 2024-01-22T05:37:41.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.370+0000 7f0b29e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0b24154190 0x7f0b240a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b29e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240c0cc0 0x7f0b240c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b29e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b240c9cb0 con 0x7f0b240ca140 2024-01-22T05:37:41.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b29e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b240851f0 con 0x7f0b24154190 2024-01-22T05:37:41.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b29e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240c6cf0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b22a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0b24154190 0x7f0b240a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b22a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0b24154190 0x7f0b240a7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.169:57894/0 (socket says 172.21.15.169:57894) 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b22a00700 1 -- 172.21.15.169:0/4022128896 learned_addr learned my addr 172.21.15.169:0/4022128896 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b23400700 1 --2- 172.21.15.169:0/4022128896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240c0cc0 0x7f0b240c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b23400700 1 -- 172.21.15.169:0/4022128896 >> v2:172.21.15.100:3300/0 conn(0x7f0b24154190 msgr2=0x7f0b240a7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.371+0000 7f0b23400700 1 --2- 172.21.15.169:0/4022128896 >> v2:172.21.15.100:3300/0 conn(0x7f0b24154190 0x7f0b240a7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.372+0000 7f0b23400700 1 -- 172.21.15.169:0/4022128896 >> v1:172.21.15.169:6789/0 conn(0x7f0b240ca140 legacy=0x7f0b240ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.372+0000 7f0b23400700 1 -- 172.21.15.169:0/4022128896 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240c6fd0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.372+0000 7f0b23400700 1 --2- 172.21.15.169:0/4022128896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240c0cc0 0x7f0b240c5d40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0b1c009e60 tx=0x7f0b1c009780).ready entity=mon.2 client_cookie=e54e865d77786ce0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.372+0000 7f0b21600700 1 -- 172.21.15.169:0/4022128896 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00e070 con 0x7f0b240c0cc0 2024-01-22T05:37:41.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.372+0000 7f0b21600700 1 -- 172.21.15.169:0/4022128896 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00bb60 con 0x7f0b240c0cc0 2024-01-22T05:37:41.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.372+0000 7f0b21600700 1 -- 172.21.15.169:0/4022128896 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c012410 con 0x7f0b240c0cc0 2024-01-22T05:37:41.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 -- 172.21.15.169:0/4022128896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240c0cc0 msgr2=0x7f0b240c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 --2- 172.21.15.169:0/4022128896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240c0cc0 0x7f0b240c5d40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0b1c009e60 tx=0x7f0b1c009780).stop 2024-01-22T05:37:41.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 -- 172.21.15.169:0/4022128896 shutdown_connections 2024-01-22T05:37:41.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 --2- 172.21.15.169:0/4022128896 >> v2:172.21.15.100:3300/0 conn(0x7f0b24154190 0x7f0b240a7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 --2- 172.21.15.169:0/4022128896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240c0cc0 0x7f0b240c5d40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 -- 172.21.15.169:0/4022128896 >> 172.21.15.169:0/4022128896 conn(0x7f0b2405e9d0 msgr2=0x7f0b240cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:41.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 -- 172.21.15.169:0/4022128896 shutdown_connections 2024-01-22T05:37:41.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.373+0000 7f0b29e00700 1 -- 172.21.15.169:0/4022128896 wait complete. 2024-01-22T05:37:41.378 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:41.371+0000 7f3e8642a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-22T05:37:41.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.375+0000 7f0b29e00700 1 Processor -- start 2024-01-22T05:37:41.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.375+0000 7f0b29e00700 1 -- start start 2024-01-22T05:37:41.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b29e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b240c0cc0 0x7f0b240afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b29e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240ca140 0x7f0b24152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b29e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b24154190 0x7f0b2414db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b29e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240aede0 con 0x7f0b24154190 2024-01-22T05:37:41.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b29e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240af0c0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b29e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240af3a0 con 0x7f0b240ca140 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b22a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b240c0cc0 0x7f0b240afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b22a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b240c0cc0 0x7f0b240afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54478/0 (socket says 172.21.15.169:54478) 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b22000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240ca140 0x7f0b24152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b22a00700 1 -- 172.21.15.169:0/750786063 learned_addr learned my addr 172.21.15.169:0/750786063 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.377+0000 7f0b23400700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b24154190 0x7f0b2414db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b22a00700 1 -- 172.21.15.169:0/750786063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240ca140 msgr2=0x7f0b24152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b22a00700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240ca140 0x7f0b24152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b22a00700 1 -- 172.21.15.169:0/750786063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b24154190 msgr2=0x7f0b2414db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b22a00700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b24154190 0x7f0b2414db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b22a00700 1 -- 172.21.15.169:0/750786063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c009a20 con 0x7f0b240c0cc0 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b22a00700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b240c0cc0 0x7f0b240afe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0b1400e8d0 tx=0x7f0b14009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b1a000700 1 -- 172.21.15.169:0/750786063 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140094a0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b1a000700 1 -- 172.21.15.169:0/750786063 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14012600 con 0x7f0b240c0cc0 2024-01-22T05:37:41.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b240af680 con 0x7f0b240c0cc0 2024-01-22T05:37:41.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b1a000700 1 -- 172.21.15.169:0/750786063 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140129a0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.378+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b240b0370 con 0x7f0b240c0cc0 2024-01-22T05:37:41.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.379+0000 7f0b1a000700 1 -- 172.21.15.169:0/750786063 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0b1401b400 con 0x7f0b240c0cc0 2024-01-22T05:37:41.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.379+0000 7f0b1a000700 1 -- 172.21.15.169:0/750786063 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f0b1401a3b0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.379+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b240afcd0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.382+0000 7f0b1a000700 1 -- 172.21.15.169:0/750786063 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f0b1403ae50 con 0x7f0b240c0cc0 2024-01-22T05:37:41.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.462+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a", "id": 3} v 0) v1 -- 0x7f0b240b05f0 con 0x7f0b240c0cc0 2024-01-22T05:37:41.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.471+0000 7f0b1a000700 1 -- 172.21.15.169:0/750786063 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b14029030 con 0x7f0b240c0cc0 2024-01-22T05:37:41.470 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-01-22T05:37:41.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b240c0cc0 msgr2=0x7f0b240afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b240c0cc0 0x7f0b240afe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0b1400e8d0 tx=0x7f0b14009060).stop 2024-01-22T05:37:41.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 shutdown_connections 2024-01-22T05:37:41.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b240c0cc0 0x7f0b240afe80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b24154190 0x7f0b2414db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 --2- 172.21.15.169:0/750786063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b240ca140 0x7f0b24152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 >> 172.21.15.169:0/750786063 conn(0x7f0b2405e9d0 msgr2=0x7f0b240ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:41.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 shutdown_connections 2024-01-22T05:37:41.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.472+0000 7f0b29e00700 1 -- 172.21.15.169:0/750786063 wait complete. 2024-01-22T05:37:41.487 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:41.485+0000 7fc831da4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-22T05:37:41.495 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 8e126466-6240-4a2b-a018-9acb4c33339d 4 2024-01-22T05:37:41.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.674+0000 7fcdc8600700 1 Processor -- start 2024-01-22T05:37:41.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.675+0000 7fcdc8600700 1 -- start start 2024-01-22T05:37:41.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc8600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcdc0154260 0x7fcdc00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc8600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc8600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc00c1a40 con 0x7fcdc00c5c80 2024-01-22T05:37:41.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc8600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc00cbd30 con 0x7fcdc0154260 2024-01-22T05:37:41.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc8600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00c1110 con 0x7fcdc00c6810 2024-01-22T05:37:41.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc5c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcdc0154260 0x7fcdc00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc6600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc5c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcdc0154260 0x7fcdc00cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54484/0 (socket says 172.21.15.169:54484) 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1498994377 learned_addr learned my addr 172.21.15.169:0/1498994377 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.677+0000 7fcdc5200700 1 --1- 172.21.15.169:0/1498994377 >> v1:172.21.15.169:6789/0 conn(0x7fcdc00c5c80 0x7fcdc00c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:32780/0 (socket says 172.21.15.169:32780) 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 msgr2=0x7fcdc00c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdc5c00700 1 --2- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1498994377 >> v1:172.21.15.169:6789/0 conn(0x7fcdc00c5c80 legacy=0x7fcdc00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdbfe00700 1 -- 172.21.15.169:0/1498994377 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807595681 0 0) 0x7fcdc00c1a40 con 0x7fcdc00c5c80 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1498994377 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc00c13f0 con 0x7fcdc0154260 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdc6600700 1 --2- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdc5c00700 1 --2- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0154260 0x7fcdc00cb4e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fcdb0009810 tx=0x7fcdb0009060).ready entity=mon.1 client_cookie=c8312c5687ea7257 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdbfe00700 1 -- 172.21.15.169:0/1498994377 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0005880 con 0x7fcdc0154260 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdbfe00700 1 -- 172.21.15.169:0/1498994377 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb00059e0 con 0x7fcdc0154260 2024-01-22T05:37:41.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.678+0000 7fcdbfe00700 1 -- 172.21.15.169:0/1498994377 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0005d60 con 0x7fcdc0154260 2024-01-22T05:37:41.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 -- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0154260 msgr2=0x7fcdc00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 --2- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0154260 0x7fcdc00cb4e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fcdb0009810 tx=0x7fcdb0009060).stop 2024-01-22T05:37:41.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 -- 172.21.15.169:0/1498994377 shutdown_connections 2024-01-22T05:37:41.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 --2- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0154260 0x7fcdc00cb4e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 --2- 172.21.15.169:0/1498994377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 -- 172.21.15.169:0/1498994377 >> 172.21.15.169:0/1498994377 conn(0x7fcdc005e9d0 msgr2=0x7fcdc00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:41.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 -- 172.21.15.169:0/1498994377 shutdown_connections 2024-01-22T05:37:41.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.679+0000 7fcdc8600700 1 -- 172.21.15.169:0/1498994377 wait complete. 2024-01-22T05:37:41.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.682+0000 7fcdc8600700 1 Processor -- start 2024-01-22T05:37:41.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.682+0000 7fcdc8600700 1 -- start start 2024-01-22T05:37:41.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.683+0000 7fcdc8600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00c5c80 0x7fcdc00aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.683+0000 7fcdc8600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.683+0000 7fcdc8600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0154260 0x7fcdc0164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.683+0000 7fcdc8600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00ab290 con 0x7fcdc0154260 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.683+0000 7fcdc8600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc014e1e0 con 0x7fcdc00c5c80 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.683+0000 7fcdc8600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00acdc0 con 0x7fcdc00c6810 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00c5c80 0x7fcdc00aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00c5c80 0x7fcdc00aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54500/0 (socket says 172.21.15.169:54500) 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1959344432 learned_addr learned my addr 172.21.15.169:0/1959344432 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc6600700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0154260 0x7fcdc0164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1959344432 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 msgr2=0x7fcdc00aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1959344432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0154260 msgr2=0x7fcdc0164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0154260 0x7fcdc0164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 -- 172.21.15.169:0/1959344432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8009a20 con 0x7fcdc00c5c80 2024-01-22T05:37:41.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.684+0000 7fcdc5c00700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00c5c80 0x7fcdc00aa8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcdb0009eb0 tx=0x7fcdb0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.685+0000 7fcdbcc00700 1 -- 172.21.15.169:0/1959344432 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00067e0 con 0x7fcdc00c5c80 2024-01-22T05:37:41.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.685+0000 7fcdbcc00700 1 -- 172.21.15.169:0/1959344432 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb000b790 con 0x7fcdc00c5c80 2024-01-22T05:37:41.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.685+0000 7fcdbcc00700 1 -- 172.21.15.169:0/1959344432 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000bb10 con 0x7fcdc00c5c80 2024-01-22T05:37:41.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.685+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb0009300 con 0x7fcdc00c5c80 2024-01-22T05:37:41.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.685+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc00ac490 con 0x7fcdc00c5c80 2024-01-22T05:37:41.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.685+0000 7fcdbcc00700 1 -- 172.21.15.169:0/1959344432 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fcdb00266c0 con 0x7fcdc00c5c80 2024-01-22T05:37:41.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.685+0000 7fcdbcc00700 1 -- 172.21.15.169:0/1959344432 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fcdb0011970 con 0x7fcdc00c5c80 2024-01-22T05:37:41.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.686+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc005fdb0 con 0x7fcdc00c5c80 2024-01-22T05:37:41.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.688+0000 7fcdbcc00700 1 -- 172.21.15.169:0/1959344432 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fcdb0016070 con 0x7fcdc00c5c80 2024-01-22T05:37:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.768+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8e126466-6240-4a2b-a018-9acb4c33339d", "id": 4} v 0) v1 -- 0x7fcdc00c16d0 con 0x7fcdc00c5c80 2024-01-22T05:37:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.776+0000 7fcdbcc00700 1 -- 172.21.15.169:0/1959344432 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e126466-6240-4a2b-a018-9acb4c33339d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcdb00350b0 con 0x7fcdc00c5c80 2024-01-22T05:37:41.776 INFO:teuthology.orchestra.run.smithi169.stdout:4 2024-01-22T05:37:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00c5c80 msgr2=0x7fcdc00aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00c5c80 0x7fcdc00aa8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcdb0009eb0 tx=0x7fcdb0016000).stop 2024-01-22T05:37:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 shutdown_connections 2024-01-22T05:37:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00c5c80 0x7fcdc00aa8b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0154260 0x7fcdc0164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 --2- 172.21.15.169:0/1959344432 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc00c6810 0x7fcdc00aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 >> 172.21.15.169:0/1959344432 conn(0x7fcdc005e9d0 msgr2=0x7fcdc00642c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.777+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 shutdown_connections 2024-01-22T05:37:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.778+0000 7fcdc8600700 1 -- 172.21.15.169:0/1959344432 wait complete. 2024-01-22T05:37:41.794 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new d750198a-b937-4f26-9296-d869c978a6f6 5 2024-01-22T05:37:41.901 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:41.900+0000 7f3e8642a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-22T05:37:41.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.973+0000 7fed64200700 1 Processor -- start 2024-01-22T05:37:41.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.973+0000 7fed64200700 1 -- start start 2024-01-22T05:37:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.974+0000 7fed64200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fed5c05e900 0x7fed5c0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.974+0000 7fed64200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed5c0c1940 0x7fed5c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.974+0000 7fed64200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c0c74b0 con 0x7fed5c0a9f60 2024-01-22T05:37:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.974+0000 7fed64200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0cab90 con 0x7fed5c0c1940 2024-01-22T05:37:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.974+0000 7fed64200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c158660 con 0x7fed5c05e900 2024-01-22T05:37:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed60e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fed5c05e900 0x7fed5c0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed61800700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fed5c0a9f60 0x7fed5c05e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35370/0 (socket says 172.21.15.169:35370) 2024-01-22T05:37:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed61800700 1 -- 172.21.15.169:0/1056161928 learned_addr learned my addr 172.21.15.169:0/1056161928 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-01-22T05:37:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed62200700 1 --2- 172.21.15.169:0/1056161928 >> v2:172.21.15.100:3300/0 conn(0x7fed5c0c1940 0x7fed5c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed60e00700 1 -- 172.21.15.169:0/1056161928 >> v2:172.21.15.100:3300/0 conn(0x7fed5c0c1940 msgr2=0x7fed5c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed60e00700 1 --2- 172.21.15.169:0/1056161928 >> v2:172.21.15.100:3300/0 conn(0x7fed5c0c1940 0x7fed5c0ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed60e00700 1 -- 172.21.15.169:0/1056161928 >> v1:172.21.15.169:6789/0 conn(0x7fed5c0a9f60 legacy=0x7fed5c05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed60e00700 1 -- 172.21.15.169:0/1056161928 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c158940 con 0x7fed5c05e900 2024-01-22T05:37:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.975+0000 7fed60e00700 1 --2- 172.21.15.169:0/1056161928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c05e900 0x7fed5c0aa340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fed5c0c88d0 tx=0x7fed44009060).ready entity=mon.1 client_cookie=6f6a03b6f48d726d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed5be00700 1 -- 172.21.15.169:0/1056161928 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400d4a0 con 0x7fed5c05e900 2024-01-22T05:37:41.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed5be00700 1 -- 172.21.15.169:0/1056161928 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4400d600 con 0x7fed5c05e900 2024-01-22T05:37:41.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed5be00700 1 -- 172.21.15.169:0/1056161928 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400d980 con 0x7fed5c05e900 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed64200700 1 -- 172.21.15.169:0/1056161928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c05e900 msgr2=0x7fed5c0aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed64200700 1 --2- 172.21.15.169:0/1056161928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c05e900 0x7fed5c0aa340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fed5c0c88d0 tx=0x7fed44009060).stop 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed64200700 1 -- 172.21.15.169:0/1056161928 shutdown_connections 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed64200700 1 --2- 172.21.15.169:0/1056161928 >> v2:172.21.15.100:3300/0 conn(0x7fed5c0c1940 0x7fed5c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed64200700 1 --2- 172.21.15.169:0/1056161928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c05e900 0x7fed5c0aa340 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed64200700 1 -- 172.21.15.169:0/1056161928 >> 172.21.15.169:0/1056161928 conn(0x7fed5c0cada0 msgr2=0x7fed5c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.976+0000 7fed64200700 1 -- 172.21.15.169:0/1056161928 shutdown_connections 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.977+0000 7fed64200700 1 -- 172.21.15.169:0/1056161928 wait complete. 2024-01-22T05:37:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.978+0000 7fed64200700 1 Processor -- start 2024-01-22T05:37:41.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.979+0000 7fed64200700 1 -- start start 2024-01-22T05:37:41.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed64200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed5c05e900 0x7fed5c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed64200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c0a9f60 0x7fed5c064460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed64200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed5c0c1940 0x7fed5c064950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:41.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed64200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0ac300 con 0x7fed5c05e900 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed64200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c064e40 con 0x7fed5c0a9f60 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed64200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c39a0 con 0x7fed5c0c1940 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed60e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c0a9f60 0x7fed5c064460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed61800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed5c05e900 0x7fed5c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed62200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed5c0c1940 0x7fed5c064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed60e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c0a9f60 0x7fed5c064460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:44358/0 (socket says 172.21.15.169:44358) 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed60e00700 1 -- 172.21.15.169:0/3681852757 learned_addr learned my addr 172.21.15.169:0/3681852757 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.980+0000 7fed61800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed5c05e900 0x7fed5c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.169:35408/0 (socket says 172.21.15.169:35408) 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed61800700 1 -- 172.21.15.169:0/3681852757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed5c0c1940 msgr2=0x7fed5c064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed61800700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed5c0c1940 0x7fed5c064950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed61800700 1 -- 172.21.15.169:0/3681852757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c0a9f60 msgr2=0x7fed5c064460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed61800700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c0a9f60 0x7fed5c064460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed61800700 1 -- 172.21.15.169:0/3681852757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed440092a0 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed60e00700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c0a9f60 0x7fed5c064460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed61800700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed5c05e900 0x7fed5c151a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fed4c00c560 tx=0x7fed4c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed58c00700 1 -- 172.21.15.169:0/3681852757 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0072e0 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed58c00700 1 -- 172.21.15.169:0/3681852757 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c007460 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed58c00700 1 -- 172.21.15.169:0/3681852757 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0059f0 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0c30b0 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.981+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c0c3350 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.982+0000 7fed58c00700 1 -- 172.21.15.169:0/3681852757 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fed4c013450 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.982+0000 7fed58c00700 1 -- 172.21.15.169:0/3681852757 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fed4c0075d0 con 0x7fed5c05e900 2024-01-22T05:37:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.982+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c05fdb0 con 0x7fed5c05e900 2024-01-22T05:37:41.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:41.988+0000 7fed58c00700 1 -- 172.21.15.169:0/3681852757 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fed4c013700 con 0x7fed5c05e900 2024-01-22T05:37:42.026 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:42.025+0000 7f3e8642a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:37:42.049 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:42.049+0000 7fc831da4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-22T05:37:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.071+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d750198a-b937-4f26-9296-d869c978a6f6", "id": 5} v 0) v1 -- 0x7fed5c098bc0 con 0x7fed5c05e900 2024-01-22T05:37:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.078+0000 7fed58c00700 1 -- 172.21.15.169:0/3681852757 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d750198a-b937-4f26-9296-d869c978a6f6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fed4c0138a0 con 0x7fed5c05e900 2024-01-22T05:37:42.078 INFO:teuthology.orchestra.run.smithi169.stdout:5 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed5c05e900 msgr2=0x7fed5c151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed5c05e900 0x7fed5c151a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fed4c00c560 tx=0x7fed4c007d00).stop 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 shutdown_connections 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed5c0c1940 0x7fed5c064950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed5c05e900 0x7fed5c151a00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 --2- 172.21.15.169:0/3681852757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed5c0a9f60 0x7fed5c064460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 >> 172.21.15.169:0/3681852757 conn(0x7fed5c0cada0 msgr2=0x7fed5c153890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:42.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.079+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 shutdown_connections 2024-01-22T05:37:42.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.080+0000 7fed64200700 1 -- 172.21.15.169:0/3681852757 wait complete. 2024-01-22T05:37:42.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 2479324c-1b69-4eae-9ef0-adad8ddf1f1e 6 2024-01-22T05:37:42.182 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:42.182+0000 7fc831da4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:37:42.210 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:42.209+0000 7f3e8642a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-22T05:37:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.278+0000 7f2d99000700 1 Processor -- start 2024-01-22T05:37:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.278+0000 7f2d99000700 1 -- start start 2024-01-22T05:37:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.279+0000 7f2d99000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2d940c0e10 0x7f2d940aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.279+0000 7f2d99000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d940c74b0 con 0x7f2d940a9f60 2024-01-22T05:37:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.279+0000 7f2d99000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d94158660 con 0x7f2d9405e900 2024-01-22T05:37:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.279+0000 7f2d99000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d94158940 con 0x7f2d940c0e10 2024-01-22T05:37:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.279+0000 7f2d92800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2d940c0e10 0x7f2d940aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d92800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2d940c0e10 0x7f2d940aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:44370/0 (socket says 172.21.15.169:44370) 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d91400700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f2d9405e900 0x7f2d94098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35380/0 (socket says 172.21.15.169:35380) 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d92800700 1 -- 172.21.15.169:0/2132351149 learned_addr learned my addr 172.21.15.169:0/2132351149 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d91e00700 1 --1- 172.21.15.169:0/2132351149 >> v1:172.21.15.100:6789/0 conn(0x7f2d940a9f60 0x7f2d9405e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.169:40994/0 (socket says 172.21.15.169:40994) 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d92800700 1 -- 172.21.15.169:0/2132351149 >> v1:172.21.15.169:6789/0 conn(0x7f2d9405e900 legacy=0x7f2d94098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d92800700 1 -- 172.21.15.169:0/2132351149 >> v1:172.21.15.100:6789/0 conn(0x7f2d940a9f60 legacy=0x7f2d9405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d92800700 1 -- 172.21.15.169:0/2132351149 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940c7140 con 0x7f2d940c0e10 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d90a00700 1 -- 172.21.15.169:0/2132351149 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747393384 0 0) 0x7f2d94158660 con 0x7f2d9405e900 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d92800700 1 --2- 172.21.15.169:0/2132351149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d940c0e10 0x7f2d940aa340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2d8c009f20 tx=0x7f2d8c009840).ready entity=mon.1 client_cookie=429ab77a6c9dc22e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.280+0000 7f2d90a00700 1 -- 172.21.15.169:0/2132351149 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00e070 con 0x7f2d940c0e10 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d90a00700 1 -- 172.21.15.169:0/2132351149 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c00b980 con 0x7f2d940c0e10 2024-01-22T05:37:42.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d90a00700 1 -- 172.21.15.169:0/2132351149 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00bd00 con 0x7f2d940c0e10 2024-01-22T05:37:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d99000700 1 -- 172.21.15.169:0/2132351149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d940c0e10 msgr2=0x7f2d940aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d99000700 1 --2- 172.21.15.169:0/2132351149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d940c0e10 0x7f2d940aa340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2d8c009f20 tx=0x7f2d8c009840).stop 2024-01-22T05:37:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d99000700 1 -- 172.21.15.169:0/2132351149 shutdown_connections 2024-01-22T05:37:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d99000700 1 --2- 172.21.15.169:0/2132351149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d940c0e10 0x7f2d940aa340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d99000700 1 -- 172.21.15.169:0/2132351149 >> 172.21.15.169:0/2132351149 conn(0x7f2d940cada0 msgr2=0x7f2d940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d99000700 1 -- 172.21.15.169:0/2132351149 shutdown_connections 2024-01-22T05:37:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.281+0000 7f2d99000700 1 -- 172.21.15.169:0/2132351149 wait complete. 2024-01-22T05:37:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.283+0000 7f2d99000700 1 Processor -- start 2024-01-22T05:37:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.283+0000 7f2d99000700 1 -- start start 2024-01-22T05:37:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d99000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d9405e900 0x7f2d941478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d99000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d940a9f60 0x7f2d94156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d99000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d940c0e10 0x7f2d94156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d99000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940aa860 con 0x7f2d940c0e10 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d99000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940ab6c0 con 0x7f2d9405e900 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d99000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940aaab0 con 0x7f2d940a9f60 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d91e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d9405e900 0x7f2d941478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d91400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d940a9f60 0x7f2d94156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d91e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d9405e900 0x7f2d941478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:44382/0 (socket says 172.21.15.169:44382) 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.284+0000 7f2d91e00700 1 -- 172.21.15.169:0/991887621 learned_addr learned my addr 172.21.15.169:0/991887621 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d92800700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d940c0e10 0x7f2d94156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d91e00700 1 -- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d940a9f60 msgr2=0x7f2d94156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d91e00700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d940a9f60 0x7f2d94156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d91e00700 1 -- 172.21.15.169:0/991887621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d940c0e10 msgr2=0x7f2d94156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d91e00700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d940c0e10 0x7f2d94156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d91e00700 1 -- 172.21.15.169:0/991887621 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c009ae0 con 0x7f2d9405e900 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d91400700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d940a9f60 0x7f2d94156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d91e00700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d9405e900 0x7f2d941478c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2d8400c5e0 tx=0x7f2d84007e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d89600700 1 -- 172.21.15.169:0/991887621 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d840072e0 con 0x7f2d9405e900 2024-01-22T05:37:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d89600700 1 -- 172.21.15.169:0/991887621 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84007440 con 0x7f2d9405e900 2024-01-22T05:37:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d89600700 1 -- 172.21.15.169:0/991887621 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84005910 con 0x7f2d9405e900 2024-01-22T05:37:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.285+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d940aad90 con 0x7f2d9405e900 2024-01-22T05:37:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.286+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d940ab350 con 0x7f2d9405e900 2024-01-22T05:37:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.286+0000 7f2d89600700 1 -- 172.21.15.169:0/991887621 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2d84013450 con 0x7f2d9405e900 2024-01-22T05:37:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.286+0000 7f2d89600700 1 -- 172.21.15.169:0/991887621 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f2d84013700 con 0x7f2d9405e900 2024-01-22T05:37:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.287+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9405fdb0 con 0x7f2d9405e900 2024-01-22T05:37:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.289+0000 7f2d89600700 1 -- 172.21.15.169:0/991887621 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f2d84018020 con 0x7f2d9405e900 2024-01-22T05:37:42.306 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:42.305+0000 7f3e8642a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-22T05:37:42.372 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:42.372+0000 7fc831da4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-22T05:37:42.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.372+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2479324c-1b69-4eae-9ef0-adad8ddf1f1e", "id": 6} v 0) v1 -- 0x7f2d940abdc0 con 0x7f2d9405e900 2024-01-22T05:37:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.380+0000 7f2d89600700 1 -- 172.21.15.169:0/991887621 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2479324c-1b69-4eae-9ef0-adad8ddf1f1e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d84013a20 con 0x7f2d9405e900 2024-01-22T05:37:42.380 INFO:teuthology.orchestra.run.smithi169.stdout:6 2024-01-22T05:37:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d9405e900 msgr2=0x7f2d941478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d9405e900 0x7f2d941478c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2d8400c5e0 tx=0x7f2d84007e30).stop 2024-01-22T05:37:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 shutdown_connections 2024-01-22T05:37:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d9405e900 0x7f2d941478c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d940c0e10 0x7f2d94156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 --2- 172.21.15.169:0/991887621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d940a9f60 0x7f2d94156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 >> 172.21.15.169:0/991887621 conn(0x7f2d940cada0 msgr2=0x7f2d94153980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:42.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 shutdown_connections 2024-01-22T05:37:42.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.381+0000 7f2d99000700 1 -- 172.21.15.169:0/991887621 wait complete. 2024-01-22T05:37:42.396 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:42.395+0000 7f3e8642a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-22T05:37:42.399 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 7c3441e2-5820-4513-a604-10d364a30aac 7 2024-01-22T05:37:42.478 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:42.479+0000 7fc831da4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-22T05:37:42.569 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:42.569+0000 7fc831da4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-22T05:37:42.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.578+0000 7f68a3200700 1 Processor -- start 2024-01-22T05:37:42.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.578+0000 7f68a3200700 1 -- start start 2024-01-22T05:37:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.579+0000 7f68a3200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f689c0aa5e0 0x7f689c0c0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.579+0000 7f68a3200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c0c73d0 con 0x7f689c0aa200 2024-01-22T05:37:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.579+0000 7f68a3200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c0c6530 con 0x7f689c0c0b70 2024-01-22T05:37:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.579+0000 7f68a3200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c154580 con 0x7f689c0aa5e0 2024-01-22T05:37:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.579+0000 7f68a1200700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f689c0c0b70 0x7f689c0c8ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35394/0 (socket says 172.21.15.169:35394) 2024-01-22T05:37:42.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.579+0000 7f68a1200700 1 -- 172.21.15.169:0/2443767570 learned_addr learned my addr 172.21.15.169:0/2443767570 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-01-22T05:37:42.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689b400700 1 --2- 172.21.15.169:0/2443767570 >> v2:172.21.15.100:3300/0 conn(0x7f689c0aa5e0 0x7f689c0c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689aa00700 1 -- 172.21.15.169:0/2443767570 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908490937 0 0) 0x7f689c0c6530 con 0x7f689c0c0b70 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689aa00700 1 -- 172.21.15.169:0/2443767570 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687c0033f0 con 0x7f689c0c0b70 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689aa00700 1 -- 172.21.15.169:0/2443767570 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685203543 0 0) 0x7f689c0c73d0 con 0x7f689c0aa200 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689aa00700 1 -- 172.21.15.169:0/2443767570 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f689c0c6530 con 0x7f689c0aa200 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689b400700 1 -- 172.21.15.169:0/2443767570 >> v1:172.21.15.169:6789/0 conn(0x7f689c0c0b70 legacy=0x7f689c0c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689b400700 1 -- 172.21.15.169:0/2443767570 >> v1:172.21.15.100:6789/0 conn(0x7f689c0aa200 legacy=0x7f689c0c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689b400700 1 -- 172.21.15.169:0/2443767570 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c0c0fa0 con 0x7f689c0aa5e0 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.580+0000 7f689b400700 1 --2- 172.21.15.169:0/2443767570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c0c0680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f6884009760 tx=0x7f6884009060).ready entity=mon.0 client_cookie=faa6fa43e658f6e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f689aa00700 1 -- 172.21.15.169:0/2443767570 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400d4a0 con 0x7f689c0aa5e0 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f689aa00700 1 -- 172.21.15.169:0/2443767570 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400d600 con 0x7f689c0aa5e0 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f689aa00700 1 -- 172.21.15.169:0/2443767570 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400d980 con 0x7f689c0aa5e0 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f68a3200700 1 -- 172.21.15.169:0/2443767570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 msgr2=0x7f689c0c0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f68a3200700 1 --2- 172.21.15.169:0/2443767570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c0c0680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f6884009760 tx=0x7f6884009060).stop 2024-01-22T05:37:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f68a3200700 1 -- 172.21.15.169:0/2443767570 shutdown_connections 2024-01-22T05:37:42.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f68a3200700 1 --2- 172.21.15.169:0/2443767570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c0c0680 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f68a3200700 1 -- 172.21.15.169:0/2443767570 >> 172.21.15.169:0/2443767570 conn(0x7f689c0945d0 msgr2=0x7f689c05e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:42.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f68a3200700 1 -- 172.21.15.169:0/2443767570 shutdown_connections 2024-01-22T05:37:42.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.581+0000 7f68a3200700 1 -- 172.21.15.169:0/2443767570 wait complete. 2024-01-22T05:37:42.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.583+0000 7f68a3200700 1 Processor -- start 2024-01-22T05:37:42.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.583+0000 7f68a3200700 1 -- start start 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a3200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f689c0aa200 0x7f689c0ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a3200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c1648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a3200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f689c0c0b70 0x7f689c0982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a3200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0ada20 con 0x7f689c0aa5e0 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a3200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0aaaf0 con 0x7f689c0aa200 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a3200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0aadd0 con 0x7f689c0c0b70 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f689be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f689c0aa200 0x7f689c0ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a1200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f689c0c0b70 0x7f689c0982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f689be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f689c0aa200 0x7f689c0ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:44386/0 (socket says 172.21.15.169:44386) 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f689b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c1648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f689be00700 1 -- 172.21.15.169:0/1119158765 learned_addr learned my addr 172.21.15.169:0/1119158765 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a1200700 1 -- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f689c0aa200 msgr2=0x7f689c0ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.584+0000 7f68a1200700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f689c0aa200 0x7f689c0ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f68a1200700 1 -- 172.21.15.169:0/1119158765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 msgr2=0x7f689c1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f68a1200700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c1648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f68a1200700 1 -- 172.21.15.169:0/1119158765 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840092a0 con 0x7f689c0c0b70 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f689be00700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f689c0aa200 0x7f689c0ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f689b400700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c1648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f68a1200700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f689c0c0b70 0x7f689c0982e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6894005ad0 tx=0x7f6894007f30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f6893400700 1 -- 172.21.15.169:0/1119158765 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894005d30 con 0x7f689c0c0b70 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f6893400700 1 -- 172.21.15.169:0/1119158765 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940070d0 con 0x7f689c0c0b70 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f6893400700 1 -- 172.21.15.169:0/1119158765 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894007490 con 0x7f689c0c0b70 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c0ab0b0 con 0x7f689c0c0b70 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c0ab670 con 0x7f689c0c0b70 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.585+0000 7f6893400700 1 -- 172.21.15.169:0/1119158765 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f6894013450 con 0x7f689c0c0b70 2024-01-22T05:37:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.586+0000 7f6893400700 1 -- 172.21.15.169:0/1119158765 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f689401da80 con 0x7f689c0c0b70 2024-01-22T05:37:42.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.586+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c0ab9e0 con 0x7f689c0c0b70 2024-01-22T05:37:42.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.589+0000 7f6893400700 1 -- 172.21.15.169:0/1119158765 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f689401dd10 con 0x7f689c0c0b70 2024-01-22T05:37:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.670+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7c3441e2-5820-4513-a604-10d364a30aac", "id": 7} v 0) v1 -- 0x7f689c05fdb0 con 0x7f689c0c0b70 2024-01-22T05:37:42.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.678+0000 7f6893400700 1 -- 172.21.15.169:0/1119158765 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c3441e2-5820-4513-a604-10d364a30aac", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6894013890 con 0x7f689c0c0b70 2024-01-22T05:37:42.678 INFO:teuthology.orchestra.run.smithi169.stdout:7 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f689c0c0b70 msgr2=0x7f689c0982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f689c0c0b70 0x7f689c0982e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6894005ad0 tx=0x7f6894007f30).stop 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 shutdown_connections 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f689c0aa200 0x7f689c0ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f689c0c0b70 0x7f689c0982e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 --2- 172.21.15.169:0/1119158765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f689c0aa5e0 0x7f689c1648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 >> 172.21.15.169:0/1119158765 conn(0x7f689c0945d0 msgr2=0x7f689c153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 shutdown_connections 2024-01-22T05:37:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:37:42.679+0000 7f68a3200700 1 -- 172.21.15.169:0/1119158765 wait complete. 2024-01-22T05:37:42.695 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-22T05:37:42.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-22T05:37:42.701 INFO:tasks.ceph.osd.0:Started 2024-01-22T05:37:42.701 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-22T05:37:42.702 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-22T05:37:42.707 INFO:tasks.ceph.osd.1:Started 2024-01-22T05:37:42.707 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-22T05:37:42.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-22T05:37:42.711 INFO:tasks.ceph.osd.2:Started 2024-01-22T05:37:42.711 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-22T05:37:42.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-22T05:37:42.717 INFO:tasks.ceph.osd.3:Started 2024-01-22T05:37:42.717 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-22T05:37:42.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-22T05:37:42.719 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:42.718+0000 7f3e8642a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-22T05:37:42.721 INFO:tasks.ceph.osd.4:Started 2024-01-22T05:37:42.721 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-22T05:37:42.721 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-22T05:37:42.725 INFO:tasks.ceph.osd.5:Started 2024-01-22T05:37:42.725 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-22T05:37:42.725 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-22T05:37:42.729 INFO:tasks.ceph.osd.6:Started 2024-01-22T05:37:42.729 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-22T05:37:42.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-22T05:37:42.733 INFO:tasks.ceph.osd.7:Started 2024-01-22T05:37:42.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:37:42.933 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:42.933+0000 7fc831da4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-22T05:37:42.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.982+0000 7f85d8400700 1 Processor -- start 2024-01-22T05:37:42.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.982+0000 7f85d8400700 1 -- start start 2024-01-22T05:37:42.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.984+0000 7f85d8400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f85d0153c60 0x7f85d0154040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.984+0000 7f85d8400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d8400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00bc510 con 0x7f85d0064c30 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d8400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d00bc7f0 con 0x7f85d0153c60 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d8400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c45b0 con 0x7f85d00c1900 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d5a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f85d0153c60 0x7f85d0154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d6400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f85d0064c30 0x7f85d0065050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48420/0 (socket says 172.21.15.100:48420) 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d5a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f85d0153c60 0x7f85d0154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36354/0 (socket says 172.21.15.100:36354) 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d6400700 1 -- 172.21.15.100:0/2331154716 learned_addr learned my addr 172.21.15.100:0/2331154716 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d5000700 1 --2- 172.21.15.100:0/2331154716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d5a00700 1 -- 172.21.15.100:0/2331154716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 msgr2=0x7f85d0066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d5a00700 1 --2- 172.21.15.100:0/2331154716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d5a00700 1 -- 172.21.15.100:0/2331154716 >> v1:172.21.15.100:6789/0 conn(0x7f85d0064c30 legacy=0x7f85d0065050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.985+0000 7f85d5a00700 1 -- 172.21.15.100:0/2331154716 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00c4890 con 0x7f85d0153c60 2024-01-22T05:37:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.986+0000 7f85d5a00700 1 --2- 172.21.15.100:0/2331154716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0154040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f85c0009760 tx=0x7f85c0009060).ready entity=mon.0 client_cookie=ab1a6419f6dcfa37 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.986+0000 7f85cfe00700 1 -- 172.21.15.100:0/2331154716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000f510 con 0x7f85d0153c60 2024-01-22T05:37:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.986+0000 7f85cfe00700 1 -- 172.21.15.100:0/2331154716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c000f670 con 0x7f85d0153c60 2024-01-22T05:37:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.986+0000 7f85cfe00700 1 -- 172.21.15.100:0/2331154716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000f9f0 con 0x7f85d0153c60 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.986+0000 7f85d8400700 1 -- 172.21.15.100:0/2331154716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 msgr2=0x7f85d0154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.986+0000 7f85d8400700 1 --2- 172.21.15.100:0/2331154716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0154040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f85c0009760 tx=0x7f85c0009060).stop 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.987+0000 7f85d8400700 1 -- 172.21.15.100:0/2331154716 shutdown_connections 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.987+0000 7f85d8400700 1 --2- 172.21.15.100:0/2331154716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0154040 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.987+0000 7f85d8400700 1 --2- 172.21.15.100:0/2331154716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.987+0000 7f85d8400700 1 -- 172.21.15.100:0/2331154716 >> 172.21.15.100:0/2331154716 conn(0x7f85d00c7d20 msgr2=0x7f85d00c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.987+0000 7f85d8400700 1 -- 172.21.15.100:0/2331154716 shutdown_connections 2024-01-22T05:37:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.987+0000 7f85d8400700 1 -- 172.21.15.100:0/2331154716 wait complete. 2024-01-22T05:37:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.989+0000 7f85d8400700 1 Processor -- start 2024-01-22T05:37:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.990+0000 7f85d8400700 1 -- start start 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.991+0000 7f85d8400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0064c30 0x7f85d01545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.991+0000 7f85d8400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.991+0000 7f85d8400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.991+0000 7f85d8400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00bf290 con 0x7f85d0153c60 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.991+0000 7f85d8400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00be960 con 0x7f85d0064c30 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.991+0000 7f85d8400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00bec40 con 0x7f85d00c1900 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36366/0 (socket says 172.21.15.100:36366) 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 -- 172.21.15.100:0/1628738657 learned_addr learned my addr 172.21.15.100:0/1628738657 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d5a00700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0064c30 0x7f85d01545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 -- 172.21.15.100:0/1628738657 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 msgr2=0x7f85d0145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 -- 172.21.15.100:0/1628738657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0064c30 msgr2=0x7f85d01545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0064c30 0x7f85d01545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 -- 172.21.15.100:0/1628738657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00092a0 con 0x7f85d0153c60 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85d6400700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0155370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f85c800c790 tx=0x7f85c80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.992+0000 7f85ccc00700 1 -- 172.21.15.100:0/1628738657 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8005d30 con 0x7f85d0153c60 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.993+0000 7f85ccc00700 1 -- 172.21.15.100:0/1628738657 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8005e90 con 0x7f85d0153c60 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.993+0000 7f85ccc00700 1 -- 172.21.15.100:0/1628738657 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8007320 con 0x7f85d0153c60 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.993+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d00bef20 con 0x7f85d0153c60 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.993+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d0154ae0 con 0x7f85d0153c60 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.993+0000 7f85ccc00700 1 -- 172.21.15.100:0/1628738657 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f85c801d440 con 0x7f85d0153c60 2024-01-22T05:37:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.993+0000 7f85ccc00700 1 -- 172.21.15.100:0/1628738657 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f85c8007930 con 0x7f85d0153c60 2024-01-22T05:37:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.994+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d00bf400 con 0x7f85d0153c60 2024-01-22T05:37:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:42.997+0000 7f85ccc00700 1 -- 172.21.15.100:0/1628738657 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f85c801d6f0 con 0x7f85d0153c60 2024-01-22T05:37:43.036 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:43.035+0000 7f3e8642a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-22T05:37:43.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.079+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85d005fdb0 con 0x7f85d0153c60 2024-01-22T05:37:43.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.080+0000 7f85ccc00700 1 -- 172.21.15.100:0/1628738657 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f85c801d950 con 0x7f85d0153c60 2024-01-22T05:37:43.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:37:43.081 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:42.671647+0000","last_up_change":"0.000000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:37:43.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 msgr2=0x7f85d0155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:43.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0155370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f85c800c790 tx=0x7f85c80015e0).stop 2024-01-22T05:37:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 shutdown_connections 2024-01-22T05:37:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0064c30 0x7f85d01545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d0153c60 0x7f85d0155370 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 --2- 172.21.15.100:0/1628738657 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85d00c1900 0x7f85d0145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 >> 172.21.15.100:0/1628738657 conn(0x7f85d00c7d20 msgr2=0x7f85d0063370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 shutdown_connections 2024-01-22T05:37:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:43.081+0000 7f85d8400700 1 -- 172.21.15.100:0/1628738657 wait complete. 2024-01-22T05:37:43.100 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-22T05:37:43.100 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-22T05:37:43.171 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:43.172+0000 7fc831da4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-22T05:37:43.392 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-01-22T05:37:43.392+0000 7efd6eccc380 -1 Falling back to public interface 2024-01-22T05:37:43.400 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-22T05:37:43.399+0000 7f1865b9c380 -1 Falling back to public interface 2024-01-22T05:37:43.413 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-01-22T05:37:43.413+0000 7f3037ec9380 -1 Falling back to public interface 2024-01-22T05:37:43.421 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-22T05:37:43.421+0000 7fda4fc02380 -1 Falling back to public interface 2024-01-22T05:37:43.435 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-22T05:37:43.434+0000 7f9ecdc76380 -1 Falling back to public interface 2024-01-22T05:37:43.435 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-22T05:37:43.435+0000 7fb9c9492380 -1 Falling back to public interface 2024-01-22T05:37:43.436 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-01-22T05:37:43.437+0000 7f4553c5e380 -1 Falling back to public interface 2024-01-22T05:37:43.439 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-22T05:37:43.438+0000 7fb9bfe00700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6821/0: (98) Address already in use 2024-01-22T05:37:43.441 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-01-22T05:37:43.442+0000 7f23a7c17380 -1 Falling back to public interface 2024-01-22T05:37:43.882 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:43.881+0000 7f3e8642a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-22T05:37:43.906 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-22T05:37:43.974 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:43.973+0000 7f3e8642a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-22T05:37:44.020 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:44.020+0000 7fc831da4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-22T05:37:44.072 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.071+0000 7f88a4e00700 1 Processor -- start 2024-01-22T05:37:44.072 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.071+0000 7f88a4e00700 1 -- start start 2024-01-22T05:37:44.073 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.072+0000 7f88a4e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a00a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:44.073 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.072+0000 7f88a4e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a00c8180 con 0x7f88a00c6820 2024-01-22T05:37:44.074 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.072+0000 7f88a4e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a0152200 con 0x7f88a00aa3d0 2024-01-22T05:37:44.074 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.072+0000 7f88a4e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00c7630 con 0x7f88a0151e20 2024-01-22T05:37:44.074 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889e800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f88a00c6820 0x7f88a00c05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48436/0 (socket says 172.21.15.100:48436) 2024-01-22T05:37:44.074 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889e800700 1 -- 172.21.15.100:0/2628145558 learned_addr learned my addr 172.21.15.100:0/2628145558 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:44.074 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889de00700 1 --2- 172.21.15.100:0/2628145558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a00a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889ca00700 1 -- 172.21.15.100:0/2628145558 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158049247 0 0) 0x7f88a0152200 con 0x7f88a00aa3d0 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889ca00700 1 -- 172.21.15.100:0/2628145558 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88800033f0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889ca00700 1 -- 172.21.15.100:0/2628145558 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074537106 0 0) 0x7f88a00c8180 con 0x7f88a00c6820 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889ca00700 1 -- 172.21.15.100:0/2628145558 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a0152200 con 0x7f88a00c6820 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889de00700 1 -- 172.21.15.100:0/2628145558 >> v1:172.21.15.169:6789/0 conn(0x7f88a00aa3d0 legacy=0x7f88a00c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889de00700 1 -- 172.21.15.100:0/2628145558 >> v1:172.21.15.100:6789/0 conn(0x7f88a00c6820 legacy=0x7f88a00c05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.073+0000 7f889de00700 1 -- 172.21.15.100:0/2628145558 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00c7850 con 0x7f88a0151e20 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f889de00700 1 --2- 172.21.15.100:0/2628145558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a00a9ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8890009760 tx=0x7f8890006f40).ready entity=mon.2 client_cookie=149b016c468945a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f889ca00700 1 -- 172.21.15.100:0/2628145558 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890005880 con 0x7f88a0151e20 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f889ca00700 1 -- 172.21.15.100:0/2628145558 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88900059e0 con 0x7f88a0151e20 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f889ca00700 1 -- 172.21.15.100:0/2628145558 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890005d60 con 0x7f88a0151e20 2024-01-22T05:37:44.076 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f88a4e00700 1 -- 172.21.15.100:0/2628145558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 msgr2=0x7f88a00a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:44.077 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f88a4e00700 1 --2- 172.21.15.100:0/2628145558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a00a9ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8890009760 tx=0x7f8890006f40).stop 2024-01-22T05:37:44.077 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f88a4e00700 1 -- 172.21.15.100:0/2628145558 shutdown_connections 2024-01-22T05:37:44.077 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f88a4e00700 1 --2- 172.21.15.100:0/2628145558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a00a9ee0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:44.077 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f88a4e00700 1 -- 172.21.15.100:0/2628145558 >> 172.21.15.100:0/2628145558 conn(0x7f88a00945f0 msgr2=0x7f88a005e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:44.077 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.074+0000 7f88a4e00700 1 -- 172.21.15.100:0/2628145558 shutdown_connections 2024-01-22T05:37:44.077 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.075+0000 7f88a4e00700 1 -- 172.21.15.100:0/2628145558 wait complete. 2024-01-22T05:37:44.079 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.076+0000 7f88a4e00700 1 Processor -- start 2024-01-22T05:37:44.079 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.076+0000 7f88a4e00700 1 -- start start 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f88a4e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88a00aa3d0 0x7f88a0150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f88a4e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00c6820 0x7f88a01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f88a4e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a01545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f88a4e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a01506f0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f88a4e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0154a90 con 0x7f88a00c6820 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f88a4e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0153130 con 0x7f88a0151e20 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f889de00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88a00aa3d0 0x7f88a0150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f889de00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88a00aa3d0 0x7f88a0150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36382/0 (socket says 172.21.15.100:36382) 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f889de00700 1 -- 172.21.15.100:0/3375806001 learned_addr learned my addr 172.21.15.100:0/3375806001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f889e800700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a01545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.077+0000 7f889d400700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00c6820 0x7f88a01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f889de00700 1 -- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 msgr2=0x7f88a01545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:44.080 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f889de00700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a01545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f889de00700 1 -- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00c6820 msgr2=0x7f88a01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f889de00700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00c6820 0x7f88a01540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f889de00700 1 -- 172.21.15.100:0/3375806001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8890009250 con 0x7f88a00aa3d0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f889de00700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88a00aa3d0 0x7f88a0150200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f88a0084480 tx=0x7f8890015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f8895600700 1 -- 172.21.15.100:0/3375806001 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890021070 con 0x7f88a00aa3d0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f8895600700 1 -- 172.21.15.100:0/3375806001 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889000d6b0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a0152520 con 0x7f88a00aa3d0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f8895600700 1 -- 172.21.15.100:0/3375806001 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900067f0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a0152ae0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.078+0000 7f8895600700 1 -- 172.21.15.100:0/3375806001 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f889000dca0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.081 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.079+0000 7f8895600700 1 -- 172.21.15.100:0/3375806001 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f889001d450 con 0x7f88a00aa3d0 2024-01-22T05:37:44.082 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.079+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a005f020 con 0x7f88a00aa3d0 2024-01-22T05:37:44.082 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:44.080+0000 7f3e8642a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-22T05:37:44.083 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.082+0000 7f8895600700 1 -- 172.21.15.100:0/3375806001 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f889001d860 con 0x7f88a00aa3d0 2024-01-22T05:37:44.108 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:44.108+0000 7fc831da4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-22T05:37:44.153 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.152+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88a005e9d0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.154 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.153+0000 7f8895600700 1 -- 172.21.15.100:0/3375806001 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f889001dac0 con 0x7f88a00aa3d0 2024-01-22T05:37:44.154 INFO:teuthology.misc.health.smithi100.stdout: 2024-01-22T05:37:44.154 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":10,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:42.671647+0000","last_up_change":"0.000000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:37:44.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88a00aa3d0 msgr2=0x7f88a0150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:44.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88a00aa3d0 0x7f88a0150200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f88a0084480 tx=0x7f8890015000).stop 2024-01-22T05:37:44.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 shutdown_connections 2024-01-22T05:37:44.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a0151e20 0x7f88a01545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:44.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88a00aa3d0 0x7f88a0150200 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:44.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 --2- 172.21.15.100:0/3375806001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00c6820 0x7f88a01540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:44.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 >> 172.21.15.100:0/3375806001 conn(0x7f88a00945f0 msgr2=0x7f88a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:44.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 shutdown_connections 2024-01-22T05:37:44.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:44.154+0000 7f88a4e00700 1 -- 172.21.15.100:0/3375806001 wait complete. 2024-01-22T05:37:44.169 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-22T05:37:44.207 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:44.207+0000 7fc831da4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-22T05:37:44.274 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:44.273+0000 7f3e8642a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-22T05:37:44.366 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:44.365+0000 7f3e8642a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-22T05:37:44.397 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:44.398+0000 7fc831da4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-22T05:37:44.489 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:44.489+0000 7fc831da4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-22T05:37:44.509 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:44.508+0000 7f3e8642a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-22T05:37:44.635 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:44.635+0000 7fc831da4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-22T05:37:44.641 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:44.640+0000 7f3e8642a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:37:44.766 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:44.766+0000 7fc831da4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-22T05:37:45.023 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:45.022+0000 7f3e8642a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-22T05:37:45.116 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:45.115+0000 7f3e8642a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-22T05:37:45.165 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:45.165+0000 7fc831da4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-22T05:37:45.255 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-01-22T05:37:45.256+0000 7fc831da4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-22T05:37:46.137 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:46.136+0000 7f3e32600700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-22T05:37:46.137 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-22T05:37:46.136+0000 7f3e32600700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-22T05:37:47.123 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-01-22T05:37:47.123+0000 7efd6eccc380 -1 osd.4 0 log_to_monitors {default=true} 2024-01-22T05:37:47.143 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-22T05:37:47.142+0000 7f1865b9c380 -1 osd.1 0 log_to_monitors {default=true} 2024-01-22T05:37:47.175 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-01-22T05:37:47.174+0000 7f3037ec9380 -1 osd.5 0 log_to_monitors {default=true} 2024-01-22T05:37:47.202 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-22T05:37:47.202+0000 7fda4fc02380 -1 osd.0 0 log_to_monitors {default=true} 2024-01-22T05:37:47.218 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-01-22T05:37:47.217+0000 7f4553c5e380 -1 osd.7 0 log_to_monitors {default=true} 2024-01-22T05:37:47.230 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-01-22T05:37:47.229+0000 7f23a7c17380 -1 osd.6 0 log_to_monitors {default=true} 2024-01-22T05:37:47.231 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-22T05:37:47.230+0000 7fb9c9492380 -1 osd.3 0 log_to_monitors {default=true} 2024-01-22T05:37:47.242 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-22T05:37:47.241+0000 7f9ecdc76380 -1 osd.2 0 log_to_monitors {default=true} 2024-01-22T05:37:48.164 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-01-22T05:37:48.163+0000 7efd61000700 -1 osd.4 0 waiting for initial osdmap 2024-01-22T05:37:48.170 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-01-22T05:37:48.170+0000 7efd5c800700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:49.167 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-22T05:37:49.165+0000 7f1857e00700 -1 osd.1 0 waiting for initial osdmap 2024-01-22T05:37:49.168 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-01-22T05:37:49.167+0000 7f302a200700 -1 osd.5 0 waiting for initial osdmap 2024-01-22T05:37:49.168 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-22T05:37:49.167+0000 7fda41e00700 -1 osd.0 0 waiting for initial osdmap 2024-01-22T05:37:49.169 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-01-22T05:37:49.168+0000 7f2399e00700 -1 osd.6 0 waiting for initial osdmap 2024-01-22T05:37:49.169 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-01-22T05:37:49.169+0000 7f4546000700 -1 osd.7 0 waiting for initial osdmap 2024-01-22T05:37:49.170 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-22T05:37:49.169+0000 7fb9bb800700 -1 osd.3 0 waiting for initial osdmap 2024-01-22T05:37:49.170 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-22T05:37:49.169+0000 7f9ec0000700 -1 osd.2 0 waiting for initial osdmap 2024-01-22T05:37:49.176 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-01-22T05:37:49.176+0000 7f2395600700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:49.179 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-22T05:37:49.178+0000 7f1853600700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:49.179 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-22T05:37:49.178+0000 7fda3d600700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:49.179 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-22T05:37:49.178+0000 7fb9b7000700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:49.180 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-22T05:37:49.178+0000 7f9ebb800700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:49.180 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-01-22T05:37:49.180+0000 7f4541800700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:49.181 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-01-22T05:37:49.180+0000 7f3025a00700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T05:37:50.975 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-22T05:37:51.148 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.147+0000 7f2f74000700 1 Processor -- start 2024-01-22T05:37:51.148 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.147+0000 7f2f74000700 1 -- start start 2024-01-22T05:37:51.151 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.148+0000 7f2f74000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f6c0a5ab0 0x7f2f6c0a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.151 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.148+0000 7f2f74000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0c0fc0 0x7f2f6c069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.151 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.148+0000 7f2f74000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c065760 con 0x7f2f6c06a070 2024-01-22T05:37:51.151 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.148+0000 7f2f74000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c0bc340 con 0x7f2f6c0a5ab0 2024-01-22T05:37:51.151 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.148+0000 7f2f74000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c06a500 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.151 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f6c0a5ab0 0x7f2f6c0a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.151 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f6c0a5ab0 0x7f2f6c0a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36478/0 (socket says 172.21.15.100:36478) 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 -- 172.21.15.100:0/3586223365 learned_addr learned my addr 172.21.15.100:0/3586223365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f70c00700 1 --2- 172.21.15.100:0/3586223365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0c0fc0 0x7f2f6c069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 -- 172.21.15.100:0/3586223365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0c0fc0 msgr2=0x7f2f6c069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 --2- 172.21.15.100:0/3586223365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0c0fc0 0x7f2f6c069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 -- 172.21.15.100:0/3586223365 >> v1:172.21.15.169:6789/0 conn(0x7f2f6c06a070 legacy=0x7f2f6c153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 -- 172.21.15.100:0/3586223365 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c06a780 con 0x7f2f6c0a5ab0 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f71600700 1 --2- 172.21.15.100:0/3586223365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0a5ab0 0x7f2f6c0a5e90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2f5c006fd0 tx=0x7f2f5c0090f0).ready entity=mon.0 client_cookie=ddcdbefae637198f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.149+0000 7f2f6be00700 1 -- 172.21.15.100:0/3586223365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00b580 con 0x7f2f6c0a5ab0 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f6be00700 1 -- 172.21.15.100:0/3586223365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c00b6e0 con 0x7f2f6c0a5ab0 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f6be00700 1 -- 172.21.15.100:0/3586223365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00ba80 con 0x7f2f6c0a5ab0 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 -- 172.21.15.100:0/3586223365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0a5ab0 msgr2=0x7f2f6c0a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 --2- 172.21.15.100:0/3586223365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0a5ab0 0x7f2f6c0a5e90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2f5c006fd0 tx=0x7f2f5c0090f0).stop 2024-01-22T05:37:51.152 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 -- 172.21.15.100:0/3586223365 shutdown_connections 2024-01-22T05:37:51.153 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 --2- 172.21.15.100:0/3586223365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0a5ab0 0x7f2f6c0a5e90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.153 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 --2- 172.21.15.100:0/3586223365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0c0fc0 0x7f2f6c069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.153 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 -- 172.21.15.100:0/3586223365 >> 172.21.15.100:0/3586223365 conn(0x7f2f6c063090 msgr2=0x7f2f6c0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:51.153 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 -- 172.21.15.100:0/3586223365 shutdown_connections 2024-01-22T05:37:51.153 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.150+0000 7f2f74000700 1 -- 172.21.15.100:0/3586223365 wait complete. 2024-01-22T05:37:51.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.152+0000 7f2f74000700 1 Processor -- start 2024-01-22T05:37:51.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.152+0000 7f2f74000700 1 -- start start 2024-01-22T05:37:51.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f74000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c06a070 0x7f2f6c0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f74000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0a5ab0 0x7f2f6c149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f74000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0c0fc0 0x7f2f6c0a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.155 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f74000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0ac050 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f74000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0ab6b0 con 0x7f2f6c06a070 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f74000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0ab990 con 0x7f2f6c0a5ab0 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0c0fc0 0x7f2f6c0a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0c0fc0 0x7f2f6c0a8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36484/0 (socket says 172.21.15.100:36484) 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 -- 172.21.15.100:0/1540647667 learned_addr learned my addr 172.21.15.100:0/1540647667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f70c00700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0a5ab0 0x7f2f6c149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f71600700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c06a070 0x7f2f6c0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 -- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0a5ab0 msgr2=0x7f2f6c149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0a5ab0 0x7f2f6c149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 -- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c06a070 msgr2=0x7f2f6c0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c06a070 0x7f2f6c0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.153+0000 7f2f72000700 1 -- 172.21.15.100:0/1540647667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c009370 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.154+0000 7f2f72000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0c0fc0 0x7f2f6c0a8af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2f64002230 tx=0x7f2f640015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:51.156 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.154+0000 7f2f68c00700 1 -- 172.21.15.100:0/1540647667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400e4a0 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.157 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.154+0000 7f2f68c00700 1 -- 172.21.15.100:0/1540647667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6400e600 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.157 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.154+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0abc70 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.157 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.154+0000 7f2f68c00700 1 -- 172.21.15.100:0/1540647667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400e980 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.157 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.154+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c0ac960 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.157 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.155+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c0ac190 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.158 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.156+0000 7f2f68c00700 1 -- 172.21.15.100:0/1540647667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2f6401b3b0 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.158 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.156+0000 7f2f68c00700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.158 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.157+0000 7f2f68c00700 1 -- 172.21.15.100:0/1540647667 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f2f64079260 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.158 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.157+0000 7f2f71600700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.158 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.157+0000 7f2f71600700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2f5c00b340 tx=0x7f2f5c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:51.162 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.162+0000 7f2f68c00700 1 -- 172.21.15.100:0/1540647667 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f64048b00 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.342 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.341+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f6c05fdb0 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.343 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.342+0000 7f2f68c00700 1 -- 172.21.15.100:0/1540647667 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12228 (secure 0 0 0) 0x7f2f6c0ac190 con 0x7f2f6c0c0fc0 2024-01-22T05:37:51.343 INFO:teuthology.misc.health.smithi100.stdout: 2024-01-22T05:37:51.344 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":15,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:51.179660+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:37:51.345 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 msgr2=0x7f2f44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.345 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2f5c00b340 tx=0x7f2f5c017000).stop 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0c0fc0 msgr2=0x7f2f6c0a8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0c0fc0 0x7f2f6c0a8af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2f64002230 tx=0x7f2f640015e0).stop 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 shutdown_connections 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c06a070 0x7f2f6c0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c0c0fc0 0x7f2f6c0a8af0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 --2- 172.21.15.100:0/1540647667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c0a5ab0 0x7f2f6c149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 >> 172.21.15.100:0/1540647667 conn(0x7f2f6c063090 msgr2=0x7f2f6c0bc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.344+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 shutdown_connections 2024-01-22T05:37:51.346 INFO:teuthology.misc.health.smithi100.stderr:2024-01-22T05:37:51.345+0000 7f2f74000700 1 -- 172.21.15.100:0/1540647667 wait complete. 2024-01-22T05:37:51.360 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-22T05:37:51.361 INFO:tasks.ceph:Creating RBD pool 2024-01-22T05:37:51.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd pool create rbd 8 2024-01-22T05:37:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.536+0000 7f0b49600700 1 Processor -- start 2024-01-22T05:37:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.537+0000 7f0b49600700 1 -- start start 2024-01-22T05:37:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b49600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44157d80 0x7f0b44158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b49600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0b441586f0 0x7f0b440c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b49600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b440c1a40 con 0x7f0b44154260 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b49600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b440cbd30 con 0x7f0b441586f0 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b49600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b44158b80 con 0x7f0b44157d80 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b43400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0b441586f0 0x7f0b440c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b42a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0b44154260 0x7f0b440cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48446/0 (socket says 172.21.15.100:48446) 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b42a00700 1 -- 172.21.15.100:0/2900459739 learned_addr learned my addr 172.21.15.100:0/2900459739 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.538+0000 7f0b42000700 1 --2- 172.21.15.100:0/2900459739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44157d80 0x7f0b44158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b41600700 1 -- 172.21.15.100:0/2900459739 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423603270 0 0) 0x7f0b440c1a40 con 0x7f0b44154260 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b41600700 1 -- 172.21.15.100:0/2900459739 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b240033f0 con 0x7f0b44154260 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b43400700 1 -- 172.21.15.100:0/2900459739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44157d80 msgr2=0x7f0b44158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b43400700 1 --2- 172.21.15.100:0/2900459739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44157d80 0x7f0b44158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b43400700 1 -- 172.21.15.100:0/2900459739 >> v1:172.21.15.100:6789/0 conn(0x7f0b44154260 legacy=0x7f0b440cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b43400700 1 -- 172.21.15.100:0/2900459739 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b440c1110 con 0x7f0b441586f0 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b42000700 1 --2- 172.21.15.100:0/2900459739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44157d80 0x7f0b44158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b43400700 1 --2- 172.21.15.100:0/2900459739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c8c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0b3c009e90 tx=0x7f0b3c009780).ready entity=mon.0 client_cookie=4ba7738d8e8a239a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b41600700 1 -- 172.21.15.100:0/2900459739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c00e070 con 0x7f0b441586f0 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b41600700 1 -- 172.21.15.100:0/2900459739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c00bb20 con 0x7f0b441586f0 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b41600700 1 -- 172.21.15.100:0/2900459739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c00bea0 con 0x7f0b441586f0 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b49600700 1 -- 172.21.15.100:0/2900459739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 msgr2=0x7f0b440c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.539+0000 7f0b49600700 1 --2- 172.21.15.100:0/2900459739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c8c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0b3c009e90 tx=0x7f0b3c009780).stop 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.540+0000 7f0b49600700 1 -- 172.21.15.100:0/2900459739 shutdown_connections 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.540+0000 7f0b49600700 1 --2- 172.21.15.100:0/2900459739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c8c00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.540+0000 7f0b49600700 1 --2- 172.21.15.100:0/2900459739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44157d80 0x7f0b44158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.540+0000 7f0b49600700 1 -- 172.21.15.100:0/2900459739 >> 172.21.15.100:0/2900459739 conn(0x7f0b4405e9d0 msgr2=0x7f0b440cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.540+0000 7f0b49600700 1 -- 172.21.15.100:0/2900459739 shutdown_connections 2024-01-22T05:37:51.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.540+0000 7f0b49600700 1 -- 172.21.15.100:0/2900459739 wait complete. 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.541+0000 7f0b49600700 1 Processor -- start 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.541+0000 7f0b49600700 1 -- start start 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b49600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44154260 0x7f0b440c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b49600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b44157d80 0x7f0b440c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b49600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b49600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440aedd0 con 0x7f0b441586f0 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b49600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440af0b0 con 0x7f0b44157d80 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b49600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440af390 con 0x7f0b44154260 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b43400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b43400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36504/0 (socket says 172.21.15.100:36504) 2024-01-22T05:37:51.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.542+0000 7f0b43400700 1 -- 172.21.15.100:0/669112372 learned_addr learned my addr 172.21.15.100:0/669112372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:51.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b42a00700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44154260 0x7f0b440c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b42000700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b44157d80 0x7f0b440c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b43400700 1 -- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44154260 msgr2=0x7f0b440c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b43400700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44154260 0x7f0b440c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b43400700 1 -- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b44157d80 msgr2=0x7f0b440c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:51.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b43400700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b44157d80 0x7f0b440c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:51.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b43400700 1 -- 172.21.15.100:0/669112372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c009a20 con 0x7f0b441586f0 2024-01-22T05:37:51.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b43400700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c44a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b3c00b6c0 tx=0x7f0b3c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:51.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b3a000700 1 -- 172.21.15.100:0/669112372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c01d630 con 0x7f0b441586f0 2024-01-22T05:37:51.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b3a000700 1 -- 172.21.15.100:0/669112372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c01d790 con 0x7f0b441586f0 2024-01-22T05:37:51.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b440af670 con 0x7f0b441586f0 2024-01-22T05:37:51.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b3a000700 1 -- 172.21.15.100:0/669112372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c01db50 con 0x7f0b441586f0 2024-01-22T05:37:51.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.543+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b440c3b00 con 0x7f0b441586f0 2024-01-22T05:37:51.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.544+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b440af9e0 con 0x7f0b441586f0 2024-01-22T05:37:51.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.545+0000 7f0b3a000700 1 -- 172.21.15.100:0/669112372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0b3c003040 con 0x7f0b441586f0 2024-01-22T05:37:51.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.545+0000 7f0b3a000700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b1c05f150 0x7f0b1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:51.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.546+0000 7f0b3a000700 1 -- 172.21.15.100:0/669112372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f0b3c07bcd0 con 0x7f0b441586f0 2024-01-22T05:37:51.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.546+0000 7f0b42a00700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b1c05f150 0x7f0b1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:51.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.546+0000 7f0b42a00700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b1c05f150 0x7f0b1c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0b44158650 tx=0x7f0b34009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:51.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.550+0000 7f0b3a000700 1 -- 172.21.15.100:0/669112372 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0b3c04d470 con 0x7f0b441586f0 2024-01-22T05:37:51.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:51.719+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f0b440afb90 con 0x7f0b441586f0 2024-01-22T05:37:52.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.191+0000 7f0b3a000700 1 -- 172.21.15.100:0/669112372 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0b440afb90 con 0x7f0b441586f0 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b1c05f150 msgr2=0x7f0b1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b1c05f150 0x7f0b1c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0b44158650 tx=0x7f0b34009040).stop 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 msgr2=0x7f0b440c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c44a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b3c00b6c0 tx=0x7f0b3c009780).stop 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 shutdown_connections 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b1c05f150 0x7f0b1c061610 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b441586f0 0x7f0b440c44a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44154260 0x7f0b440c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 --2- 172.21.15.100:0/669112372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b44157d80 0x7f0b440c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 >> 172.21.15.100:0/669112372 conn(0x7f0b4405e9d0 msgr2=0x7f0b441512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:52.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 shutdown_connections 2024-01-22T05:37:52.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.194+0000 7f0b49600700 1 -- 172.21.15.100:0/669112372 wait complete. 2024-01-22T05:37:52.196 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'rbd' created 2024-01-22T05:37:52.214 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-01-22T05:37:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.392+0000 7efe67400700 1 Processor -- start 2024-01-22T05:37:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.392+0000 7efe67400700 1 -- start start 2024-01-22T05:37:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.393+0000 7efe67400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efe60154260 0x7efe600cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.393+0000 7efe67400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c5c80 0x7efe600c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.393+0000 7efe67400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe600c1a40 con 0x7efe600c65f0 2024-01-22T05:37:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.393+0000 7efe67400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600cbd30 con 0x7efe60154260 2024-01-22T05:37:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.393+0000 7efe67400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe600c6a80 con 0x7efe600c5c80 2024-01-22T05:37:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe65400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efe600c65f0 0x7efe60157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48450/0 (socket says 172.21.15.100:48450) 2024-01-22T05:37:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe65400700 1 -- 172.21.15.100:0/4169020336 learned_addr learned my addr 172.21.15.100:0/4169020336 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe64a00700 1 --2- 172.21.15.100:0/4169020336 >> v2:172.21.15.169:3300/0 conn(0x7efe60154260 0x7efe600cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe5fe00700 1 --2- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c5c80 0x7efe600c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe5f400700 1 -- 172.21.15.100:0/4169020336 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563249205 0 0) 0x7efe600c1a40 con 0x7efe600c65f0 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe5f400700 1 -- 172.21.15.100:0/4169020336 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe400033f0 con 0x7efe600c65f0 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe64a00700 1 -- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c5c80 msgr2=0x7efe600c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe64a00700 1 --2- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c5c80 0x7efe600c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe64a00700 1 -- 172.21.15.100:0/4169020336 >> v1:172.21.15.100:6789/0 conn(0x7efe600c65f0 legacy=0x7efe60157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe64a00700 1 -- 172.21.15.100:0/4169020336 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600c1110 con 0x7efe60154260 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe5fe00700 1 --2- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c5c80 0x7efe600c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.394+0000 7efe64a00700 1 --2- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600cb4e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7efe50009760 tx=0x7efe50006f40).ready entity=mon.1 client_cookie=65cc2f5f694540c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe5f400700 1 -- 172.21.15.100:0/4169020336 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50005880 con 0x7efe60154260 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe5f400700 1 -- 172.21.15.100:0/4169020336 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe500059e0 con 0x7efe60154260 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe5f400700 1 -- 172.21.15.100:0/4169020336 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50005d60 con 0x7efe60154260 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 -- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 msgr2=0x7efe600cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 --2- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600cb4e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7efe50009760 tx=0x7efe50006f40).stop 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 -- 172.21.15.100:0/4169020336 shutdown_connections 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 --2- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600cb4e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 --2- 172.21.15.100:0/4169020336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c5c80 0x7efe600c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 -- 172.21.15.100:0/4169020336 >> 172.21.15.100:0/4169020336 conn(0x7efe6005e9d0 msgr2=0x7efe600cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 -- 172.21.15.100:0/4169020336 shutdown_connections 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.395+0000 7efe67400700 1 -- 172.21.15.100:0/4169020336 wait complete. 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.397+0000 7efe67400700 1 Processor -- start 2024-01-22T05:37:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.397+0000 7efe67400700 1 -- start start 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe67400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe600c5c80 0x7efe600add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe67400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c65f0 0x7efe60152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe67400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe67400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600af490 con 0x7efe600c5c80 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe67400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600ae640 con 0x7efe60154260 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe67400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe600ae920 con 0x7efe600c65f0 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe600c5c80 0x7efe600add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe600c5c80 0x7efe600add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36520/0 (socket says 172.21.15.100:36520) 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 -- 172.21.15.100:0/2048935027 learned_addr learned my addr 172.21.15.100:0/2048935027 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe5fe00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c65f0 0x7efe60152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe65400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 -- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c65f0 msgr2=0x7efe60152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c65f0 0x7efe60152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 -- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 msgr2=0x7efe600a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe64a00700 1 -- 172.21.15.100:0/2048935027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe480092a0 con 0x7efe600c5c80 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe5fe00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c65f0 0x7efe60152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.398+0000 7efe65400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.399+0000 7efe64a00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe600c5c80 0x7efe600add60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7efe50006f80 tx=0x7efe50015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.399+0000 7efe57e00700 1 -- 172.21.15.100:0/2048935027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5000d6b0 con 0x7efe600c5c80 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.399+0000 7efe57e00700 1 -- 172.21.15.100:0/2048935027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5000d830 con 0x7efe600c5c80 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.399+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe50009250 con 0x7efe600c5c80 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.399+0000 7efe57e00700 1 -- 172.21.15.100:0/2048935027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5000dbf0 con 0x7efe600c5c80 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.399+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe600aeee0 con 0x7efe600c5c80 2024-01-22T05:37:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.400+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe600af770 con 0x7efe600c5c80 2024-01-22T05:37:52.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.401+0000 7efe57e00700 1 -- 172.21.15.100:0/2048935027 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efe500113f0 con 0x7efe600c5c80 2024-01-22T05:37:52.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.402+0000 7efe57e00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe3805f150 0x7efe38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:52.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.402+0000 7efe57e00700 1 -- 172.21.15.100:0/2048935027 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7efe5007b400 con 0x7efe600c5c80 2024-01-22T05:37:52.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.402+0000 7efe5fe00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe3805f150 0x7efe38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.402+0000 7efe5fe00700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe3805f150 0x7efe38061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7efe48009270 tx=0x7efe48008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:52.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.406+0000 7efe57e00700 1 -- 172.21.15.100:0/2048935027 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efe5004c9d0 con 0x7efe600c5c80 2024-01-22T05:37:52.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:52.577+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efe600c13f0 con 0x7efe600c5c80 2024-01-22T05:37:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.195+0000 7efe57e00700 1 -- 172.21.15.100:0/2048935027 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7efe50023070 con 0x7efe600c5c80 2024-01-22T05:37:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.197+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe3805f150 msgr2=0x7efe38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.197+0000 7efe67400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe3805f150 0x7efe38061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7efe48009270 tx=0x7efe48008040).stop 2024-01-22T05:37:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.197+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe600c5c80 msgr2=0x7efe600add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.197+0000 7efe67400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe600c5c80 0x7efe600add60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7efe50006f80 tx=0x7efe50015000).stop 2024-01-22T05:37:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 shutdown_connections 2024-01-22T05:37:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe3805f150 0x7efe38061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe60154260 0x7efe600a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe600c5c80 0x7efe600add60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 --2- 172.21.15.100:0/2048935027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe600c65f0 0x7efe60152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 >> 172.21.15.100:0/2048935027 conn(0x7efe6005e9d0 msgr2=0x7efe601535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 shutdown_connections 2024-01-22T05:37:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.198+0000 7efe67400700 1 -- 172.21.15.100:0/2048935027 wait complete. 2024-01-22T05:37:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:enabled application 'rbd' on pool 'rbd' 2024-01-22T05:37:53.220 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-22T05:37:53.221 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:37:53.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:37:53.225 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:37:53.225 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:37:53.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:37:53.229 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:37:53.229 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:37:53.229 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:37:53.233 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:37:53.233 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:37:53.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:37:53.237 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:37:53.237 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-22T05:37:53.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:37:53.368 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-22T05:37:53.368 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-22T05:37:53.380 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-01-22T05:37:53.383 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-01-22T05:37:53.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.436+0000 7f4877400700 1 Processor -- start 2024-01-22T05:37:53.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.436+0000 7f4877400700 1 -- start start 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4877400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4870153ee0 0x7f48700c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4877400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48701542c0 0x7f48700c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4877400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48700928b0 con 0x7f48700be2d0 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4877400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700c4870 con 0x7f4870153ee0 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4877400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700bef90 con 0x7f48701542c0 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4874a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4870153ee0 0x7f48700c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4874a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4870153ee0 0x7f48700c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40750/0 (socket says 172.21.15.100:40750) 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.437+0000 7f4874a00700 1 -- 172.21.15.100:0/1259394631 learned_addr learned my addr 172.21.15.100:0/1259394631 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f486fe00700 1 --2- 172.21.15.100:0/1259394631 >> v2:172.21.15.169:3300/0 conn(0x7f48701542c0 0x7f48700c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f4874a00700 1 -- 172.21.15.100:0/1259394631 >> v2:172.21.15.169:3300/0 conn(0x7f48701542c0 msgr2=0x7f48700c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:53.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f4874a00700 1 --2- 172.21.15.100:0/1259394631 >> v2:172.21.15.169:3300/0 conn(0x7f48701542c0 0x7f48700c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f4874a00700 1 -- 172.21.15.100:0/1259394631 >> v1:172.21.15.169:6789/0 conn(0x7f48700be2d0 legacy=0x7f48700be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f4874a00700 1 -- 172.21.15.100:0/1259394631 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700bfba0 con 0x7f4870153ee0 2024-01-22T05:37:53.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f4874a00700 1 --2- 172.21.15.100:0/1259394631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4870153ee0 0x7f48700c3e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f48700ab960 tx=0x7f4860009060).ready entity=mon.0 client_cookie=a6161182cd598ec6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f486f400700 1 -- 172.21.15.100:0/1259394631 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860005880 con 0x7f4870153ee0 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f486f400700 1 -- 172.21.15.100:0/1259394631 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600059e0 con 0x7f4870153ee0 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.438+0000 7f486f400700 1 -- 172.21.15.100:0/1259394631 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860005d60 con 0x7f4870153ee0 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 -- 172.21.15.100:0/1259394631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4870153ee0 msgr2=0x7f48700c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 --2- 172.21.15.100:0/1259394631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4870153ee0 0x7f48700c3e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f48700ab960 tx=0x7f4860009060).stop 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 -- 172.21.15.100:0/1259394631 shutdown_connections 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 --2- 172.21.15.100:0/1259394631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4870153ee0 0x7f48700c3e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 --2- 172.21.15.100:0/1259394631 >> v2:172.21.15.169:3300/0 conn(0x7f48701542c0 0x7f48700c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 -- 172.21.15.100:0/1259394631 >> 172.21.15.100:0/1259394631 conn(0x7f4870091a00 msgr2=0x7f4870091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:53.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 -- 172.21.15.100:0/1259394631 shutdown_connections 2024-01-22T05:37:53.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.439+0000 7f4877400700 1 -- 172.21.15.100:0/1259394631 wait complete. 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.440+0000 7f4877400700 1 Processor -- start 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.441+0000 7f4877400700 1 -- start start 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.441+0000 7f4877400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700be2d0 0x7f4870164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.441+0000 7f4877400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4870153ee0 0x7f48700c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.441+0000 7f4877400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48701542c0 0x7f4870156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.441+0000 7f4877400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870155c40 con 0x7f48700be2d0 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.441+0000 7f4877400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870154de0 con 0x7f48701542c0 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4877400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870155030 con 0x7f4870153ee0 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700be2d0 0x7f4870164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700be2d0 0x7f4870164650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40756/0 (socket says 172.21.15.100:40756) 2024-01-22T05:37:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 -- 172.21.15.100:0/797568473 learned_addr learned my addr 172.21.15.100:0/797568473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f486fe00700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4870153ee0 0x7f48700c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4875400700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48701542c0 0x7f4870156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 -- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4870153ee0 msgr2=0x7f48700c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4870153ee0 0x7f48700c1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 -- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48701542c0 msgr2=0x7f4870156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48701542c0 0x7f4870156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 -- 172.21.15.100:0/797568473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860009300 con 0x7f48700be2d0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4874a00700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700be2d0 0x7f4870164650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4870069010 tx=0x7f4860016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.442+0000 7f4867e00700 1 -- 172.21.15.100:0/797568473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000b600 con 0x7f48700be2d0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.443+0000 7f4867e00700 1 -- 172.21.15.100:0/797568473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000b760 con 0x7f48700be2d0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.443+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4870155310 con 0x7f48700be2d0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.443+0000 7f4867e00700 1 -- 172.21.15.100:0/797568473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000bae0 con 0x7f48700be2d0 2024-01-22T05:37:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.443+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48701558d0 con 0x7f48700be2d0 2024-01-22T05:37:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.444+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4870155f20 con 0x7f48700be2d0 2024-01-22T05:37:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.444+0000 7f4867e00700 1 -- 172.21.15.100:0/797568473 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4860018070 con 0x7f48700be2d0 2024-01-22T05:37:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.445+0000 7f4867e00700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f484805f150 0x7f4848061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.445+0000 7f4867e00700 1 -- 172.21.15.100:0/797568473 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f486007af10 con 0x7f48700be2d0 2024-01-22T05:37:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.445+0000 7f486fe00700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f484805f150 0x7f4848061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.446+0000 7f486fe00700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f484805f150 0x7f4848061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4870156660 tx=0x7f4858008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:53.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.449+0000 7f4867e00700 1 -- 172.21.15.100:0/797568473 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f486004c470 con 0x7f48700be2d0 2024-01-22T05:37:53.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.620+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f487005fdb0 con 0x7f48700be2d0 2024-01-22T05:37:53.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.621+0000 7f4867e00700 1 -- 172.21.15.100:0/797568473 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f4860006ad0 con 0x7f48700be2d0 2024-01-22T05:37:53.622 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:37:53.622 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:53.189853+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:37:53.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f484805f150 msgr2=0x7f4848061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f484805f150 0x7f4848061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4870156660 tx=0x7f4858008040).stop 2024-01-22T05:37:53.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700be2d0 msgr2=0x7f4870164650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700be2d0 0x7f4870164650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4870069010 tx=0x7f4860016000).stop 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 shutdown_connections 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f484805f150 0x7f4848061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48701542c0 0x7f4870156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700be2d0 0x7f4870164650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 --2- 172.21.15.100:0/797568473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4870153ee0 0x7f48700c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 >> 172.21.15.100:0/797568473 conn(0x7f4870091a00 msgr2=0x7f48700a7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 shutdown_connections 2024-01-22T05:37:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.623+0000 7f4877400700 1 -- 172.21.15.100:0/797568473 wait complete. 2024-01-22T05:37:53.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:37:53.641 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:37:53.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.827+0000 7fba95200700 1 Processor -- start 2024-01-22T05:37:53.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.827+0000 7fba95200700 1 -- start start 2024-01-22T05:37:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.828+0000 7fba95200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fba90154260 0x7fba900cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.828+0000 7fba95200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900c1a40 con 0x7fba900c6810 2024-01-22T05:37:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.828+0000 7fba95200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900cbd30 con 0x7fba900c5c80 2024-01-22T05:37:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.828+0000 7fba95200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900c1110 con 0x7fba90154260 2024-01-22T05:37:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.828+0000 7fba8e800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fba900c6810 0x7fba900c8c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59270/0 (socket says 172.21.15.100:59270) 2024-01-22T05:37:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.828+0000 7fba8e800700 1 -- 172.21.15.100:0/3226755039 learned_addr learned my addr 172.21.15.100:0/3226755039 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.828+0000 7fba8de00700 1 --2- 172.21.15.100:0/3226755039 >> v2:172.21.15.169:3300/0 conn(0x7fba90154260 0x7fba900cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8ca00700 1 -- 172.21.15.100:0/3226755039 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669767013 0 0) 0x7fba900c1a40 con 0x7fba900c6810 2024-01-22T05:37:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8ca00700 1 -- 172.21.15.100:0/3226755039 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba700033f0 con 0x7fba900c6810 2024-01-22T05:37:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8ca00700 1 -- 172.21.15.100:0/3226755039 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287934708 0 0) 0x7fba900cbd30 con 0x7fba900c5c80 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8ca00700 1 -- 172.21.15.100:0/3226755039 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba900c1a40 con 0x7fba900c5c80 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8de00700 1 -- 172.21.15.100:0/3226755039 >> v1:172.21.15.169:6789/0 conn(0x7fba900c5c80 legacy=0x7fba900c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8de00700 1 -- 172.21.15.100:0/3226755039 >> v1:172.21.15.100:6789/0 conn(0x7fba900c6810 legacy=0x7fba900c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8de00700 1 -- 172.21.15.100:0/3226755039 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900c13f0 con 0x7fba90154260 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8de00700 1 --2- 172.21.15.100:0/3226755039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba900cb4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fba80006fd0 tx=0x7fba80006f40).ready entity=mon.1 client_cookie=3d4527f49970adf8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8ca00700 1 -- 172.21.15.100:0/3226755039 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80005880 con 0x7fba90154260 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8ca00700 1 -- 172.21.15.100:0/3226755039 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba800059e0 con 0x7fba90154260 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.829+0000 7fba8ca00700 1 -- 172.21.15.100:0/3226755039 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80005d60 con 0x7fba90154260 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.830+0000 7fba95200700 1 -- 172.21.15.100:0/3226755039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 msgr2=0x7fba900cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.830+0000 7fba95200700 1 --2- 172.21.15.100:0/3226755039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba900cb4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fba80006fd0 tx=0x7fba80006f40).stop 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.830+0000 7fba95200700 1 -- 172.21.15.100:0/3226755039 shutdown_connections 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.830+0000 7fba95200700 1 --2- 172.21.15.100:0/3226755039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba900cb4e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.830+0000 7fba95200700 1 -- 172.21.15.100:0/3226755039 >> 172.21.15.100:0/3226755039 conn(0x7fba9005e9d0 msgr2=0x7fba900cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.830+0000 7fba95200700 1 -- 172.21.15.100:0/3226755039 shutdown_connections 2024-01-22T05:37:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.830+0000 7fba95200700 1 -- 172.21.15.100:0/3226755039 wait complete. 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.831+0000 7fba95200700 1 Processor -- start 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.832+0000 7fba95200700 1 -- start start 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.832+0000 7fba95200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba900c5c80 0x7fba900c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.832+0000 7fba95200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba900c6810 0x7fba9013d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.832+0000 7fba95200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba90064370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.832+0000 7fba95200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900c3f30 con 0x7fba900c6810 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.832+0000 7fba95200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900c4210 con 0x7fba90154260 2024-01-22T05:37:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.832+0000 7fba95200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900b0450 con 0x7fba900c5c80 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba900c6810 0x7fba9013d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba900c6810 0x7fba9013d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40762/0 (socket says 172.21.15.100:40762) 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 -- 172.21.15.100:0/1714458289 learned_addr learned my addr 172.21.15.100:0/1714458289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8de00700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba900c5c80 0x7fba900c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8e800700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba90064370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 -- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba900c5c80 msgr2=0x7fba900c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba900c5c80 0x7fba900c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 -- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 msgr2=0x7fba90064370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba90064370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 -- 172.21.15.100:0/1714458289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba80009250 con 0x7fba900c6810 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8e800700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba90064370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba8d400700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba900c6810 0x7fba9013d7e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fba7800c4c0 tx=0x7fba78007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.833+0000 7fba85600700 1 -- 172.21.15.100:0/1714458289 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800f470 con 0x7fba900c6810 2024-01-22T05:37:53.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.834+0000 7fba85600700 1 -- 172.21.15.100:0/1714458289 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7800f5d0 con 0x7fba900c6810 2024-01-22T05:37:53.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.834+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba900b0730 con 0x7fba900c6810 2024-01-22T05:37:53.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.834+0000 7fba85600700 1 -- 172.21.15.100:0/1714458289 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800f990 con 0x7fba900c6810 2024-01-22T05:37:53.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.834+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9013dcd0 con 0x7fba900c6810 2024-01-22T05:37:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.835+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba900c43a0 con 0x7fba900c6810 2024-01-22T05:37:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.835+0000 7fba85600700 1 -- 172.21.15.100:0/1714458289 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fba7800fd40 con 0x7fba900c6810 2024-01-22T05:37:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.836+0000 7fba85600700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fba6805f150 0x7fba68061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.836+0000 7fba85600700 1 -- 172.21.15.100:0/1714458289 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fba780794a0 con 0x7fba900c6810 2024-01-22T05:37:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.836+0000 7fba8de00700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fba6805f150 0x7fba68061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.837+0000 7fba8de00700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fba6805f150 0x7fba68061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fba80006fa0 tx=0x7fba80015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:53.840+0000 7fba85600700 1 -- 172.21.15.100:0/1714458289 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fba7804aa00 con 0x7fba900c6810 2024-01-22T05:37:54.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.009+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fba900c16d0 con 0x7fba900c6810 2024-01-22T05:37:54.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.010+0000 7fba85600700 1 -- 172.21.15.100:0/1714458289 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fba78007db0 con 0x7fba900c6810 2024-01-22T05:37:54.011 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:37:54.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fba6805f150 msgr2=0x7fba68061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fba6805f150 0x7fba68061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fba80006fa0 tx=0x7fba80015000).stop 2024-01-22T05:37:54.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba900c6810 msgr2=0x7fba9013d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba900c6810 0x7fba9013d7e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fba7800c4c0 tx=0x7fba78007c90).stop 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 shutdown_connections 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fba6805f150 0x7fba68061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba90154260 0x7fba90064370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba900c5c80 0x7fba900c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 --2- 172.21.15.100:0/1714458289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba900c6810 0x7fba9013d7e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 >> 172.21.15.100:0/1714458289 conn(0x7fba9005e9d0 msgr2=0x7fba9015a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 shutdown_connections 2024-01-22T05:37:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.012+0000 7fba95200700 1 -- 172.21.15.100:0/1714458289 wait complete. 2024-01-22T05:37:54.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:37:54.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.216+0000 7f2dd1a00700 1 Processor -- start 2024-01-22T05:37:54.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.216+0000 7f2dd1a00700 1 -- start start 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.217+0000 7f2dd1a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2dcc154260 0x7f2dcc0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.217+0000 7f2dd1a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc0c5c80 0x7f2dcc0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.217+0000 7f2dd1a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc0c1a40 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.217+0000 7f2dd1a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc0cbd30 con 0x7f2dcc154260 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.217+0000 7f2dd1a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0c6a80 con 0x7f2dcc0c5c80 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.217+0000 7f2dcb400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2dcc0c65f0 0x7f2dcc157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59272/0 (socket says 172.21.15.100:59272) 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.217+0000 7f2dcb400700 1 -- 172.21.15.100:0/233210356 learned_addr learned my addr 172.21.15.100:0/233210356 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dca000700 1 --2- 172.21.15.100:0/233210356 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc0c5c80 0x7f2dcc0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dcaa00700 1 --2- 172.21.15.100:0/233210356 >> v2:172.21.15.169:3300/0 conn(0x7f2dcc154260 0x7f2dcc0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dc9600700 1 -- 172.21.15.100:0/233210356 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107207024 0 0) 0x7f2dcc0c1a40 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dc9600700 1 -- 172.21.15.100:0/233210356 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dac0033f0 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dca000700 1 -- 172.21.15.100:0/233210356 >> v2:172.21.15.169:3300/0 conn(0x7f2dcc154260 msgr2=0x7f2dcc0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dca000700 1 --2- 172.21.15.100:0/233210356 >> v2:172.21.15.169:3300/0 conn(0x7f2dcc154260 0x7f2dcc0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dca000700 1 -- 172.21.15.100:0/233210356 >> v1:172.21.15.100:6789/0 conn(0x7f2dcc0c65f0 legacy=0x7f2dcc157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dca000700 1 -- 172.21.15.100:0/233210356 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc0c1110 con 0x7f2dcc0c5c80 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dcaa00700 1 --2- 172.21.15.100:0/233210356 >> v2:172.21.15.169:3300/0 conn(0x7f2dcc154260 0x7f2dcc0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.218+0000 7f2dca000700 1 --2- 172.21.15.100:0/233210356 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc0c5c80 0x7f2dcc0c6100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2db4009790 tx=0x7f2db4009060).ready entity=mon.2 client_cookie=3cff0adc2448bb1b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dc9600700 1 -- 172.21.15.100:0/233210356 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400d4a0 con 0x7f2dcc0c5c80 2024-01-22T05:37:54.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dc9600700 1 -- 172.21.15.100:0/233210356 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db400d600 con 0x7f2dcc0c5c80 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dc9600700 1 -- 172.21.15.100:0/233210356 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400d980 con 0x7f2dcc0c5c80 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 -- 172.21.15.100:0/233210356 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc0c5c80 msgr2=0x7f2dcc0c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/233210356 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc0c5c80 0x7f2dcc0c6100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2db4009790 tx=0x7f2db4009060).stop 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 -- 172.21.15.100:0/233210356 shutdown_connections 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/233210356 >> v2:172.21.15.169:3300/0 conn(0x7f2dcc154260 0x7f2dcc0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/233210356 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc0c5c80 0x7f2dcc0c6100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 -- 172.21.15.100:0/233210356 >> 172.21.15.100:0/233210356 conn(0x7f2dcc05e9d0 msgr2=0x7f2dcc0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 -- 172.21.15.100:0/233210356 shutdown_connections 2024-01-22T05:37:54.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.219+0000 7f2dd1a00700 1 -- 172.21.15.100:0/233210356 wait complete. 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.221+0000 7f2dd1a00700 1 Processor -- start 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.221+0000 7f2dd1a00700 1 -- start start 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dd1a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dcc0c5c80 0x7f2dcc0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dd1a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc0c65f0 0x7f2dcc1654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dd1a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc154260 0x7f2dcc0a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dd1a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc164860 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dd1a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc164b40 con 0x7f2dcc0c5c80 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dd1a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc164e20 con 0x7f2dcc154260 2024-01-22T05:37:54.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc0c65f0 0x7f2dcc1654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc0c65f0 0x7f2dcc1654c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40770/0 (socket says 172.21.15.100:40770) 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 -- 172.21.15.100:0/3020589930 learned_addr learned my addr 172.21.15.100:0/3020589930 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dcaa00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dcc0c5c80 0x7f2dcc0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dcb400700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc154260 0x7f2dcc0a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 -- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc154260 msgr2=0x7f2dcc0a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc154260 0x7f2dcc0a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 -- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dcc0c5c80 msgr2=0x7f2dcc0b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dcc0c5c80 0x7f2dcc0b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 -- 172.21.15.100:0/3020589930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc009250 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dcb400700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc154260 0x7f2dcc0a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.222+0000 7f2dca000700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc0c65f0 0x7f2dcc1654c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2dcc0c6bc0 tx=0x7f2db4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.223+0000 7f2dc2000700 1 -- 172.21.15.100:0/3020589930 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4000c90 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.223+0000 7f2dc2000700 1 -- 172.21.15.100:0/3020589930 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db400d770 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.223+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db40092a0 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.223+0000 7f2dc2000700 1 -- 172.21.15.100:0/3020589930 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db401d430 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.223+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc0ac860 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.224+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc05fdb0 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.225+0000 7f2dc2000700 1 -- 172.21.15.100:0/3020589930 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2db40263b0 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.226+0000 7f2dc2000700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2da405f150 0x7f2da4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.226+0000 7f2dc2000700 1 -- 172.21.15.100:0/3020589930 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2db407af50 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.226+0000 7f2dcaa00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2da405f150 0x7f2da4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.226+0000 7f2dcaa00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2da405f150 0x7f2da4061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2dbc006fd0 tx=0x7f2dbc006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:54.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.230+0000 7f2dc2000700 1 -- 172.21.15.100:0/3020589930 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2db404c450 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.401+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2dcc0c13f0 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.402+0000 7f2dc2000700 1 -- 172.21.15.100:0/3020589930 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2db4022070 con 0x7f2dcc0c65f0 2024-01-22T05:37:54.403 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:37:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2da405f150 msgr2=0x7f2da4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2da405f150 0x7f2da4061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2dbc006fd0 tx=0x7f2dbc006f40).stop 2024-01-22T05:37:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc0c65f0 msgr2=0x7f2dcc1654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc0c65f0 0x7f2dcc1654c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2dcc0c6bc0 tx=0x7f2db4016000).stop 2024-01-22T05:37:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 shutdown_connections 2024-01-22T05:37:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2da405f150 0x7f2da4061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dcc0c5c80 0x7f2dcc0b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dcc154260 0x7f2dcc0a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 --2- 172.21.15.100:0/3020589930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc0c65f0 0x7f2dcc1654c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 >> 172.21.15.100:0/3020589930 conn(0x7f2dcc05e9d0 msgr2=0x7f2dcc0c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 shutdown_connections 2024-01-22T05:37:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.404+0000 7f2dd1a00700 1 -- 172.21.15.100:0/3020589930 wait complete. 2024-01-22T05:37:54.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:37:54.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.605+0000 7fb6cea00700 1 Processor -- start 2024-01-22T05:37:54.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.605+0000 7fb6cea00700 1 -- start start 2024-01-22T05:37:54.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.606+0000 7fb6cea00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb6c8153ff0 0x7fb6c81543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.606+0000 7fb6cea00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c80c66e0 con 0x7fb6c80c5cd0 2024-01-22T05:37:54.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.606+0000 7fb6cea00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c80c0750 con 0x7fb6c80aa440 2024-01-22T05:37:54.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.606+0000 7fb6cea00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c80bfe20 con 0x7fb6c8153ff0 2024-01-22T05:37:54.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c7400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb6c80c5cd0 0x7fb6c80a9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59278/0 (socket says 172.21.15.100:59278) 2024-01-22T05:37:54.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c7400700 1 -- 172.21.15.100:0/2494979793 learned_addr learned my addr 172.21.15.100:0/2494979793 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:54.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c7e00700 1 --2- 172.21.15.100:0/2494979793 >> v2:172.21.15.169:3300/0 conn(0x7fb6c8153ff0 0x7fb6c81543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c6a00700 1 -- 172.21.15.100:0/2494979793 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312852728 0 0) 0x7fb6c80c66e0 con 0x7fb6c80c5cd0 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c6a00700 1 -- 172.21.15.100:0/2494979793 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a80033f0 con 0x7fb6c80c5cd0 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c7e00700 1 -- 172.21.15.100:0/2494979793 >> v1:172.21.15.169:6789/0 conn(0x7fb6c80aa440 legacy=0x7fb6c80c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c7e00700 1 -- 172.21.15.100:0/2494979793 >> v1:172.21.15.100:6789/0 conn(0x7fb6c80c5cd0 legacy=0x7fb6c80a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c7e00700 1 -- 172.21.15.100:0/2494979793 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c80c0100 con 0x7fb6c8153ff0 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.607+0000 7fb6c7e00700 1 --2- 172.21.15.100:0/2494979793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c81543d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6b8009760 tx=0x7fb6b8009060).ready entity=mon.1 client_cookie=1d8a19eb352f6087 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6c6a00700 1 -- 172.21.15.100:0/2494979793 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800f510 con 0x7fb6c8153ff0 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6c6a00700 1 -- 172.21.15.100:0/2494979793 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b800f670 con 0x7fb6c8153ff0 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6c6a00700 1 -- 172.21.15.100:0/2494979793 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800f9f0 con 0x7fb6c8153ff0 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6cea00700 1 -- 172.21.15.100:0/2494979793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 msgr2=0x7fb6c81543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6cea00700 1 --2- 172.21.15.100:0/2494979793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c81543d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6b8009760 tx=0x7fb6b8009060).stop 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6cea00700 1 -- 172.21.15.100:0/2494979793 shutdown_connections 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6cea00700 1 --2- 172.21.15.100:0/2494979793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c81543d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6cea00700 1 -- 172.21.15.100:0/2494979793 >> 172.21.15.100:0/2494979793 conn(0x7fb6c80c82a0 msgr2=0x7fb6c805e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6cea00700 1 -- 172.21.15.100:0/2494979793 shutdown_connections 2024-01-22T05:37:54.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.608+0000 7fb6cea00700 1 -- 172.21.15.100:0/2494979793 wait complete. 2024-01-22T05:37:54.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.610+0000 7fb6cea00700 1 Processor -- start 2024-01-22T05:37:54.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.610+0000 7fb6cea00700 1 -- start start 2024-01-22T05:37:54.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6cea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c80aa440 0x7fb6c814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6cea00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6c80c5cd0 0x7fb6c80ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6cea00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c80aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6cea00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8164770 con 0x7fb6c80aa440 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6cea00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80abf50 con 0x7fb6c8153ff0 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6cea00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80c2320 con 0x7fb6c80c5cd0 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6c7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c80aa440 0x7fb6c814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6c7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c80aa440 0x7fb6c814c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40784/0 (socket says 172.21.15.100:40784) 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6c7e00700 1 -- 172.21.15.100:0/1774316219 learned_addr learned my addr 172.21.15.100:0/1774316219 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6cca00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c80aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6c7400700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6c80c5cd0 0x7fb6c80ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6c7e00700 1 -- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6c80c5cd0 msgr2=0x7fb6c80ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6c7e00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6c80c5cd0 0x7fb6c80ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.611+0000 7fb6c7e00700 1 -- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 msgr2=0x7fb6c80aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6c7e00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c80aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6c7e00700 1 -- 172.21.15.100:0/1774316219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b80092a0 con 0x7fb6c80aa440 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6cca00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c80aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6c7e00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c80aa440 0x7fb6c814c9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb6b8006dd0 tx=0x7fb6b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6bf400700 1 -- 172.21.15.100:0/1774316219 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800f7e0 con 0x7fb6c80aa440 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6bf400700 1 -- 172.21.15.100:0/1774316219 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b800f940 con 0x7fb6c80aa440 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c80b0950 con 0x7fb6c80aa440 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6bf400700 1 -- 172.21.15.100:0/1774316219 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b801b690 con 0x7fb6c80aa440 2024-01-22T05:37:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.612+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c80c1fb0 con 0x7fb6c80aa440 2024-01-22T05:37:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.613+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c80c1e10 con 0x7fb6c80aa440 2024-01-22T05:37:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.614+0000 7fb6bf400700 1 -- 172.21.15.100:0/1774316219 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb6b801ba80 con 0x7fb6c80aa440 2024-01-22T05:37:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.615+0000 7fb6bf400700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb6a005f150 0x7fb6a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.615+0000 7fb6bf400700 1 -- 172.21.15.100:0/1774316219 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb6b807b560 con 0x7fb6c80aa440 2024-01-22T05:37:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.615+0000 7fb6c7400700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb6a005f150 0x7fb6a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.615+0000 7fb6c7400700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb6a005f150 0x7fb6a0061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6c80ac230 tx=0x7fb6b0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.619+0000 7fb6bf400700 1 -- 172.21.15.100:0/1774316219 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb6c80c1e10 con 0x7fb6c80aa440 2024-01-22T05:37:54.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.827+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6c80c1e10 con 0x7fb6c80aa440 2024-01-22T05:37:54.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.827+0000 7fb6bf400700 1 -- 172.21.15.100:0/1774316219 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7fb6c80c1e10 con 0x7fb6c80aa440 2024-01-22T05:37:54.828 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:37:54.829 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb6a005f150 msgr2=0x7fb6a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb6a005f150 0x7fb6a0061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6c80ac230 tx=0x7fb6b0009040).stop 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c80aa440 msgr2=0x7fb6c814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c80aa440 0x7fb6c814c9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb6b8006dd0 tx=0x7fb6b8017000).stop 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 shutdown_connections 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb6a005f150 0x7fb6a0061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6c8153ff0 0x7fb6c80aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c80aa440 0x7fb6c814c9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 --2- 172.21.15.100:0/1774316219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb6c80c5cd0 0x7fb6c80ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 >> 172.21.15.100:0/1774316219 conn(0x7fb6c80c82a0 msgr2=0x7fb6c80ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.829+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 shutdown_connections 2024-01-22T05:37:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:54.830+0000 7fb6cea00700 1 -- 172.21.15.100:0/1774316219 wait complete. 2024-01-22T05:37:54.832 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-01-22T05:37:54.848 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:37:55.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.031+0000 7f105f200700 1 Processor -- start 2024-01-22T05:37:55.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.031+0000 7f105f200700 1 -- start start 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.032+0000 7f105f200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1058153ff0 0x7f10581543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.032+0000 7f105f200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f10580c5cd0 0x7f10580c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.032+0000 7f105f200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f10580a9d30 0x7f10580aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.032+0000 7f105f200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580aa6d0 con 0x7f10580a9d30 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.032+0000 7f105f200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580c66e0 con 0x7f10580c5cd0 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.032+0000 7f105f200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10580c0750 con 0x7f1058153ff0 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.032+0000 7f105d200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f10580a9d30 0x7f10580aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f10580a9d30 0x7f10580aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40796/0 (socket says 172.21.15.100:40796) 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 -- 172.21.15.100:0/953415255 learned_addr learned my addr 172.21.15.100:0/953415255 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f1057e00700 1 --2- 172.21.15.100:0/953415255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1058153ff0 0x7f10581543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f1057400700 1 --2- 172.21.15.100:0/953415255 >> v2:172.21.15.169:3300/0 conn(0x7f10580c5cd0 0x7f10580c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 -- 172.21.15.100:0/953415255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1058153ff0 msgr2=0x7f10581543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 --2- 172.21.15.100:0/953415255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1058153ff0 0x7f10581543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 -- 172.21.15.100:0/953415255 >> v2:172.21.15.169:3300/0 conn(0x7f10580c5cd0 msgr2=0x7f10580c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 --2- 172.21.15.100:0/953415255 >> v2:172.21.15.169:3300/0 conn(0x7f10580c5cd0 0x7f10580c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 -- 172.21.15.100:0/953415255 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10580bfe20 con 0x7f10580a9d30 2024-01-22T05:37:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f105d200700 1 --2- 172.21.15.100:0/953415255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10580a9d30 0x7f10580aa1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f105806c280 tx=0x7f1050009840).ready entity=mon.0 client_cookie=df4d58592094cbea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f1056a00700 1 -- 172.21.15.100:0/953415255 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000e070 con 0x7f10580a9d30 2024-01-22T05:37:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f1056a00700 1 -- 172.21.15.100:0/953415255 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105000b970 con 0x7f10580a9d30 2024-01-22T05:37:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.033+0000 7f1056a00700 1 -- 172.21.15.100:0/953415255 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000bcf0 con 0x7f10580a9d30 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 -- 172.21.15.100:0/953415255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10580a9d30 msgr2=0x7f10580aa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 --2- 172.21.15.100:0/953415255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10580a9d30 0x7f10580aa1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f105806c280 tx=0x7f1050009840).stop 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 -- 172.21.15.100:0/953415255 shutdown_connections 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 --2- 172.21.15.100:0/953415255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10580a9d30 0x7f10580aa1e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 --2- 172.21.15.100:0/953415255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1058153ff0 0x7f10581543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 --2- 172.21.15.100:0/953415255 >> v2:172.21.15.169:3300/0 conn(0x7f10580c5cd0 0x7f10580c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 -- 172.21.15.100:0/953415255 >> 172.21.15.100:0/953415255 conn(0x7f10580c82a0 msgr2=0x7f105805e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 -- 172.21.15.100:0/953415255 shutdown_connections 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.034+0000 7f105f200700 1 -- 172.21.15.100:0/953415255 wait complete. 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.035+0000 7f105f200700 1 Processor -- start 2024-01-22T05:37:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.036+0000 7f105f200700 1 -- start start 2024-01-22T05:37:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.036+0000 7f105f200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10580a9d30 0x7f105814c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.036+0000 7f105f200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10580c5cd0 0x7f1058152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.036+0000 7f105f200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058153ff0 0x7f10580c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.036+0000 7f105f200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10580c1f60 con 0x7f1058153ff0 2024-01-22T05:37:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.036+0000 7f105f200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10580c9bd0 con 0x7f10580a9d30 2024-01-22T05:37:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.036+0000 7f105f200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10580c9eb0 con 0x7f10580c5cd0 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058153ff0 0x7f10580c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058153ff0 0x7f10580c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40798/0 (socket says 172.21.15.100:40798) 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 -- 172.21.15.100:0/1114622662 learned_addr learned my addr 172.21.15.100:0/1114622662 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f1057e00700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10580a9d30 0x7f105814c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f1057400700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10580c5cd0 0x7f1058152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 -- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10580c5cd0 msgr2=0x7f1058152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10580c5cd0 0x7f1058152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 -- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10580a9d30 msgr2=0x7f105814c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10580a9d30 0x7f105814c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 -- 172.21.15.100:0/1114622662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050009ae0 con 0x7f1058153ff0 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f105d200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058153ff0 0x7f10580c31c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f105000b610 tx=0x7f1050009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.037+0000 7f104f400700 1 -- 172.21.15.100:0/1114622662 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000bee0 con 0x7f1058153ff0 2024-01-22T05:37:55.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.038+0000 7f104f400700 1 -- 172.21.15.100:0/1114622662 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105000bcf0 con 0x7f1058153ff0 2024-01-22T05:37:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.038+0000 7f104f400700 1 -- 172.21.15.100:0/1114622662 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105001d6b0 con 0x7f1058153ff0 2024-01-22T05:37:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.038+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10580ca190 con 0x7f1058153ff0 2024-01-22T05:37:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.038+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10580c9880 con 0x7f1058153ff0 2024-01-22T05:37:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.039+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10580c20d0 con 0x7f1058153ff0 2024-01-22T05:37:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.039+0000 7f104f400700 1 -- 172.21.15.100:0/1114622662 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1050003040 con 0x7f1058153ff0 2024-01-22T05:37:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.040+0000 7f104f400700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f103005f150 0x7f1030061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.040+0000 7f104f400700 1 -- 172.21.15.100:0/1114622662 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f105007aff0 con 0x7f1058153ff0 2024-01-22T05:37:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.040+0000 7f1057e00700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f103005f150 0x7f1030061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.041+0000 7f1057e00700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f103005f150 0x7f1030061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f10580ad3f0 tx=0x7f1048009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.045+0000 7f104f400700 1 -- 172.21.15.100:0/1114622662 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f10500a9b00 con 0x7f1058153ff0 2024-01-22T05:37:55.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.217+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f105806a030 con 0x7f1058153ff0 2024-01-22T05:37:55.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.218+0000 7f104f400700 1 -- 172.21.15.100:0/1114622662 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13757 (secure 0 0 0) 0x7f1050022030 con 0x7f1058153ff0 2024-01-22T05:37:55.221 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:37:55.221 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:54.204723+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:37:55.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f103005f150 msgr2=0x7f1030061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f103005f150 0x7f1030061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f10580ad3f0 tx=0x7f1048009060).stop 2024-01-22T05:37:55.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058153ff0 msgr2=0x7f10580c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058153ff0 0x7f10580c31c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f105000b610 tx=0x7f1050009840).stop 2024-01-22T05:37:55.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 shutdown_connections 2024-01-22T05:37:55.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f103005f150 0x7f1030061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10580a9d30 0x7f105814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058153ff0 0x7f10580c31c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 --2- 172.21.15.100:0/1114622662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10580c5cd0 0x7f1058152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.220+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 >> 172.21.15.100:0/1114622662 conn(0x7f10580c82a0 msgr2=0x7f10580c0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:55.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.221+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 shutdown_connections 2024-01-22T05:37:55.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.221+0000 7f105f200700 1 -- 172.21.15.100:0/1114622662 wait complete. 2024-01-22T05:37:55.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:37:55.241 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:37:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.427+0000 7f8c34800700 1 Processor -- start 2024-01-22T05:37:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.428+0000 7f8c34800700 1 -- start start 2024-01-22T05:37:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c34800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c157d80 0x7f8c2c158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c34800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8c2c1586f0 0x7f8c2c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c34800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0c1a40 con 0x7f8c2c154260 2024-01-22T05:37:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c34800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c0cbd30 con 0x7f8c2c1586f0 2024-01-22T05:37:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c34800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c158b80 con 0x7f8c2c157d80 2024-01-22T05:37:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c31400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c157d80 0x7f8c2c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c32800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8c2c1586f0 0x7f8c2c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c31400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c157d80 0x7f8c2c158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:54758/0 (socket says 172.21.15.100:54758) 2024-01-22T05:37:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.429+0000 7f8c31400700 1 -- 172.21.15.100:0/3367966906 learned_addr learned my addr 172.21.15.100:0/3367966906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c32800700 1 -- 172.21.15.100:0/3367966906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c157d80 msgr2=0x7f8c2c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c32800700 1 --2- 172.21.15.100:0/3367966906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c157d80 0x7f8c2c158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c32800700 1 -- 172.21.15.100:0/3367966906 >> v1:172.21.15.169:6789/0 conn(0x7f8c2c154260 legacy=0x7f8c2c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c32800700 1 -- 172.21.15.100:0/3367966906 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0c1110 con 0x7f8c2c1586f0 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c32800700 1 --2- 172.21.15.100:0/3367966906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 0x7f8c2c0c8c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8c24009e90 tx=0x7f8c24009780).ready entity=mon.1 client_cookie=d292a228676101b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c30a00700 1 -- 172.21.15.100:0/3367966906 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400e070 con 0x7f8c2c1586f0 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c30a00700 1 -- 172.21.15.100:0/3367966906 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2400bb20 con 0x7f8c2c1586f0 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.430+0000 7f8c30a00700 1 -- 172.21.15.100:0/3367966906 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400bea0 con 0x7f8c2c1586f0 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 -- 172.21.15.100:0/3367966906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 msgr2=0x7f8c2c0c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 --2- 172.21.15.100:0/3367966906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 0x7f8c2c0c8c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8c24009e90 tx=0x7f8c24009780).stop 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 -- 172.21.15.100:0/3367966906 shutdown_connections 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 --2- 172.21.15.100:0/3367966906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 0x7f8c2c0c8c00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 --2- 172.21.15.100:0/3367966906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c157d80 0x7f8c2c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 -- 172.21.15.100:0/3367966906 >> 172.21.15.100:0/3367966906 conn(0x7f8c2c05e9d0 msgr2=0x7f8c2c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 -- 172.21.15.100:0/3367966906 shutdown_connections 2024-01-22T05:37:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.431+0000 7f8c34800700 1 -- 172.21.15.100:0/3367966906 wait complete. 2024-01-22T05:37:55.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.432+0000 7f8c34800700 1 Processor -- start 2024-01-22T05:37:55.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.432+0000 7f8c34800700 1 -- start start 2024-01-22T05:37:55.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.433+0000 7f8c34800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c154260 0x7f8c2c0c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.433+0000 7f8c34800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c2c157d80 0x7f8c2c14b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.433+0000 7f8c34800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 0x7f8c2c0a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.433+0000 7f8c34800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0aec10 con 0x7f8c2c157d80 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.433+0000 7f8c34800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0add60 con 0x7f8c2c1586f0 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.433+0000 7f8c34800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0ae000 con 0x7f8c2c154260 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c2c157d80 0x7f8c2c14b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c2c157d80 0x7f8c2c14b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40810/0 (socket says 172.21.15.100:40810) 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 -- 172.21.15.100:0/3948536619 learned_addr learned my addr 172.21.15.100:0/3948536619 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c32800700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 0x7f8c2c0a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31e00700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c154260 0x7f8c2c0c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 -- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c154260 msgr2=0x7f8c2c0c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c154260 0x7f8c2c0c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 -- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 msgr2=0x7f8c2c0a8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 0x7f8c2c0a8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 -- 172.21.15.100:0/3948536619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24009a20 con 0x7f8c2c157d80 2024-01-22T05:37:55.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c31400700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c2c157d80 0x7f8c2c14b7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8c1400e900 tx=0x7f8c140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c29600700 1 -- 172.21.15.100:0/3948536619 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14012600 con 0x7f8c2c157d80 2024-01-22T05:37:55.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c29600700 1 -- 172.21.15.100:0/3948536619 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c14012760 con 0x7f8c2c157d80 2024-01-22T05:37:55.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.434+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0ae2e0 con 0x7f8c2c157d80 2024-01-22T05:37:55.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.435+0000 7f8c29600700 1 -- 172.21.15.100:0/3948536619 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14012ae0 con 0x7f8c2c157d80 2024-01-22T05:37:55.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.435+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0ae8a0 con 0x7f8c2c157d80 2024-01-22T05:37:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.436+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c05fdb0 con 0x7f8c2c157d80 2024-01-22T05:37:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.436+0000 7f8c29600700 1 -- 172.21.15.100:0/3948536619 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8c1401b400 con 0x7f8c2c157d80 2024-01-22T05:37:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.437+0000 7f8c29600700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c0405f120 0x7f8c040615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.437+0000 7f8c29600700 1 -- 172.21.15.100:0/3948536619 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8c1407a250 con 0x7f8c2c157d80 2024-01-22T05:37:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.437+0000 7f8c31e00700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c0405f120 0x7f8c040615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.438+0000 7f8c31e00700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c0405f120 0x7f8c040615e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8c1c007fd0 tx=0x7f8c1c007d90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.441+0000 7f8c29600700 1 -- 172.21.15.100:0/3948536619 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8c1404b810 con 0x7f8c2c157d80 2024-01-22T05:37:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.610+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8c2c0c13f0 con 0x7f8c2c157d80 2024-01-22T05:37:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.610+0000 7f8c29600700 1 -- 172.21.15.100:0/3948536619 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8c1404ee30 con 0x7f8c2c157d80 2024-01-22T05:37:55.611 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:37:55.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.612+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c0405f120 msgr2=0x7f8c040615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.612+0000 7f8c34800700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c0405f120 0x7f8c040615e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8c1c007fd0 tx=0x7f8c1c007d90).stop 2024-01-22T05:37:55.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c2c157d80 msgr2=0x7f8c2c14b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c2c157d80 0x7f8c2c14b7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8c1400e900 tx=0x7f8c140090f0).stop 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 shutdown_connections 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c0405f120 0x7f8c040615e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c1586f0 0x7f8c2c0a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c154260 0x7f8c2c0c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 --2- 172.21.15.100:0/3948536619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c2c157d80 0x7f8c2c14b7d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 >> 172.21.15.100:0/3948536619 conn(0x7f8c2c05e9d0 msgr2=0x7f8c2c0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 shutdown_connections 2024-01-22T05:37:55.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.613+0000 7f8c34800700 1 -- 172.21.15.100:0/3948536619 wait complete. 2024-01-22T05:37:55.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:37:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.815+0000 7f4de1e00700 1 Processor -- start 2024-01-22T05:37:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.816+0000 7f4de1e00700 1 -- start start 2024-01-22T05:37:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4de1e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ddc154260 0x7f4ddc0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4de1e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c6810 0x7f4ddc0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4de1e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0c1a40 con 0x7f4ddc0c5c80 2024-01-22T05:37:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4de1e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0cbd30 con 0x7f4ddc154260 2024-01-22T05:37:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4de1e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c1110 con 0x7f4ddc0c6810 2024-01-22T05:37:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4ddaa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ddc154260 0x7f4ddc0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4dda000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4ddc0c5c80 0x7f4ddc0c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59288/0 (socket says 172.21.15.100:59288) 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4dda000700 1 -- 172.21.15.100:0/3515266655 learned_addr learned my addr 172.21.15.100:0/3515266655 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4ddb400700 1 --2- 172.21.15.100:0/3515266655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c6810 0x7f4ddc0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.817+0000 7f4dd9600700 1 -- 172.21.15.100:0/3515266655 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347017785 0 0) 0x7f4ddc0c1a40 con 0x7f4ddc0c5c80 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4dd9600700 1 -- 172.21.15.100:0/3515266655 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dbc0033f0 con 0x7f4ddc0c5c80 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4ddaa00700 1 -- 172.21.15.100:0/3515266655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c6810 msgr2=0x7f4ddc0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4ddaa00700 1 --2- 172.21.15.100:0/3515266655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c6810 0x7f4ddc0c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4ddaa00700 1 -- 172.21.15.100:0/3515266655 >> v1:172.21.15.100:6789/0 conn(0x7f4ddc0c5c80 legacy=0x7f4ddc0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4ddaa00700 1 -- 172.21.15.100:0/3515266655 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0c13f0 con 0x7f4ddc154260 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4ddaa00700 1 --2- 172.21.15.100:0/3515266655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc154260 0x7f4ddc0cb4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4dcc009750 tx=0x7f4dcc009060).ready entity=mon.0 client_cookie=33703c3fcd46e290 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4dd9600700 1 -- 172.21.15.100:0/3515266655 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00d4a0 con 0x7f4ddc154260 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4dd9600700 1 -- 172.21.15.100:0/3515266655 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00d600 con 0x7f4ddc154260 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.818+0000 7f4dd9600700 1 -- 172.21.15.100:0/3515266655 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00d980 con 0x7f4ddc154260 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 -- 172.21.15.100:0/3515266655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc154260 msgr2=0x7f4ddc0cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 --2- 172.21.15.100:0/3515266655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc154260 0x7f4ddc0cb4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4dcc009750 tx=0x7f4dcc009060).stop 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 -- 172.21.15.100:0/3515266655 shutdown_connections 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 --2- 172.21.15.100:0/3515266655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc154260 0x7f4ddc0cb4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 --2- 172.21.15.100:0/3515266655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c6810 0x7f4ddc0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 -- 172.21.15.100:0/3515266655 >> 172.21.15.100:0/3515266655 conn(0x7f4ddc05e9d0 msgr2=0x7f4ddc0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 -- 172.21.15.100:0/3515266655 shutdown_connections 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.819+0000 7f4de1e00700 1 -- 172.21.15.100:0/3515266655 wait complete. 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.820+0000 7f4de1e00700 1 Processor -- start 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.820+0000 7f4de1e00700 1 -- start start 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4de1e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c5c80 0x7f4ddc1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4de1e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc0c6810 0x7f4ddc152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4de1e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ddc154260 0x7f4ddc064150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4de1e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0aad90 con 0x7f4ddc0c6810 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4de1e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0ab070 con 0x7f4ddc154260 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4de1e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0ab350 con 0x7f4ddc0c5c80 2024-01-22T05:37:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4dda000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc0c6810 0x7f4ddc152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4dda000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc0c6810 0x7f4ddc152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40824/0 (socket says 172.21.15.100:40824) 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.821+0000 7f4dda000700 1 -- 172.21.15.100:0/302952318 learned_addr learned my addr 172.21.15.100:0/302952318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4ddaa00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c5c80 0x7f4ddc1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4ddb400700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ddc154260 0x7f4ddc064150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dda000700 1 -- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c5c80 msgr2=0x7f4ddc1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dda000700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c5c80 0x7f4ddc1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dda000700 1 -- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ddc154260 msgr2=0x7f4ddc064150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dda000700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ddc154260 0x7f4ddc064150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dda000700 1 -- 172.21.15.100:0/302952318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc009240 con 0x7f4ddc0c6810 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4ddaa00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c5c80 0x7f4ddc1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4ddb400700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ddc154260 0x7f4ddc064150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dda000700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc0c6810 0x7f4ddc152a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4dc4001ed0 tx=0x7f4dc4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dd2000700 1 -- 172.21.15.100:0/302952318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40072e0 con 0x7f4ddc0c6810 2024-01-22T05:37:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dd2000700 1 -- 172.21.15.100:0/302952318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4007440 con 0x7f4ddc0c6810 2024-01-22T05:37:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc0ab630 con 0x7f4ddc0c6810 2024-01-22T05:37:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4dd2000700 1 -- 172.21.15.100:0/302952318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40057a0 con 0x7f4ddc0c6810 2024-01-22T05:37:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.822+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc0abe30 con 0x7f4ddc0c6810 2024-01-22T05:37:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.823+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc0abb50 con 0x7f4ddc0c6810 2024-01-22T05:37:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.824+0000 7f4dd2000700 1 -- 172.21.15.100:0/302952318 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4dc4005b50 con 0x7f4ddc0c6810 2024-01-22T05:37:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.825+0000 7f4dd2000700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4db405f150 0x7f4db4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.825+0000 7f4dd2000700 1 -- 172.21.15.100:0/302952318 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4dc40796e0 con 0x7f4ddc0c6810 2024-01-22T05:37:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.825+0000 7f4ddaa00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4db405f150 0x7f4db4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.825+0000 7f4ddaa00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4db405f150 0x7f4db4061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4dcc009fd0 tx=0x7f4dcc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:55.829+0000 7f4dd2000700 1 -- 172.21.15.100:0/302952318 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4ddc0abb50 con 0x7f4ddc0c6810 2024-01-22T05:37:56.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.004+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ddc0abb50 con 0x7f4ddc0c6810 2024-01-22T05:37:56.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.004+0000 7f4dd2000700 1 -- 172.21.15.100:0/302952318 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ddc0abb50 con 0x7f4ddc0c6810 2024-01-22T05:37:56.004 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:37:56.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4db405f150 msgr2=0x7f4db4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4db405f150 0x7f4db4061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4dcc009fd0 tx=0x7f4dcc016000).stop 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc0c6810 msgr2=0x7f4ddc152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc0c6810 0x7f4ddc152a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4dc4001ed0 tx=0x7f4dc4007c70).stop 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 shutdown_connections 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4db405f150 0x7f4db4061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ddc154260 0x7f4ddc064150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ddc0c5c80 0x7f4ddc1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 --2- 172.21.15.100:0/302952318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ddc0c6810 0x7f4ddc152a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.006+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 >> 172.21.15.100:0/302952318 conn(0x7f4ddc05e9d0 msgr2=0x7f4ddc0631e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.007+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 shutdown_connections 2024-01-22T05:37:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.007+0000 7f4de1e00700 1 -- 172.21.15.100:0/302952318 wait complete. 2024-01-22T05:37:56.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:37:56.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.208+0000 7f339fc00700 1 Processor -- start 2024-01-22T05:37:56.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.208+0000 7f339fc00700 1 -- start start 2024-01-22T05:37:56.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.209+0000 7f339fc00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3398153ee0 0x7f33980c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.209+0000 7f339fc00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33981542c0 0x7f33980c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.209+0000 7f339fc00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980928b0 con 0x7f33980be2d0 2024-01-22T05:37:56.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.209+0000 7f339fc00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980c4870 con 0x7f33981542c0 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.209+0000 7f339fc00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980bef90 con 0x7f3398153ee0 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33981542c0 0x7f33980c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33981542c0 0x7f33980c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40840/0 (socket says 172.21.15.100:40840) 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 -- 172.21.15.100:0/110615448 learned_addr learned my addr 172.21.15.100:0/110615448 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f339d200700 1 --2- 172.21.15.100:0/110615448 >> v2:172.21.15.169:3300/0 conn(0x7f3398153ee0 0x7f33980c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 -- 172.21.15.100:0/110615448 >> v2:172.21.15.169:3300/0 conn(0x7f3398153ee0 msgr2=0x7f33980c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 --2- 172.21.15.100:0/110615448 >> v2:172.21.15.169:3300/0 conn(0x7f3398153ee0 0x7f33980c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 -- 172.21.15.100:0/110615448 >> v1:172.21.15.169:6789/0 conn(0x7f33980be2d0 legacy=0x7f33980be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 -- 172.21.15.100:0/110615448 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980bfba0 con 0x7f33981542c0 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.210+0000 7f3397e00700 1 --2- 172.21.15.100:0/110615448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33981542c0 0x7f33980c4380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3398063410 tx=0x7f33800090f0).ready entity=mon.0 client_cookie=33689821e21617dc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.211+0000 7f3397400700 1 -- 172.21.15.100:0/110615448 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000b520 con 0x7f33981542c0 2024-01-22T05:37:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.211+0000 7f3397400700 1 -- 172.21.15.100:0/110615448 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000b680 con 0x7f33981542c0 2024-01-22T05:37:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.211+0000 7f3397400700 1 -- 172.21.15.100:0/110615448 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000ba00 con 0x7f33981542c0 2024-01-22T05:37:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 -- 172.21.15.100:0/110615448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33981542c0 msgr2=0x7f33980c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 --2- 172.21.15.100:0/110615448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33981542c0 0x7f33980c4380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3398063410 tx=0x7f33800090f0).stop 2024-01-22T05:37:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 -- 172.21.15.100:0/110615448 shutdown_connections 2024-01-22T05:37:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 --2- 172.21.15.100:0/110615448 >> v2:172.21.15.169:3300/0 conn(0x7f3398153ee0 0x7f33980c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 --2- 172.21.15.100:0/110615448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33981542c0 0x7f33980c4380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 -- 172.21.15.100:0/110615448 >> 172.21.15.100:0/110615448 conn(0x7f3398091a00 msgr2=0x7f3398091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 -- 172.21.15.100:0/110615448 shutdown_connections 2024-01-22T05:37:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.212+0000 7f339fc00700 1 -- 172.21.15.100:0/110615448 wait complete. 2024-01-22T05:37:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.214+0000 7f339fc00700 1 Processor -- start 2024-01-22T05:37:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.214+0000 7f339fc00700 1 -- start start 2024-01-22T05:37:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339fc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33980be2d0 0x7f33980c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339fc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3398153ee0 0x7f33980c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339fc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33981542c0 0x7f33980c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339fc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c7600 con 0x7f33980be2d0 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339fc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980ac890 con 0x7f33981542c0 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339fc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980bfd30 con 0x7f3398153ee0 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339d200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33980be2d0 0x7f33980c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339d200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33980be2d0 0x7f33980c25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40846/0 (socket says 172.21.15.100:40846) 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339d200700 1 -- 172.21.15.100:0/961560153 learned_addr learned my addr 172.21.15.100:0/961560153 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.215+0000 7f339dc00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33981542c0 0x7f33980c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f3397e00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3398153ee0 0x7f33980c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339d200700 1 -- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3398153ee0 msgr2=0x7f33980c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339d200700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3398153ee0 0x7f33980c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339d200700 1 -- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33981542c0 msgr2=0x7f33980c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339d200700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33981542c0 0x7f33980c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339d200700 1 -- 172.21.15.100:0/961560153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380009370 con 0x7f33980be2d0 2024-01-22T05:37:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f3397e00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3398153ee0 0x7f33980c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:37:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339d200700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33980be2d0 0x7f33980c25d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f338800e8d0 tx=0x7f3388006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f338fe00700 1 -- 172.21.15.100:0/961560153 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800c640 con 0x7f33980be2d0 2024-01-22T05:37:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f338fe00700 1 -- 172.21.15.100:0/961560153 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800c7a0 con 0x7f33980be2d0 2024-01-22T05:37:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33980acb30 con 0x7f33980be2d0 2024-01-22T05:37:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f338fe00700 1 -- 172.21.15.100:0/961560153 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800cb20 con 0x7f33980be2d0 2024-01-22T05:37:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.216+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33980ad0f0 con 0x7f33980be2d0 2024-01-22T05:37:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.217+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33980ad740 con 0x7f33980be2d0 2024-01-22T05:37:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.218+0000 7f338fe00700 1 -- 172.21.15.100:0/961560153 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f338801b400 con 0x7f33980be2d0 2024-01-22T05:37:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.219+0000 7f338fe00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f337005f120 0x7f33700615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.219+0000 7f338fe00700 1 -- 172.21.15.100:0/961560153 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f338807a3f0 con 0x7f33980be2d0 2024-01-22T05:37:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.219+0000 7f3397e00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f337005f120 0x7f33700615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.219+0000 7f3397e00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f337005f120 0x7f33700615e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f33980ab8f0 tx=0x7f3380017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.223+0000 7f338fe00700 1 -- 172.21.15.100:0/961560153 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f338804b8f0 con 0x7f33980be2d0 2024-01-22T05:37:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.396+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f339805fdb0 con 0x7f33980be2d0 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.397+0000 7f338fe00700 1 -- 172.21.15.100:0/961560153 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f338804ef10 con 0x7f33980be2d0 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "device_health_metrics" 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 2, 2024-01-22T05:37:56.397 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "rbd" 2024-01-22T05:37:56.398 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:37:56.398 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f337005f120 msgr2=0x7f33700615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f337005f120 0x7f33700615e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f33980ab8f0 tx=0x7f3380017000).stop 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33980be2d0 msgr2=0x7f33980c25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33980be2d0 0x7f33980c25d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f338800e8d0 tx=0x7f3388006f40).stop 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 shutdown_connections 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f337005f120 0x7f33700615e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33981542c0 0x7f33980c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33980be2d0 0x7f33980c25d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 --2- 172.21.15.100:0/961560153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3398153ee0 0x7f33980c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 >> 172.21.15.100:0/961560153 conn(0x7f3398091a00 msgr2=0x7f3398065140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:56.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 shutdown_connections 2024-01-22T05:37:56.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.399+0000 7f339fc00700 1 -- 172.21.15.100:0/961560153 wait complete. 2024-01-22T05:37:56.416 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:37:56.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:37:56.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:37:56.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:37:56.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.605+0000 7f2b19800700 1 Processor -- start 2024-01-22T05:37:56.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.605+0000 7f2b19800700 1 -- start start 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b19800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2b14154260 0x7f2b140cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b19800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c6810 0x7f2b140c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b19800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b140c1a40 con 0x7f2b140c5c80 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b19800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b140cbd30 con 0x7f2b14154260 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b19800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c1110 con 0x7f2b140c6810 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b12a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2b14154260 0x7f2b140cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b12a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2b14154260 0x7f2b140cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40858/0 (socket says 172.21.15.100:40858) 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b12a00700 1 -- 172.21.15.100:0/3701065409 learned_addr learned my addr 172.21.15.100:0/3701065409 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:56.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b13400700 1 --2- 172.21.15.100:0/3701065409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c6810 0x7f2b140c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b12a00700 1 -- 172.21.15.100:0/3701065409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c6810 msgr2=0x7f2b140c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.607+0000 7f2b12a00700 1 --2- 172.21.15.100:0/3701065409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c6810 0x7f2b140c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.608+0000 7f2b12a00700 1 -- 172.21.15.100:0/3701065409 >> v1:172.21.15.169:6789/0 conn(0x7f2b140c5c80 legacy=0x7f2b140c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.608+0000 7f2b12a00700 1 -- 172.21.15.100:0/3701065409 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b140c13f0 con 0x7f2b14154260 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.608+0000 7f2b12a00700 1 --2- 172.21.15.100:0/3701065409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140cb4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2b04006fd0 tx=0x7f2b040090f0).ready entity=mon.0 client_cookie=abfea2fd050551bf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.608+0000 7f2b11600700 1 -- 172.21.15.100:0/3701065409 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400b580 con 0x7f2b14154260 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.608+0000 7f2b11600700 1 -- 172.21.15.100:0/3701065409 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400b6e0 con 0x7f2b14154260 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.608+0000 7f2b11600700 1 -- 172.21.15.100:0/3701065409 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400ba80 con 0x7f2b14154260 2024-01-22T05:37:56.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 -- 172.21.15.100:0/3701065409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 msgr2=0x7f2b140cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 --2- 172.21.15.100:0/3701065409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140cb4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2b04006fd0 tx=0x7f2b040090f0).stop 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 -- 172.21.15.100:0/3701065409 shutdown_connections 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 --2- 172.21.15.100:0/3701065409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140cb4e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 --2- 172.21.15.100:0/3701065409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c6810 0x7f2b140c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 -- 172.21.15.100:0/3701065409 >> 172.21.15.100:0/3701065409 conn(0x7f2b1405e9d0 msgr2=0x7f2b140cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 -- 172.21.15.100:0/3701065409 shutdown_connections 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.609+0000 7f2b19800700 1 -- 172.21.15.100:0/3701065409 wait complete. 2024-01-22T05:37:56.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.611+0000 7f2b19800700 1 Processor -- start 2024-01-22T05:37:56.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.611+0000 7f2b19800700 1 -- start start 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.612+0000 7f2b19800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c5c80 0x7f2b1414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.612+0000 7f2b19800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b140c6810 0x7f2b140c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.612+0000 7f2b19800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.612+0000 7f2b19800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c9af0 con 0x7f2b14154260 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.612+0000 7f2b19800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c3830 con 0x7f2b140c6810 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.612+0000 7f2b19800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1414ce30 con 0x7f2b140c5c80 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b12a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c5c80 0x7f2b1414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b12000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b140c6810 0x7f2b140c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40866/0 (socket says 172.21.15.100:40866) 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b12a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c5c80 0x7f2b1414c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:54822/0 (socket says 172.21.15.100:54822) 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 -- 172.21.15.100:0/3790466614 learned_addr learned my addr 172.21.15.100:0/3790466614 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:56.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 -- 172.21.15.100:0/3790466614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c5c80 msgr2=0x7f2b1414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c5c80 0x7f2b1414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 -- 172.21.15.100:0/3790466614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b140c6810 msgr2=0x7f2b140c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b140c6810 0x7f2b140c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 -- 172.21.15.100:0/3790466614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04009310 con 0x7f2b14154260 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.613+0000 7f2b13400700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140c9600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2b0c009ef0 tx=0x7f2b0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.614+0000 7f2b0a000700 1 -- 172.21.15.100:0/3790466614 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00cb70 con 0x7f2b14154260 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.614+0000 7f2b0a000700 1 -- 172.21.15.100:0/3790466614 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00f040 con 0x7f2b14154260 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.614+0000 7f2b0a000700 1 -- 172.21.15.100:0/3790466614 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c013400 con 0x7f2b14154260 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.614+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b140c2c20 con 0x7f2b14154260 2024-01-22T05:37:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.614+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b140c31e0 con 0x7f2b14154260 2024-01-22T05:37:56.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.615+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b140c39c0 con 0x7f2b14154260 2024-01-22T05:37:56.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.615+0000 7f2b0a000700 1 -- 172.21.15.100:0/3790466614 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2b0c013770 con 0x7f2b14154260 2024-01-22T05:37:56.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.616+0000 7f2b0a000700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2aec05f150 0x7f2aec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:56.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.616+0000 7f2b0a000700 1 -- 172.21.15.100:0/3790466614 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2b0c07a730 con 0x7f2b14154260 2024-01-22T05:37:56.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.617+0000 7f2b12a00700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2aec05f150 0x7f2aec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:56.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.617+0000 7f2b12a00700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2aec05f150 0x7f2aec061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2b04009130 tx=0x7f2b04017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:56.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.621+0000 7f2b0a000700 1 -- 172.21.15.100:0/3790466614 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2b0c04bc90 con 0x7f2b14154260 2024-01-22T05:37:56.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:56.795+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f2b140c16d0 con 0x7f2b14154260 2024-01-22T05:37:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.220+0000 7f2b0a000700 1 -- 172.21.15.100:0/3790466614 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f2b0c04f2b0 con 0x7f2b14154260 2024-01-22T05:37:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2aec05f150 msgr2=0x7f2aec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2aec05f150 0x7f2aec061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2b04009130 tx=0x7f2b04017000).stop 2024-01-22T05:37:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 msgr2=0x7f2b140c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140c9600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2b0c009ef0 tx=0x7f2b0c00b040).stop 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 shutdown_connections 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2aec05f150 0x7f2aec061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b14154260 0x7f2b140c9600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b140c5c80 0x7f2b1414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 --2- 172.21.15.100:0/3790466614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b140c6810 0x7f2b140c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.224+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 >> 172.21.15.100:0/3790466614 conn(0x7f2b1405e9d0 msgr2=0x7f2b140c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.225+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 shutdown_connections 2024-01-22T05:37:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.225+0000 7f2b19800700 1 -- 172.21.15.100:0/3790466614 wait complete. 2024-01-22T05:37:57.230 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-01-22T05:37:57.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:37:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.439+0000 7f2f71a00700 1 Processor -- start 2024-01-22T05:37:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.439+0000 7f2f71a00700 1 -- start start 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f71a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f6c157290 0x7f2f6c092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f71a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2f6c092600 0x7f2f6c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f71a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157670 0x7f2f6c0c5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f71a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c5e50 con 0x7f2f6c157290 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f71a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c065000 con 0x7f2f6c092600 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f71a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0643f0 con 0x7f2f6c157670 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f6aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f6c157290 0x7f2f6c092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f6aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f6c157290 0x7f2f6c092110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40878/0 (socket says 172.21.15.100:40878) 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.440+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1175116955 learned_addr learned my addr 172.21.15.100:0/1175116955 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:57.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6b400700 1 --2- 172.21.15.100:0/1175116955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157670 0x7f2f6c0c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6a000700 1 --2- 172.21.15.100:0/1175116955 >> v2:172.21.15.169:3300/0 conn(0x7f2f6c092600 0x7f2f6c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1175116955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157670 msgr2=0x7f2f6c0c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6aa00700 1 --2- 172.21.15.100:0/1175116955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157670 0x7f2f6c0c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1175116955 >> v2:172.21.15.169:3300/0 conn(0x7f2f6c092600 msgr2=0x7f2f6c0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6aa00700 1 --2- 172.21.15.100:0/1175116955 >> v2:172.21.15.169:3300/0 conn(0x7f2f6c092600 0x7f2f6c0c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1175116955 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0646d0 con 0x7f2f6c157290 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f6aa00700 1 --2- 172.21.15.100:0/1175116955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c157290 0x7f2f6c092110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2f6c0c6750 tx=0x7f2f5c0090f0).ready entity=mon.0 client_cookie=4fded9419f98a9f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f69600700 1 -- 172.21.15.100:0/1175116955 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00b600 con 0x7f2f6c157290 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f69600700 1 -- 172.21.15.100:0/1175116955 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c00b760 con 0x7f2f6c157290 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.441+0000 7f2f69600700 1 -- 172.21.15.100:0/1175116955 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00bae0 con 0x7f2f6c157290 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 -- 172.21.15.100:0/1175116955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c157290 msgr2=0x7f2f6c092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1175116955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c157290 0x7f2f6c092110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2f6c0c6750 tx=0x7f2f5c0090f0).stop 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 -- 172.21.15.100:0/1175116955 shutdown_connections 2024-01-22T05:37:57.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1175116955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157670 0x7f2f6c0c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1175116955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c157290 0x7f2f6c092110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1175116955 >> v2:172.21.15.169:3300/0 conn(0x7f2f6c092600 0x7f2f6c0c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 -- 172.21.15.100:0/1175116955 >> 172.21.15.100:0/1175116955 conn(0x7f2f6c05e9d0 msgr2=0x7f2f6c091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:57.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 -- 172.21.15.100:0/1175116955 shutdown_connections 2024-01-22T05:37:57.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.442+0000 7f2f71a00700 1 -- 172.21.15.100:0/1175116955 wait complete. 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.443+0000 7f2f71a00700 1 Processor -- start 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.444+0000 7f2f71a00700 1 -- start start 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.444+0000 7f2f71a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c092600 0x7f2f6c096470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.444+0000 7f2f71a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157290 0x7f2f6c094640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f71a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c157670 0x7f2f6c0ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f71a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0938f0 con 0x7f2f6c092600 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f71a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c092a00 con 0x7f2f6c157670 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f71a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c092ce0 con 0x7f2f6c157290 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c092600 0x7f2f6c096470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c092600 0x7f2f6c096470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40888/0 (socket says 172.21.15.100:40888) 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1811548787 learned_addr learned my addr 172.21.15.100:0/1811548787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6a000700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157290 0x7f2f6c094640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6b400700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c157670 0x7f2f6c0ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157290 msgr2=0x7f2f6c094640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157290 0x7f2f6c094640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c157670 msgr2=0x7f2f6c0ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c157670 0x7f2f6c0ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 -- 172.21.15.100:0/1811548787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c009370 con 0x7f2f6c092600 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.445+0000 7f2f6aa00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c092600 0x7f2f6c096470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2f5c009130 tx=0x7f2f5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.446+0000 7f2f62000700 1 -- 172.21.15.100:0/1811548787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00bea0 con 0x7f2f6c092600 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.446+0000 7f2f62000700 1 -- 172.21.15.100:0/1811548787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c00b8d0 con 0x7f2f6c092600 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.446+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c092fc0 con 0x7f2f6c092600 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.446+0000 7f2f62000700 1 -- 172.21.15.100:0/1811548787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c01c650 con 0x7f2f6c092600 2024-01-22T05:37:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.446+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c093580 con 0x7f2f6c092600 2024-01-22T05:37:57.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.447+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c05fdb0 con 0x7f2f6c092600 2024-01-22T05:37:57.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.448+0000 7f2f62000700 1 -- 172.21.15.100:0/1811548787 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2f5c01c9c0 con 0x7f2f6c092600 2024-01-22T05:37:57.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.449+0000 7f2f62000700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:57.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.449+0000 7f2f62000700 1 -- 172.21.15.100:0/1811548787 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f2f5c07bc10 con 0x7f2f6c092600 2024-01-22T05:37:57.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.449+0000 7f2f6a000700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:57.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.449+0000 7f2f6a000700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2f6c096260 tx=0x7f2f54008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:57.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.454+0000 7f2f62000700 1 -- 172.21.15.100:0/1811548787 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f5c04d0c0 con 0x7f2f6c092600 2024-01-22T05:37:57.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:57.624+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2f6c093bd0 con 0x7f2f6c092600 2024-01-22T05:37:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.227+0000 7f2f62000700 1 -- 172.21.15.100:0/1811548787 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2f5c02a070 con 0x7f2f6c092600 2024-01-22T05:37:58.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 msgr2=0x7f2f44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2f6c096260 tx=0x7f2f54008040).stop 2024-01-22T05:37:58.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c092600 msgr2=0x7f2f6c096470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c092600 0x7f2f6c096470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2f5c009130 tx=0x7f2f5c017000).stop 2024-01-22T05:37:58.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 shutdown_connections 2024-01-22T05:37:58.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2f4405f150 0x7f2f44061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f6c157670 0x7f2f6c0ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f6c092600 0x7f2f6c096470 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 --2- 172.21.15.100:0/1811548787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f6c157290 0x7f2f6c094640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.232+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 >> 172.21.15.100:0/1811548787 conn(0x7f2f6c05e9d0 msgr2=0x7f2f6c0c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.233+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 shutdown_connections 2024-01-22T05:37:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.233+0000 7f2f71a00700 1 -- 172.21.15.100:0/1811548787 wait complete. 2024-01-22T05:37:58.243 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-01-22T05:37:58.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:37:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.458+0000 7fd51bc00700 1 Processor -- start 2024-01-22T05:37:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.458+0000 7fd51bc00700 1 -- start start 2024-01-22T05:37:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.459+0000 7fd51bc00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd514154260 0x7fd5140cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.459+0000 7fd51bc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5140c5c80 0x7fd5140c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.459+0000 7fd51bc00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5140c1a40 con 0x7fd5140c65f0 2024-01-22T05:37:58.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd51bc00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5140cbd30 con 0x7fd514154260 2024-01-22T05:37:58.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd51bc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140c6a80 con 0x7fd5140c5c80 2024-01-22T05:37:58.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd519200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd514154260 0x7fd5140cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd513e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5140c5c80 0x7fd5140c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd519200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd514154260 0x7fd5140cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:41592/0 (socket says 172.21.15.100:41592) 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd519200700 1 -- 172.21.15.100:0/357953845 learned_addr learned my addr 172.21.15.100:0/357953845 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd519200700 1 -- 172.21.15.100:0/357953845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5140c5c80 msgr2=0x7fd5140c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd519200700 1 --2- 172.21.15.100:0/357953845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5140c5c80 0x7fd5140c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd519200700 1 -- 172.21.15.100:0/357953845 >> v1:172.21.15.169:6789/0 conn(0x7fd5140c65f0 legacy=0x7fd514157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.460+0000 7fd519200700 1 -- 172.21.15.100:0/357953845 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140c1110 con 0x7fd514154260 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd519200700 1 --2- 172.21.15.100:0/357953845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd514154260 0x7fd5140cb4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd504009840 tx=0x7fd504009060).ready entity=mon.1 client_cookie=f10de159c857fb6a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd513400700 1 -- 172.21.15.100:0/357953845 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504005880 con 0x7fd514154260 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd513400700 1 -- 172.21.15.100:0/357953845 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5040059e0 con 0x7fd514154260 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd513400700 1 -- 172.21.15.100:0/357953845 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504005d60 con 0x7fd514154260 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd51bc00700 1 -- 172.21.15.100:0/357953845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd514154260 msgr2=0x7fd5140cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd51bc00700 1 --2- 172.21.15.100:0/357953845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd514154260 0x7fd5140cb4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd504009840 tx=0x7fd504009060).stop 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd51bc00700 1 -- 172.21.15.100:0/357953845 shutdown_connections 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd51bc00700 1 --2- 172.21.15.100:0/357953845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd514154260 0x7fd5140cb4e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd51bc00700 1 --2- 172.21.15.100:0/357953845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5140c5c80 0x7fd5140c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.461+0000 7fd51bc00700 1 -- 172.21.15.100:0/357953845 >> 172.21.15.100:0/357953845 conn(0x7fd51405e9d0 msgr2=0x7fd5140cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:58.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.462+0000 7fd51bc00700 1 -- 172.21.15.100:0/357953845 shutdown_connections 2024-01-22T05:37:58.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.462+0000 7fd51bc00700 1 -- 172.21.15.100:0/357953845 wait complete. 2024-01-22T05:37:58.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.464+0000 7fd51bc00700 1 Processor -- start 2024-01-22T05:37:58.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.464+0000 7fd51bc00700 1 -- start start 2024-01-22T05:37:58.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd51bc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5140c5c80 0x7fd514098290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd51bc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5140c65f0 0x7fd5140b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd51bc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd514154260 0x7fd5140957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd51bc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514098ae0 con 0x7fd5140c5c80 2024-01-22T05:37:58.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd51bc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140adf00 con 0x7fd5140c65f0 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd51bc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140ae1a0 con 0x7fd514154260 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd519200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5140c5c80 0x7fd514098290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd519200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5140c5c80 0x7fd514098290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40892/0 (socket says 172.21.15.100:40892) 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd519200700 1 -- 172.21.15.100:0/1822234482 learned_addr learned my addr 172.21.15.100:0/1822234482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd513e00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5140c65f0 0x7fd5140b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.465+0000 7fd519c00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd514154260 0x7fd5140957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd519200700 1 -- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd514154260 msgr2=0x7fd5140957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd519200700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd514154260 0x7fd5140957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd519200700 1 -- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5140c65f0 msgr2=0x7fd5140b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd519200700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5140c65f0 0x7fd5140b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd519200700 1 -- 172.21.15.100:0/1822234482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504009300 con 0x7fd5140c5c80 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd513e00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5140c65f0 0x7fd5140b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:37:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd519200700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5140c5c80 0x7fd514098290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd50400b340 tx=0x7fd504016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd50be00700 1 -- 172.21.15.100:0/1822234482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50400b580 con 0x7fd5140c5c80 2024-01-22T05:37:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd50be00700 1 -- 172.21.15.100:0/1822234482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50400b700 con 0x7fd5140c5c80 2024-01-22T05:37:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5140ae480 con 0x7fd5140c5c80 2024-01-22T05:37:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.466+0000 7fd50be00700 1 -- 172.21.15.100:0/1822234482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50400bac0 con 0x7fd5140c5c80 2024-01-22T05:37:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.467+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd514098780 con 0x7fd5140c5c80 2024-01-22T05:37:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.468+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5140aead0 con 0x7fd5140c5c80 2024-01-22T05:37:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.468+0000 7fd50be00700 1 -- 172.21.15.100:0/1822234482 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd504026460 con 0x7fd5140c5c80 2024-01-22T05:37:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.469+0000 7fd50be00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd4ec05f120 0x7fd4ec0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.469+0000 7fd50be00700 1 -- 172.21.15.100:0/1822234482 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fd50407b5d0 con 0x7fd5140c5c80 2024-01-22T05:37:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.469+0000 7fd513e00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd4ec05f120 0x7fd4ec0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.470+0000 7fd513e00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd4ec05f120 0x7fd4ec0615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd5140b0110 tx=0x7fd4fc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:58.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.474+0000 7fd50be00700 1 -- 172.21.15.100:0/1822234482 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd50404c8a0 con 0x7fd5140c5c80 2024-01-22T05:37:58.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.682+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5140c13f0 con 0x7fd5140c5c80 2024-01-22T05:37:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.689+0000 7fd50be00700 1 -- 172.21.15.100:0/1822234482 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd50404fec0 con 0x7fd5140c5c80 2024-01-22T05:37:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd4ec05f120 msgr2=0x7fd4ec0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd4ec05f120 0x7fd4ec0615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd5140b0110 tx=0x7fd4fc009060).stop 2024-01-22T05:37:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5140c5c80 msgr2=0x7fd514098290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5140c5c80 0x7fd514098290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd50400b340 tx=0x7fd504016000).stop 2024-01-22T05:37:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 shutdown_connections 2024-01-22T05:37:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd4ec05f120 0x7fd4ec0615e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd514154260 0x7fd5140957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5140c5c80 0x7fd514098290 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 --2- 172.21.15.100:0/1822234482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5140c65f0 0x7fd5140b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.694+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 >> 172.21.15.100:0/1822234482 conn(0x7fd51405e9d0 msgr2=0x7fd514064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.695+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 shutdown_connections 2024-01-22T05:37:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.696+0000 7fd51bc00700 1 -- 172.21.15.100:0/1822234482 wait complete. 2024-01-22T05:37:58.700 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 3 and data pool 4 2024-01-22T05:37:58.735 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:37:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.918+0000 7f3e70c00700 1 Processor -- start 2024-01-22T05:37:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.918+0000 7f3e70c00700 1 -- start start 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e70c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e70c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3e6c0aa3f0 0x7f3e6c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e70c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c0c1530 con 0x7f3e6c154060 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e70c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c0cbb60 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e70c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0cb880 con 0x7f3e6c0c64b0 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e6a800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3e6c0aa3f0 0x7f3e6c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e69e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3e6c154060 0x7f3e6c0c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59298/0 (socket says 172.21.15.100:59298) 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.919+0000 7f3e69e00700 1 -- 172.21.15.100:0/276476121 learned_addr learned my addr 172.21.15.100:0/276476121 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:58.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e69400700 1 --2- 172.21.15.100:0/276476121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e68a00700 1 -- 172.21.15.100:0/276476121 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947611746 0 0) 0x7f3e6c0c1530 con 0x7f3e6c154060 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e68a00700 1 -- 172.21.15.100:0/276476121 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4c0033f0 con 0x7f3e6c154060 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e6a800700 1 -- 172.21.15.100:0/276476121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 msgr2=0x7f3e6c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e6a800700 1 --2- 172.21.15.100:0/276476121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e6a800700 1 -- 172.21.15.100:0/276476121 >> v1:172.21.15.100:6789/0 conn(0x7f3e6c154060 legacy=0x7f3e6c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e6a800700 1 -- 172.21.15.100:0/276476121 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0c17d0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e6a800700 1 --2- 172.21.15.100:0/276476121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c9950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3e64009e60 tx=0x7f3e64009780).ready entity=mon.0 client_cookie=2103ad766cd4aea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e68a00700 1 -- 172.21.15.100:0/276476121 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400e070 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e68a00700 1 -- 172.21.15.100:0/276476121 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6400bab0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.920+0000 7f3e68a00700 1 -- 172.21.15.100:0/276476121 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400be30 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 -- 172.21.15.100:0/276476121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 msgr2=0x7f3e6c0c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 --2- 172.21.15.100:0/276476121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c9950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3e64009e60 tx=0x7f3e64009780).stop 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 -- 172.21.15.100:0/276476121 shutdown_connections 2024-01-22T05:37:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 --2- 172.21.15.100:0/276476121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c9950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 --2- 172.21.15.100:0/276476121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 -- 172.21.15.100:0/276476121 >> 172.21.15.100:0/276476121 conn(0x7f3e6c05e9d0 msgr2=0x7f3e6c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 -- 172.21.15.100:0/276476121 shutdown_connections 2024-01-22T05:37:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.921+0000 7f3e70c00700 1 -- 172.21.15.100:0/276476121 wait complete. 2024-01-22T05:37:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.922+0000 7f3e70c00700 1 Processor -- start 2024-01-22T05:37:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.923+0000 7f3e70c00700 1 -- start start 2024-01-22T05:37:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.923+0000 7f3e70c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.923+0000 7f3e70c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c14f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e70c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e6c154060 0x7f3e6c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e70c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0c2af0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e70c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0c2dd0 con 0x7f3e6c154060 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e70c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0c30b0 con 0x7f3e6c0c64b0 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40910/0 (socket says 172.21.15.100:40910) 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 -- 172.21.15.100:0/4099467866 learned_addr learned my addr 172.21.15.100:0/4099467866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69400700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c14f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e6a800700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e6c154060 0x7f3e6c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 -- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 msgr2=0x7f3e6c14f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c14f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 -- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e6c154060 msgr2=0x7f3e6c0b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e6c154060 0x7f3e6c0b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 -- 172.21.15.100:0/4099467866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009a20 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e6a800700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e6c154060 0x7f3e6c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.924+0000 7f3e69e00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c3b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3e5c00c420 tx=0x7f3e5c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.925+0000 7f3e61600700 1 -- 172.21.15.100:0/4099467866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00ce80 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.925+0000 7f3e61600700 1 -- 172.21.15.100:0/4099467866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c0072e0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.925+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c0c3390 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.925+0000 7f3e61600700 1 -- 172.21.15.100:0/4099467866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c007660 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.925+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c0c4080 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.926+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c05fdb0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.926+0000 7f3e61600700 1 -- 172.21.15.100:0/4099467866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3e5c0059b0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.927+0000 7f3e61600700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e4405f150 0x7f3e44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:58.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.927+0000 7f3e61600700 1 -- 172.21.15.100:0/4099467866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3e5c079610 con 0x7f3e6c0aa3f0 2024-01-22T05:37:58.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.927+0000 7f3e69400700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e4405f150 0x7f3e44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:58.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.928+0000 7f3e69400700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e4405f150 0x7f3e44061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3e6c150440 tx=0x7f3e54009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:58.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:58.932+0000 7f3e61600700 1 -- 172.21.15.100:0/4099467866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3e5c04a8e0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:59.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.104+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e6c0cacf0 con 0x7f3e6c0aa3f0 2024-01-22T05:37:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.105+0000 7f3e61600700 1 -- 172.21.15.100:0/4099467866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f3e5c018020 con 0x7f3e6c0aa3f0 2024-01-22T05:37:59.106 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:37:59.106 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:58.683579+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:37:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e4405f150 msgr2=0x7f3e44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e4405f150 0x7f3e44061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3e6c150440 tx=0x7f3e54009060).stop 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 msgr2=0x7f3e6c0c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c3b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3e5c00c420 tx=0x7f3e5c007c80).stop 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 shutdown_connections 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e4405f150 0x7f3e44061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e6c154060 0x7f3e6c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0aa3f0 0x7f3e6c0c3b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 --2- 172.21.15.100:0/4099467866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e6c0c64b0 0x7f3e6c14f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.107+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 >> 172.21.15.100:0/4099467866 conn(0x7f3e6c05e9d0 msgr2=0x7f3e6c150700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.108+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 shutdown_connections 2024-01-22T05:37:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.108+0000 7f3e70c00700 1 -- 172.21.15.100:0/4099467866 wait complete. 2024-01-22T05:37:59.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:37:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.312+0000 7f1e92800700 1 Processor -- start 2024-01-22T05:37:59.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.313+0000 7f1e92800700 1 -- start start 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e92800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e92800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e8c0c5cd0 0x7f1e8c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e92800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c0c66e0 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e92800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c0750 con 0x7f1e8c0c5cd0 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e92800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c1bf0 con 0x7f1e8c153ff0 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e8aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e8c0c5cd0 0x7f1e8c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e8aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e8c0c5cd0 0x7f1e8c0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40926/0 (socket says 172.21.15.100:40926) 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e8aa00700 1 -- 172.21.15.100:0/634140004 learned_addr learned my addr 172.21.15.100:0/634140004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.314+0000 7f1e8b400700 1 --2- 172.21.15.100:0/634140004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8aa00700 1 -- 172.21.15.100:0/634140004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 msgr2=0x7f1e8c1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8aa00700 1 --2- 172.21.15.100:0/634140004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8aa00700 1 -- 172.21.15.100:0/634140004 >> v1:172.21.15.169:6789/0 conn(0x7f1e8c0a9d30 legacy=0x7f1e8c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:59.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8aa00700 1 -- 172.21.15.100:0/634140004 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0bfe20 con 0x7f1e8c0c5cd0 2024-01-22T05:37:59.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8aa00700 1 --2- 172.21.15.100:0/634140004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c6150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1e74006fd0 tx=0x7f1e740090f0).ready entity=mon.0 client_cookie=fbcd3cf8cf8adf66 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:59.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8a000700 1 -- 172.21.15.100:0/634140004 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400b600 con 0x7f1e8c0c5cd0 2024-01-22T05:37:59.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8a000700 1 -- 172.21.15.100:0/634140004 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400b760 con 0x7f1e8c0c5cd0 2024-01-22T05:37:59.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e8a000700 1 -- 172.21.15.100:0/634140004 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400bae0 con 0x7f1e8c0c5cd0 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e92800700 1 -- 172.21.15.100:0/634140004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0c5cd0 msgr2=0x7f1e8c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.315+0000 7f1e92800700 1 --2- 172.21.15.100:0/634140004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c6150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1e74006fd0 tx=0x7f1e740090f0).stop 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.316+0000 7f1e92800700 1 -- 172.21.15.100:0/634140004 shutdown_connections 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.316+0000 7f1e92800700 1 --2- 172.21.15.100:0/634140004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.316+0000 7f1e92800700 1 --2- 172.21.15.100:0/634140004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c6150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.316+0000 7f1e92800700 1 -- 172.21.15.100:0/634140004 >> 172.21.15.100:0/634140004 conn(0x7f1e8c0c82a0 msgr2=0x7f1e8c05e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.316+0000 7f1e92800700 1 -- 172.21.15.100:0/634140004 shutdown_connections 2024-01-22T05:37:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.316+0000 7f1e92800700 1 -- 172.21.15.100:0/634140004 wait complete. 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.318+0000 7f1e92800700 1 Processor -- start 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.318+0000 7f1e92800700 1 -- start start 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e92800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0a9d30 0x7f1e8c0c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e92800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e92800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e92800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c14ed90 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e92800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c1554c0 con 0x7f1e8c0c5cd0 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e92800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c2fa0 con 0x7f1e8c153ff0 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e8b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0a9d30 0x7f1e8c0c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e8b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0a9d30 0x7f1e8c0c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40938/0 (socket says 172.21.15.100:40938) 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e8b400700 1 -- 172.21.15.100:0/3446454892 learned_addr learned my addr 172.21.15.100:0/3446454892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:59.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e8aa00700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.319+0000 7f1e8be00700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e8b400700 1 -- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 msgr2=0x7f1e8c145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e8b400700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e8b400700 1 -- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e8c0c5cd0 msgr2=0x7f1e8c0c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e8b400700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e8b400700 1 -- 172.21.15.100:0/3446454892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74009370 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e8aa00700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e8b400700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0a9d30 0x7f1e8c0c2ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1e7c00d890 tx=0x7f1e7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e82a00700 1 -- 172.21.15.100:0/3446454892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0125f0 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e82a00700 1 -- 172.21.15.100:0/3446454892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c012750 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c14eab0 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e82a00700 1 -- 172.21.15.100:0/3446454892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c012ad0 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.320+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c155a40 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.321+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c05fdb0 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.322+0000 7f1e82a00700 1 -- 172.21.15.100:0/3446454892 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e7c013480 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.323+0000 7f1e82a00700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e6405f150 0x7f1e64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.323+0000 7f1e82a00700 1 -- 172.21.15.100:0/3446454892 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e7c079f40 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.323+0000 7f1e8aa00700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e6405f150 0x7f1e64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.323+0000 7f1e8aa00700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e6405f150 0x7f1e64061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1e74006fd0 tx=0x7f1e74017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.327+0000 7f1e82a00700 1 -- 172.21.15.100:0/3446454892 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e7c04b1b0 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.383 INFO:tasks.ceph.mds.a.smithi100.stderr:2024-01-22T05:37:59.383+0000 7f2277800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:37:59.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.501+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e8c0c0100 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.502+0000 7f1e82a00700 1 -- 172.21.15.100:0/3446454892 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f1e7c04e7d0 con 0x7f1e8c0a9d30 2024-01-22T05:37:59.503 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:37:59.503 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:58.683579+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e6405f150 msgr2=0x7f1e64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e6405f150 0x7f1e64061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1e74006fd0 tx=0x7f1e74017000).stop 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0a9d30 msgr2=0x7f1e8c0c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0a9d30 0x7f1e8c0c2ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1e7c00d890 tx=0x7f1e7c008040).stop 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 shutdown_connections 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e6405f150 0x7f1e64061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e8c153ff0 0x7f1e8c145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c0a9d30 0x7f1e8c0c2ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 --2- 172.21.15.100:0/3446454892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e8c0c5cd0 0x7f1e8c0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.504+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 >> 172.21.15.100:0/3446454892 conn(0x7f1e8c0c82a0 msgr2=0x7f1e8c0c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:59.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.505+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 shutdown_connections 2024-01-22T05:37:59.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.505+0000 7f1e92800700 1 -- 172.21.15.100:0/3446454892 wait complete. 2024-01-22T05:37:59.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:37:59.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.709+0000 7f7768800700 1 Processor -- start 2024-01-22T05:37:59.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.709+0000 7f7768800700 1 -- start start 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7768800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7760154260 0x7f77600cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7768800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77600c5c80 0x7f77600c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7768800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77600c1a40 con 0x7f77600c65f0 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7768800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600cbd30 con 0x7f77600c5c80 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7768800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600c6a80 con 0x7f7760154260 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7765400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77600c5c80 0x7f77600c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7766800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f77600c65f0 0x7f7760157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59300/0 (socket says 172.21.15.100:59300) 2024-01-22T05:37:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.710+0000 7f7766800700 1 -- 172.21.15.100:0/906536500 learned_addr learned my addr 172.21.15.100:0/906536500 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7765e00700 1 --2- 172.21.15.100:0/906536500 >> v2:172.21.15.169:3300/0 conn(0x7f7760154260 0x7f77600cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7765400700 1 -- 172.21.15.100:0/906536500 >> v2:172.21.15.169:3300/0 conn(0x7f7760154260 msgr2=0x7f77600cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7765400700 1 --2- 172.21.15.100:0/906536500 >> v2:172.21.15.169:3300/0 conn(0x7f7760154260 0x7f77600cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7764a00700 1 -- 172.21.15.100:0/906536500 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073792151 0 0) 0x7f77600c1a40 con 0x7f77600c65f0 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7765400700 1 -- 172.21.15.100:0/906536500 >> v1:172.21.15.100:6789/0 conn(0x7f77600c65f0 legacy=0x7f7760157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7765400700 1 -- 172.21.15.100:0/906536500 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600c1110 con 0x7f77600c5c80 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7765400700 1 --2- 172.21.15.100:0/906536500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c5c80 0x7f77600c6100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7760083650 tx=0x7f7748009060).ready entity=mon.0 client_cookie=5f3e19e9cf37a3ef server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7764a00700 1 -- 172.21.15.100:0/906536500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800b580 con 0x7f77600c5c80 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7764a00700 1 -- 172.21.15.100:0/906536500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800b6e0 con 0x7f77600c5c80 2024-01-22T05:37:59.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.711+0000 7f7764a00700 1 -- 172.21.15.100:0/906536500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800ba60 con 0x7f77600c5c80 2024-01-22T05:37:59.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 -- 172.21.15.100:0/906536500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c5c80 msgr2=0x7f77600c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 --2- 172.21.15.100:0/906536500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c5c80 0x7f77600c6100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7760083650 tx=0x7f7748009060).stop 2024-01-22T05:37:59.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 -- 172.21.15.100:0/906536500 shutdown_connections 2024-01-22T05:37:59.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 --2- 172.21.15.100:0/906536500 >> v2:172.21.15.169:3300/0 conn(0x7f7760154260 0x7f77600cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 --2- 172.21.15.100:0/906536500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c5c80 0x7f77600c6100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 -- 172.21.15.100:0/906536500 >> 172.21.15.100:0/906536500 conn(0x7f776005e9d0 msgr2=0x7f77600cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:37:59.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 -- 172.21.15.100:0/906536500 shutdown_connections 2024-01-22T05:37:59.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.712+0000 7f7768800700 1 -- 172.21.15.100:0/906536500 wait complete. 2024-01-22T05:37:59.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.714+0000 7f7768800700 1 Processor -- start 2024-01-22T05:37:59.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.714+0000 7f7768800700 1 -- start start 2024-01-22T05:37:59.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7768800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77600c5c80 0x7f77601683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7768800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c65f0 0x7f77600c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7768800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7760154260 0x7f77600b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7768800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600c4810 con 0x7f77600c65f0 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7768800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600c38c0 con 0x7f77600c5c80 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7768800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600c3b90 con 0x7f7760154260 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7765400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c65f0 0x7f77600c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7765400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c65f0 0x7f77600c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40960/0 (socket says 172.21.15.100:40960) 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.715+0000 7f7765400700 1 -- 172.21.15.100:0/4130452453 learned_addr learned my addr 172.21.15.100:0/4130452453 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7765e00700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77600c5c80 0x7f77601683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7766800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7760154260 0x7f77600b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7765400700 1 -- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7760154260 msgr2=0x7f77600b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7765400700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7760154260 0x7f77600b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7765400700 1 -- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77600c5c80 msgr2=0x7f77601683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:37:59.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7765400700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77600c5c80 0x7f77601683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7765400700 1 -- 172.21.15.100:0/4130452453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77480092a0 con 0x7f77600c65f0 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7766800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7760154260 0x7f77600b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7765400700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c65f0 0x7f77600c33d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7748009e80 tx=0x7f7748017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f775d600700 1 -- 172.21.15.100:0/4130452453 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800b850 con 0x7f77600c65f0 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f775d600700 1 -- 172.21.15.100:0/4130452453 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800b9b0 con 0x7f77600c65f0 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77600c3e70 con 0x7f77600c65f0 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.716+0000 7f775d600700 1 -- 172.21.15.100:0/4130452453 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774801b660 con 0x7f77600c65f0 2024-01-22T05:37:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.717+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77600c4430 con 0x7f77600c65f0 2024-01-22T05:37:59.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.718+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77600c4950 con 0x7f77600c65f0 2024-01-22T05:37:59.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.718+0000 7f775d600700 1 -- 172.21.15.100:0/4130452453 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f774801ba10 con 0x7f77600c65f0 2024-01-22T05:37:59.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.719+0000 7f775d600700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f773805f150 0x7f7738061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:37:59.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.719+0000 7f775d600700 1 -- 172.21.15.100:0/4130452453 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f774807bd50 con 0x7f77600c65f0 2024-01-22T05:37:59.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.719+0000 7f7765e00700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f773805f150 0x7f7738061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:37:59.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.720+0000 7f7765e00700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f773805f150 0x7f7738061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7750006090 tx=0x7f7750008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:37:59.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.723+0000 7f775d600700 1 -- 172.21.15.100:0/4130452453 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f77600c4950 con 0x7f77600c65f0 2024-01-22T05:37:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:37:59.934+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f77600c4950 con 0x7f77600c65f0 2024-01-22T05:38:00.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.695+0000 7f775d600700 1 -- 172.21.15.100:0/4130452453 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f77600c4950 con 0x7f77600c65f0 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.698+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f773805f150 msgr2=0x7f7738061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f773805f150 0x7f7738061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7750006090 tx=0x7f7750008040).stop 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c65f0 msgr2=0x7f77600c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c65f0 0x7f77600c33d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7748009e80 tx=0x7f7748017000).stop 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 shutdown_connections 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f773805f150 0x7f7738061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77600c5c80 0x7f77601683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7760154260 0x7f77600b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 --2- 172.21.15.100:0/4130452453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77600c65f0 0x7f77600c33d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 >> 172.21.15.100:0/4130452453 conn(0x7f776005e9d0 msgr2=0x7f77600c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:00.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 shutdown_connections 2024-01-22T05:38:00.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.699+0000 7f7768800700 1 -- 172.21.15.100:0/4130452453 wait complete. 2024-01-22T05:38:00.718 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:38:00.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:38:00.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.905+0000 7f01fc600700 1 Processor -- start 2024-01-22T05:38:00.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.906+0000 7f01fc600700 1 -- start start 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fc600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f4154260 0x7f01f40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fc600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01f40c6810 0x7f01f40c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fc600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40c1a40 con 0x7f01f40c5c80 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fc600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40cbd30 con 0x7f01f40c6810 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fc600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40c1110 con 0x7f01f4154260 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fa600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01f40c6810 0x7f01f40c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fa600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01f40c6810 0x7f01f40c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40976/0 (socket says 172.21.15.100:40976) 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01fa600700 1 -- 172.21.15.100:0/2631055245 learned_addr learned my addr 172.21.15.100:0/2631055245 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.907+0000 7f01f9c00700 1 --2- 172.21.15.100:0/2631055245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f4154260 0x7f01f40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01fa600700 1 -- 172.21.15.100:0/2631055245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f4154260 msgr2=0x7f01f40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01fa600700 1 --2- 172.21.15.100:0/2631055245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f4154260 0x7f01f40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01fa600700 1 -- 172.21.15.100:0/2631055245 >> v1:172.21.15.169:6789/0 conn(0x7f01f40c5c80 legacy=0x7f01f40c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:00.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01fa600700 1 -- 172.21.15.100:0/2631055245 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40c13f0 con 0x7f01f40c6810 2024-01-22T05:38:00.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01fa600700 1 --2- 172.21.15.100:0/2631055245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f40c8c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f01ec009f20 tx=0x7f01ec009840).ready entity=mon.0 client_cookie=a298492d6d79e1fa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:00.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01f3e00700 1 -- 172.21.15.100:0/2631055245 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00e070 con 0x7f01f40c6810 2024-01-22T05:38:00.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01f3e00700 1 -- 172.21.15.100:0/2631055245 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00ba80 con 0x7f01f40c6810 2024-01-22T05:38:00.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.908+0000 7f01f3e00700 1 -- 172.21.15.100:0/2631055245 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00be00 con 0x7f01f40c6810 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 -- 172.21.15.100:0/2631055245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 msgr2=0x7f01f40c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 --2- 172.21.15.100:0/2631055245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f40c8c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f01ec009f20 tx=0x7f01ec009840).stop 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 -- 172.21.15.100:0/2631055245 shutdown_connections 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 --2- 172.21.15.100:0/2631055245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f40c8c00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 --2- 172.21.15.100:0/2631055245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f4154260 0x7f01f40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 -- 172.21.15.100:0/2631055245 >> 172.21.15.100:0/2631055245 conn(0x7f01f405e9d0 msgr2=0x7f01f40cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 -- 172.21.15.100:0/2631055245 shutdown_connections 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.909+0000 7f01fc600700 1 -- 172.21.15.100:0/2631055245 wait complete. 2024-01-22T05:38:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.910+0000 7f01fc600700 1 Processor -- start 2024-01-22T05:38:00.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.910+0000 7f01fc600700 1 -- start start 2024-01-22T05:38:00.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.911+0000 7f01fc600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40c5c80 0x7f01f41490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:00.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.911+0000 7f01fc600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f4163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.911+0000 7f01fc600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f4154260 0x7f01f40acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.911+0000 7f01fc600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40c3430 con 0x7f01f40c6810 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.911+0000 7f01fc600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40aa950 con 0x7f01f4154260 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.911+0000 7f01fc600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40aac30 con 0x7f01f40c5c80 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.911+0000 7f01f9200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f4163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f4163bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40980/0 (socket says 172.21.15.100:40980) 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 -- 172.21.15.100:0/1765059409 learned_addr learned my addr 172.21.15.100:0/1765059409 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9c00700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40c5c80 0x7f01f41490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01fa600700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f4154260 0x7f01f40acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 -- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40c5c80 msgr2=0x7f01f41490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40c5c80 0x7f01f41490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 -- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f4154260 msgr2=0x7f01f40acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f4154260 0x7f01f40acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 -- 172.21.15.100:0/1765059409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec009ae0 con 0x7f01f40c6810 2024-01-22T05:38:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f9200700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f4163bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f01dc00c4c0 tx=0x7f01dc007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f0c00700 1 -- 172.21.15.100:0/1765059409 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc00ce10 con 0x7f01f40c6810 2024-01-22T05:38:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f0c00700 1 -- 172.21.15.100:0/1765059409 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc007020 con 0x7f01f40c6810 2024-01-22T05:38:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40aaf10 con 0x7f01f40c6810 2024-01-22T05:38:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.912+0000 7f01f0c00700 1 -- 172.21.15.100:0/1765059409 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0073c0 con 0x7f01f40c6810 2024-01-22T05:38:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.913+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f41640b0 con 0x7f01f40c6810 2024-01-22T05:38:00.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.914+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f40ab430 con 0x7f01f40c6810 2024-01-22T05:38:00.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.914+0000 7f01f0c00700 1 -- 172.21.15.100:0/1765059409 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f01dc0068b0 con 0x7f01f40c6810 2024-01-22T05:38:00.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.915+0000 7f01f0c00700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f01cc05f150 0x7f01cc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:00.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.915+0000 7f01f0c00700 1 -- 172.21.15.100:0/1765059409 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f01dc0794c0 con 0x7f01f40c6810 2024-01-22T05:38:00.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.915+0000 7f01f9c00700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f01cc05f150 0x7f01cc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:00.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.916+0000 7f01f9c00700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f01cc05f150 0x7f01cc061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f01e4006090 tx=0x7f01e4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:00.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:00.919+0000 7f01f0c00700 1 -- 172.21.15.100:0/1765059409 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f01dc047b00 con 0x7f01f40c6810 2024-01-22T05:38:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.134+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f01f405fdb0 con 0x7f01f40c6810 2024-01-22T05:38:01.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.697+0000 7f01f0c00700 1 -- 172.21.15.100:0/1765059409 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f01f40ab430 con 0x7f01f40c6810 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f01cc05f150 msgr2=0x7f01cc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f01cc05f150 0x7f01cc061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f01e4006090 tx=0x7f01e4008040).stop 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 msgr2=0x7f01f4163bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f4163bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f01dc00c4c0 tx=0x7f01dc007dd0).stop 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 shutdown_connections 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f01cc05f150 0x7f01cc061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f4154260 0x7f01f40acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01f40c5c80 0x7f01f41490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 --2- 172.21.15.100:0/1765059409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01f40c6810 0x7f01f4163bc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 >> 172.21.15.100:0/1765059409 conn(0x7f01f405e9d0 msgr2=0x7f01f40c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:01.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 shutdown_connections 2024-01-22T05:38:01.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.700+0000 7f01fc600700 1 -- 172.21.15.100:0/1765059409 wait complete. 2024-01-22T05:38:01.719 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:38:01.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.904+0000 7fc652c00700 1 Processor -- start 2024-01-22T05:38:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.904+0000 7fc652c00700 1 -- start start 2024-01-22T05:38:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.905+0000 7fc652c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc64c153ff0 0x7fc64c1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.905+0000 7fc652c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc64c0c5cd0 0x7fc64c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.905+0000 7fc652c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0c66e0 con 0x7fc64c0a9d30 2024-01-22T05:38:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.905+0000 7fc652c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c0c0750 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.905+0000 7fc652c00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c0c1bf0 con 0x7fc64c153ff0 2024-01-22T05:38:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64b400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc64c0c5cd0 0x7fc64c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc650c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc64c0a9d30 0x7fc64c157dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59306/0 (socket says 172.21.15.100:59306) 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc650c00700 1 -- 172.21.15.100:0/2763589786 learned_addr learned my addr 172.21.15.100:0/2763589786 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64be00700 1 --2- 172.21.15.100:0/2763589786 >> v2:172.21.15.169:3300/0 conn(0x7fc64c153ff0 0x7fc64c1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64b400700 1 -- 172.21.15.100:0/2763589786 >> v2:172.21.15.169:3300/0 conn(0x7fc64c153ff0 msgr2=0x7fc64c1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64b400700 1 --2- 172.21.15.100:0/2763589786 >> v2:172.21.15.169:3300/0 conn(0x7fc64c153ff0 0x7fc64c1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64b400700 1 -- 172.21.15.100:0/2763589786 >> v1:172.21.15.100:6789/0 conn(0x7fc64c0a9d30 legacy=0x7fc64c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64b400700 1 -- 172.21.15.100:0/2763589786 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0bfe20 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64aa00700 1 -- 172.21.15.100:0/2763589786 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417653051 0 0) 0x7fc64c0c66e0 con 0x7fc64c0a9d30 2024-01-22T05:38:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.906+0000 7fc64b400700 1 --2- 172.21.15.100:0/2763589786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0c6150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc64c083710 tx=0x7fc634009060).ready entity=mon.0 client_cookie=f19f5352dfb558f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc64aa00700 1 -- 172.21.15.100:0/2763589786 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400f510 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc64aa00700 1 -- 172.21.15.100:0/2763589786 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63400f670 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc64aa00700 1 -- 172.21.15.100:0/2763589786 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400f9f0 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 -- 172.21.15.100:0/2763589786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 msgr2=0x7fc64c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 --2- 172.21.15.100:0/2763589786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0c6150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc64c083710 tx=0x7fc634009060).stop 2024-01-22T05:38:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 -- 172.21.15.100:0/2763589786 shutdown_connections 2024-01-22T05:38:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 --2- 172.21.15.100:0/2763589786 >> v2:172.21.15.169:3300/0 conn(0x7fc64c153ff0 0x7fc64c1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 --2- 172.21.15.100:0/2763589786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0c6150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 -- 172.21.15.100:0/2763589786 >> 172.21.15.100:0/2763589786 conn(0x7fc64c0c82a0 msgr2=0x7fc64c05e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 -- 172.21.15.100:0/2763589786 shutdown_connections 2024-01-22T05:38:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.907+0000 7fc652c00700 1 -- 172.21.15.100:0/2763589786 wait complete. 2024-01-22T05:38:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.909+0000 7fc652c00700 1 Processor -- start 2024-01-22T05:38:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.910+0000 7fc652c00700 1 -- start start 2024-01-22T05:38:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc652c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc64c0a9d30 0x7fc64c164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc652c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc652c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc64c153ff0 0x7fc64c1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc652c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1559f0 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc652c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1653f0 con 0x7fc64c153ff0 2024-01-22T05:38:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc652c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0b0120 con 0x7fc64c0a9d30 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40996/0 (socket says 172.21.15.100:40996) 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 -- 172.21.15.100:0/856023412 learned_addr learned my addr 172.21.15.100:0/856023412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64be00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc64c0a9d30 0x7fc64c164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc650c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc64c153ff0 0x7fc64c1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 -- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc64c0a9d30 msgr2=0x7fc64c164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc64c0a9d30 0x7fc64c164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 -- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc64c153ff0 msgr2=0x7fc64c1532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc64c153ff0 0x7fc64c1532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc64b400700 1 -- 172.21.15.100:0/856023412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340092a0 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.911+0000 7fc650c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc64c153ff0 0x7fc64c1532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.912+0000 7fc64b400700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0afc30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc64c06c2e0 tx=0x7fc634017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.912+0000 7fc643400700 1 -- 172.21.15.100:0/856023412 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63401a4d0 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.912+0000 7fc643400700 1 -- 172.21.15.100:0/856023412 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63401e070 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.912+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c0b0c60 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.912+0000 7fc643400700 1 -- 172.21.15.100:0/856023412 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63401a880 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.912+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c0b06a0 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.913+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c155b60 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.914+0000 7fc643400700 1 -- 172.21.15.100:0/856023412 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc634020030 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.915+0000 7fc643400700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc62405f150 0x7fc624061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:01.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.915+0000 7fc643400700 1 -- 172.21.15.100:0/856023412 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc63407b290 con 0x7fc64c0c5cd0 2024-01-22T05:38:01.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.915+0000 7fc64be00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc62405f150 0x7fc624061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:01.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.915+0000 7fc64be00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc62405f150 0x7fc624061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc64c0c22b0 tx=0x7fc63c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:01.919+0000 7fc643400700 1 -- 172.21.15.100:0/856023412 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc63404c560 con 0x7fc64c0c5cd0 2024-01-22T05:38:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.129+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc64c05fdb0 con 0x7fc64c0c5cd0 2024-01-22T05:38:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.129+0000 7fc643400700 1 -- 172.21.15.100:0/856023412 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7fc63404fb80 con 0x7fc64c0c5cd0 2024-01-22T05:38:02.129 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:02.130 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.131+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc62405f150 msgr2=0x7fc624061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.131+0000 7fc652c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc62405f150 0x7fc624061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc64c0c22b0 tx=0x7fc63c009060).stop 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.131+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 msgr2=0x7fc64c0afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.131+0000 7fc652c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0afc30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc64c06c2e0 tx=0x7fc634017000).stop 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 shutdown_connections 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc62405f150 0x7fc624061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc64c153ff0 0x7fc64c1532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc64c0a9d30 0x7fc64c164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 --2- 172.21.15.100:0/856023412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc64c0c5cd0 0x7fc64c0afc30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 >> 172.21.15.100:0/856023412 conn(0x7fc64c0c82a0 msgr2=0x7fc64c0ab210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:02.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 shutdown_connections 2024-01-22T05:38:02.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.132+0000 7fc652c00700 1 -- 172.21.15.100:0/856023412 wait complete. 2024-01-22T05:38:02.133 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:02.150 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.334+0000 7f005a800700 1 Processor -- start 2024-01-22T05:38:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.334+0000 7f005a800700 1 -- start start 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f005a800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0054153ff0 0x7f00541543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f005a800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00540aa440 0x7f00540c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f005a800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540c66e0 con 0x7f00540c5cd0 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f005a800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540c0750 con 0x7f0054153ff0 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f005a800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540c1bf0 con 0x7f00540aa440 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f0053400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0054153ff0 0x7f00541543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f0053400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0054153ff0 0x7f00541543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41010/0 (socket says 172.21.15.100:41010) 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f0053400700 1 -- 172.21.15.100:0/4148870252 learned_addr learned my addr 172.21.15.100:0/4148870252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.335+0000 7f004be00700 1 --1- 172.21.15.100:0/4148870252 >> v1:172.21.15.100:6789/0 conn(0x7f00540c5cd0 0x7f00540a9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59308/0 (socket says 172.21.15.100:59308) 2024-01-22T05:38:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0053e00700 1 --2- 172.21.15.100:0/4148870252 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00540aa440 0x7f00540c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0053400700 1 -- 172.21.15.100:0/4148870252 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00540aa440 msgr2=0x7f00540c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0053400700 1 --2- 172.21.15.100:0/4148870252 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00540aa440 0x7f00540c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0053400700 1 -- 172.21.15.100:0/4148870252 >> v1:172.21.15.100:6789/0 conn(0x7f00540c5cd0 legacy=0x7f00540a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0053400700 1 -- 172.21.15.100:0/4148870252 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540bfe20 con 0x7f0054153ff0 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0052a00700 1 -- 172.21.15.100:0/4148870252 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278240239 0 0) 0x7f00540c66e0 con 0x7f00540c5cd0 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0053400700 1 --2- 172.21.15.100:0/4148870252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054153ff0 0x7f00541543d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0044006fd0 tx=0x7f00440090f0).ready entity=mon.0 client_cookie=771e5157f2654dde server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0052a00700 1 -- 172.21.15.100:0/4148870252 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400b600 con 0x7f0054153ff0 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0052a00700 1 -- 172.21.15.100:0/4148870252 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400b760 con 0x7f0054153ff0 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.336+0000 7f0052a00700 1 -- 172.21.15.100:0/4148870252 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400bae0 con 0x7f0054153ff0 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 -- 172.21.15.100:0/4148870252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054153ff0 msgr2=0x7f00541543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 --2- 172.21.15.100:0/4148870252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054153ff0 0x7f00541543d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0044006fd0 tx=0x7f00440090f0).stop 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 -- 172.21.15.100:0/4148870252 shutdown_connections 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 --2- 172.21.15.100:0/4148870252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054153ff0 0x7f00541543d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 --2- 172.21.15.100:0/4148870252 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00540aa440 0x7f00540c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 -- 172.21.15.100:0/4148870252 >> 172.21.15.100:0/4148870252 conn(0x7f00540c82a0 msgr2=0x7f005405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 -- 172.21.15.100:0/4148870252 shutdown_connections 2024-01-22T05:38:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.337+0000 7f005a800700 1 -- 172.21.15.100:0/4148870252 wait complete. 2024-01-22T05:38:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.339+0000 7f005a800700 1 Processor -- start 2024-01-22T05:38:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.339+0000 7f005a800700 1 -- start start 2024-01-22T05:38:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f005a800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00540aa440 0x7f00540c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f005a800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00540c5cd0 0x7f0054151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f005a800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0054153ff0 0x7f0054152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f005a800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054153960 con 0x7f00540c5cd0 2024-01-22T05:38:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f005a800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540c2620 con 0x7f00540aa440 2024-01-22T05:38:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f005a800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540c2fa0 con 0x7f0054153ff0 2024-01-22T05:38:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f004be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00540c5cd0 0x7f0054151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f004be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00540c5cd0 0x7f0054151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41018/0 (socket says 172.21.15.100:41018) 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.340+0000 7f004be00700 1 -- 172.21.15.100:0/469464501 learned_addr learned my addr 172.21.15.100:0/469464501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f0053e00700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0054153ff0 0x7f0054152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f0053400700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00540aa440 0x7f00540c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004be00700 1 -- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0054153ff0 msgr2=0x7f0054152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004be00700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0054153ff0 0x7f0054152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004be00700 1 -- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00540aa440 msgr2=0x7f00540c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004be00700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00540aa440 0x7f00540c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004be00700 1 -- 172.21.15.100:0/469464501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044009370 con 0x7f00540c5cd0 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f0053e00700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0054153ff0 0x7f0054152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f0053400700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00540aa440 0x7f00540c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004be00700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00540c5cd0 0x7f0054151090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f003c00c4e0 tx=0x7f003c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004aa00700 1 -- 172.21.15.100:0/469464501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0072e0 con 0x7f00540c5cd0 2024-01-22T05:38:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004aa00700 1 -- 172.21.15.100:0/469464501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c007440 con 0x7f00540c5cd0 2024-01-22T05:38:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f004aa00700 1 -- 172.21.15.100:0/469464501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0058f0 con 0x7f00540c5cd0 2024-01-22T05:38:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0054153680 con 0x7f00540c5cd0 2024-01-22T05:38:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.341+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00540c22b0 con 0x7f00540c5cd0 2024-01-22T05:38:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.342+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00540c1e10 con 0x7f00540c5cd0 2024-01-22T05:38:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.343+0000 7f004aa00700 1 -- 172.21.15.100:0/469464501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f003c005ce0 con 0x7f00540c5cd0 2024-01-22T05:38:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.344+0000 7f004aa00700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f002c05f150 0x7f002c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.344+0000 7f004aa00700 1 -- 172.21.15.100:0/469464501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f003c079ae0 con 0x7f00540c5cd0 2024-01-22T05:38:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.344+0000 7f0053400700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f002c05f150 0x7f002c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.344+0000 7f0053400700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f002c05f150 0x7f002c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0044009130 tx=0x7f0044017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.347+0000 7f004aa00700 1 -- 172.21.15.100:0/469464501 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f003c04acf0 con 0x7f00540c5cd0 2024-01-22T05:38:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.521+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0054153440 con 0x7f00540c5cd0 2024-01-22T05:38:02.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.522+0000 7f004aa00700 1 -- 172.21.15.100:0/469464501 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f0054153440 con 0x7f00540c5cd0 2024-01-22T05:38:02.522 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:02.523 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f002c05f150 msgr2=0x7f002c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f002c05f150 0x7f002c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0044009130 tx=0x7f0044017000).stop 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00540c5cd0 msgr2=0x7f0054151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00540c5cd0 0x7f0054151090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f003c00c4e0 tx=0x7f003c007c60).stop 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 shutdown_connections 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f002c05f150 0x7f002c061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00540aa440 0x7f00540c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0054153ff0 0x7f0054152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.524+0000 7f005a800700 1 --2- 172.21.15.100:0/469464501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00540c5cd0 0x7f0054151090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.525+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 >> 172.21.15.100:0/469464501 conn(0x7f00540c82a0 msgr2=0x7f00540ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.525+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 shutdown_connections 2024-01-22T05:38:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.525+0000 7f005a800700 1 -- 172.21.15.100:0/469464501 wait complete. 2024-01-22T05:38:02.542 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:38:02.543 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:38:02.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.726+0000 7fc24be00700 1 Processor -- start 2024-01-22T05:38:02.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.726+0000 7fc24be00700 1 -- start start 2024-01-22T05:38:02.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.727+0000 7fc24be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.727+0000 7fc24be00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440c66e0 con 0x7fc244153ff0 2024-01-22T05:38:02.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.727+0000 7fc24be00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440c0750 con 0x7fc2440aa220 2024-01-22T05:38:02.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.727+0000 7fc24be00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440aa6b0 con 0x7fc2441543d0 2024-01-22T05:38:02.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.727+0000 7fc249400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc244153ff0 0x7fc2440c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59314/0 (socket says 172.21.15.100:59314) 2024-01-22T05:38:02.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.727+0000 7fc249400700 1 -- 172.21.15.100:0/1557373831 learned_addr learned my addr 172.21.15.100:0/1557373831 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:02.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.727+0000 7fc248a00700 1 --2- 172.21.15.100:0/1557373831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc243e00700 1 -- 172.21.15.100:0/1557373831 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359401112 0 0) 0x7fc2440c66e0 con 0x7fc244153ff0 2024-01-22T05:38:02.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc243e00700 1 -- 172.21.15.100:0/1557373831 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2240033f0 con 0x7fc244153ff0 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc243e00700 1 -- 172.21.15.100:0/1557373831 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65833749 0 0) 0x7fc2440c0750 con 0x7fc2440aa220 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc243e00700 1 -- 172.21.15.100:0/1557373831 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2440c66e0 con 0x7fc2440aa220 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc248a00700 1 -- 172.21.15.100:0/1557373831 >> v1:172.21.15.169:6789/0 conn(0x7fc2440aa220 legacy=0x7fc2440c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc248a00700 1 -- 172.21.15.100:0/1557373831 >> v1:172.21.15.100:6789/0 conn(0x7fc244153ff0 legacy=0x7fc2440c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc248a00700 1 -- 172.21.15.100:0/1557373831 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440bfe20 con 0x7fc2441543d0 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc248a00700 1 --2- 172.21.15.100:0/1557373831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440a9d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc22c009790 tx=0x7fc22c009060).ready entity=mon.2 client_cookie=2ae1630e3ad77b54 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc243e00700 1 -- 172.21.15.100:0/1557373831 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00f510 con 0x7fc2441543d0 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc243e00700 1 -- 172.21.15.100:0/1557373831 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c00f670 con 0x7fc2441543d0 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.728+0000 7fc243e00700 1 -- 172.21.15.100:0/1557373831 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00f9f0 con 0x7fc2441543d0 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.729+0000 7fc24be00700 1 -- 172.21.15.100:0/1557373831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 msgr2=0x7fc2440a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.729+0000 7fc24be00700 1 --2- 172.21.15.100:0/1557373831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440a9d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc22c009790 tx=0x7fc22c009060).stop 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.729+0000 7fc24be00700 1 -- 172.21.15.100:0/1557373831 shutdown_connections 2024-01-22T05:38:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.729+0000 7fc24be00700 1 --2- 172.21.15.100:0/1557373831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440a9d30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.729+0000 7fc24be00700 1 -- 172.21.15.100:0/1557373831 >> 172.21.15.100:0/1557373831 conn(0x7fc2440c82a0 msgr2=0x7fc24405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.729+0000 7fc24be00700 1 -- 172.21.15.100:0/1557373831 shutdown_connections 2024-01-22T05:38:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.729+0000 7fc24be00700 1 -- 172.21.15.100:0/1557373831 wait complete. 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.730+0000 7fc24be00700 1 Processor -- start 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.731+0000 7fc24be00700 1 -- start start 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.731+0000 7fc24be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2440aa220 0x7fc244165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.731+0000 7fc24be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244153ff0 0x7fc2440b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.731+0000 7fc24be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.731+0000 7fc24be00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c1e30 con 0x7fc244153ff0 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.731+0000 7fc24be00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c29b0 con 0x7fc2440aa220 2024-01-22T05:38:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.731+0000 7fc24be00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c2080 con 0x7fc2441543d0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244153ff0 0x7fc2440b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244153ff0 0x7fc2440b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41026/0 (socket says 172.21.15.100:41026) 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 -- 172.21.15.100:0/1230168006 learned_addr learned my addr 172.21.15.100:0/1230168006 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc249e00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc249400700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2440aa220 0x7fc244165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 -- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 msgr2=0x7fc2440c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 -- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2440aa220 msgr2=0x7fc244165300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2440aa220 0x7fc244165300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 -- 172.21.15.100:0/1230168006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c0092a0 con 0x7fc244153ff0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc248a00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244153ff0 0x7fc2440b0600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc24406c2e0 tx=0x7fc22c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.732+0000 7fc240c00700 1 -- 172.21.15.100:0/1230168006 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00fe80 con 0x7fc244153ff0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.733+0000 7fc240c00700 1 -- 172.21.15.100:0/1230168006 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c00f7e0 con 0x7fc244153ff0 2024-01-22T05:38:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.733+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440c2360 con 0x7fc244153ff0 2024-01-22T05:38:02.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.733+0000 7fc240c00700 1 -- 172.21.15.100:0/1230168006 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c01b640 con 0x7fc244153ff0 2024-01-22T05:38:02.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.733+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2440b0af0 con 0x7fc244153ff0 2024-01-22T05:38:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.734+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2440c2b20 con 0x7fc244153ff0 2024-01-22T05:38:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.734+0000 7fc240c00700 1 -- 172.21.15.100:0/1230168006 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc22c01b9b0 con 0x7fc244153ff0 2024-01-22T05:38:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.735+0000 7fc240c00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc21c05f150 0x7fc21c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.736+0000 7fc240c00700 1 -- 172.21.15.100:0/1230168006 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc22c07b4a0 con 0x7fc244153ff0 2024-01-22T05:38:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.736+0000 7fc249400700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc21c05f150 0x7fc21c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.736+0000 7fc249400700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc21c05f150 0x7fc21c061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc234005750 tx=0x7fc234009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.739+0000 7fc240c00700 1 -- 172.21.15.100:0/1230168006 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc22c04c730 con 0x7fc244153ff0 2024-01-22T05:38:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.906+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc24405fdb0 con 0x7fc21c05f150 2024-01-22T05:38:02.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.917+0000 7fc240c00700 1 -- 172.21.15.100:0/1230168006 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+326635 (secure 0 0 0) 0x7fc24405fdb0 con 0x7fc21c05f150 2024-01-22T05:38:02.922 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:02.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.921+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc21c05f150 msgr2=0x7fc21c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.921+0000 7fc24be00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc21c05f150 0x7fc21c061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc234005750 tx=0x7fc234009040).stop 2024-01-22T05:38:02.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.921+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244153ff0 msgr2=0x7fc2440b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.921+0000 7fc24be00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244153ff0 0x7fc2440b0600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc24406c2e0 tx=0x7fc22c017000).stop 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 shutdown_connections 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc21c05f150 0x7fc21c061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2440aa220 0x7fc244165300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2441543d0 0x7fc2440c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 --2- 172.21.15.100:0/1230168006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244153ff0 0x7fc2440b0600 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 >> 172.21.15.100:0/1230168006 conn(0x7fc2440c82a0 msgr2=0x7fc24414ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 shutdown_connections 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:02.922+0000 7fc24be00700 1 -- 172.21.15.100:0/1230168006 wait complete. 2024-01-22T05:38:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:38:02.939 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-22T05:38:01.130267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378172,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596548,"statfs":{"total":773094113280,"available":770658865152,"internally_reserved":0,"allocated":1437696,"data_stored":465342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727312+0000","last_change":"2024-01-22T05:37:58.720751+0000","last_active":"2024-01-22T05:37:58.727312+0000","last_peered":"2024-01-22T05:37:58.727312+0000","last_clean":"2024-01-22T05:37:58.727312+0000","last_became_active":"2024-01-22T05:37:58.720447+0000","last_became_peered":"2024-01-22T05:37:58.720447+0000","last_unstale":"2024-01-22T05:37:58.727312+0000","last_undegraded":"2024-01-22T05:37:58.727312+0000","last_fullsized":"2024-01-22T05:37:58.727312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696152+0000","last_change":"2024-01-22T05:37:58.248478+0000","last_active":"2024-01-22T05:37:58.696152+0000","last_peered":"2024-01-22T05:37:58.696152+0000","last_clean":"2024-01-22T05:37:58.696152+0000","last_became_active":"2024-01-22T05:37:58.248115+0000","last_became_peered":"2024-01-22T05:37:58.248115+0000","last_unstale":"2024-01-22T05:37:58.696152+0000","last_undegraded":"2024-01-22T05:37:58.696152+0000","last_fullsized":"2024-01-22T05:37:58.696152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726308+0000","last_change":"2024-01-22T05:37:58.720495+0000","last_active":"2024-01-22T05:37:58.726308+0000","last_peered":"2024-01-22T05:37:58.726308+0000","last_clean":"2024-01-22T05:37:58.726308+0000","last_became_active":"2024-01-22T05:37:58.713824+0000","last_became_peered":"2024-01-22T05:37:58.713824+0000","last_unstale":"2024-01-22T05:37:58.726308+0000","last_undegraded":"2024-01-22T05:37:58.726308+0000","last_fullsized":"2024-01-22T05:37:58.726308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716320+0000","last_change":"2024-01-22T05:37:58.712852+0000","last_active":"2024-01-22T05:37:58.716320+0000","last_peered":"2024-01-22T05:37:58.716320+0000","last_clean":"2024-01-22T05:37:58.716320+0000","last_became_active":"2024-01-22T05:37:58.712580+0000","last_became_peered":"2024-01-22T05:37:58.712580+0000","last_unstale":"2024-01-22T05:37:58.716320+0000","last_undegraded":"2024-01-22T05:37:58.716320+0000","last_fullsized":"2024-01-22T05:37:58.716320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703194+0000","last_change":"2024-01-22T05:37:58.247858+0000","last_active":"2024-01-22T05:37:58.703194+0000","last_peered":"2024-01-22T05:37:58.703194+0000","last_clean":"2024-01-22T05:37:58.703194+0000","last_became_active":"2024-01-22T05:37:58.247562+0000","last_became_peered":"2024-01-22T05:37:58.247562+0000","last_unstale":"2024-01-22T05:37:58.703194+0000","last_undegraded":"2024-01-22T05:37:58.703194+0000","last_fullsized":"2024-01-22T05:37:58.703194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:53.211815+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:37:53.211815+0000","last_peered":"2024-01-22T05:37:53.211815+0000","last_clean":"2024-01-22T05:37:53.211815+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:37:53.211815+0000","last_undegraded":"2024-01-22T05:37:53.211815+0000","last_fullsized":"2024-01-22T05:37:53.211815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:53.211300+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:37:53.211300+0000","last_peered":"2024-01-22T05:37:53.211300+0000","last_clean":"2024-01-22T05:37:53.211300+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:37:53.211300+0000","last_undegraded":"2024-01-22T05:37:53.211300+0000","last_fullsized":"2024-01-22T05:37:53.211300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:53.212213+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:37:53.212213+0000","last_peered":"2024-01-22T05:37:53.212213+0000","last_clean":"2024-01-22T05:37:53.212213+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:37:53.212213+0000","last_undegraded":"2024-01-22T05:37:53.212213+0000","last_fullsized":"2024-01-22T05:37:53.212213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:53.482496+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:37:53.482496+0000","last_peered":"2024-01-22T05:37:53.482496+0000","last_clean":"2024-01-22T05:37:53.482496+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:37:53.482496+0000","last_undegraded":"2024-01-22T05:37:53.482496+0000","last_fullsized":"2024-01-22T05:37:53.482496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:53.196743+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:37:53.196743+0000","last_peered":"2024-01-22T05:37:53.196743+0000","last_clean":"2024-01-22T05:37:53.196743+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:37:53.196743+0000","last_undegraded":"2024-01-22T05:37:53.196743+0000","last_fullsized":"2024-01-22T05:37:53.196743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.694912+0000","last_change":"2024-01-22T05:37:58.248432+0000","last_active":"2024-01-22T05:37:58.694912+0000","last_peered":"2024-01-22T05:37:58.694912+0000","last_clean":"2024-01-22T05:37:58.694912+0000","last_became_active":"2024-01-22T05:37:58.248051+0000","last_became_peered":"2024-01-22T05:37:58.248051+0000","last_unstale":"2024-01-22T05:37:58.694912+0000","last_undegraded":"2024-01-22T05:37:58.694912+0000","last_fullsized":"2024-01-22T05:37:58.694912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:53.211269+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:37:53.211269+0000","last_peered":"2024-01-22T05:37:53.211269+0000","last_clean":"2024-01-22T05:37:53.211269+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:37:53.211269+0000","last_undegraded":"2024-01-22T05:37:53.211269+0000","last_fullsized":"2024-01-22T05:37:53.211269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:53.211287+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:37:53.211287+0000","last_peered":"2024-01-22T05:37:53.211287+0000","last_clean":"2024-01-22T05:37:53.211287+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:37:53.211287+0000","last_undegraded":"2024-01-22T05:37:53.211287+0000","last_fullsized":"2024-01-22T05:37:53.211287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718886+0000","last_change":"2024-01-22T05:37:58.248570+0000","last_active":"2024-01-22T05:37:58.718886+0000","last_peered":"2024-01-22T05:37:58.718886+0000","last_clean":"2024-01-22T05:37:58.718886+0000","last_became_active":"2024-01-22T05:37:58.248217+0000","last_became_peered":"2024-01-22T05:37:58.248217+0000","last_unstale":"2024-01-22T05:37:58.718886+0000","last_undegraded":"2024-01-22T05:37:58.718886+0000","last_fullsized":"2024-01-22T05:37:58.718886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703823+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:37:58.703823+0000","last_peered":"2024-01-22T05:37:58.703823+0000","last_clean":"2024-01-22T05:37:58.703823+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:37:58.703823+0000","last_undegraded":"2024-01-22T05:37:58.703823+0000","last_fullsized":"2024-01-22T05:37:58.703823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.721675+0000","last_change":"2024-01-22T05:37:58.714917+0000","last_active":"2024-01-22T05:37:58.721675+0000","last_peered":"2024-01-22T05:37:58.721675+0000","last_clean":"2024-01-22T05:37:58.721675+0000","last_became_active":"2024-01-22T05:37:58.714575+0000","last_became_peered":"2024-01-22T05:37:58.714575+0000","last_unstale":"2024-01-22T05:37:58.721675+0000","last_undegraded":"2024-01-22T05:37:58.721675+0000","last_fullsized":"2024-01-22T05:37:58.721675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-22T05:37:54.035609+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:37:54.035609+0000","last_peered":"2024-01-22T05:37:54.035609+0000","last_clean":"2024-01-22T05:37:54.035609+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:37:54.035609+0000","last_undegraded":"2024-01-22T05:37:54.035609+0000","last_fullsized":"2024-01-22T05:37:54.035609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705408+0000","last_change":"2024-01-22T05:37:58.253114+0000","last_active":"2024-01-22T05:37:58.705408+0000","last_peered":"2024-01-22T05:37:58.705408+0000","last_clean":"2024-01-22T05:37:58.705408+0000","last_became_active":"2024-01-22T05:37:58.252823+0000","last_became_peered":"2024-01-22T05:37:58.252823+0000","last_unstale":"2024-01-22T05:37:58.705408+0000","last_undegraded":"2024-01-22T05:37:58.705408+0000","last_fullsized":"2024-01-22T05:37:58.705408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727511+0000","last_change":"2024-01-22T05:37:58.721226+0000","last_active":"2024-01-22T05:37:58.727511+0000","last_peered":"2024-01-22T05:37:58.727511+0000","last_clean":"2024-01-22T05:37:58.727511+0000","last_became_active":"2024-01-22T05:37:58.714690+0000","last_became_peered":"2024-01-22T05:37:58.714690+0000","last_unstale":"2024-01-22T05:37:58.727511+0000","last_undegraded":"2024-01-22T05:37:58.727511+0000","last_fullsized":"2024-01-22T05:37:58.727511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701838+0000","last_change":"2024-01-22T05:37:58.253254+0000","last_active":"2024-01-22T05:37:58.701838+0000","last_peered":"2024-01-22T05:37:58.701838+0000","last_clean":"2024-01-22T05:37:58.701838+0000","last_became_active":"2024-01-22T05:37:58.252839+0000","last_became_peered":"2024-01-22T05:37:58.252839+0000","last_unstale":"2024-01-22T05:37:58.701838+0000","last_undegraded":"2024-01-22T05:37:58.701838+0000","last_fullsized":"2024-01-22T05:37:58.701838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732648+0000","last_change":"2024-01-22T05:37:58.730288+0000","last_active":"2024-01-22T05:37:58.732648+0000","last_peered":"2024-01-22T05:37:58.732648+0000","last_clean":"2024-01-22T05:37:58.732648+0000","last_became_active":"2024-01-22T05:37:58.729963+0000","last_became_peered":"2024-01-22T05:37:58.729963+0000","last_unstale":"2024-01-22T05:37:58.732648+0000","last_undegraded":"2024-01-22T05:37:58.732648+0000","last_fullsized":"2024-01-22T05:37:58.732648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.720058+0000","last_change":"2024-01-22T05:37:58.252113+0000","last_active":"2024-01-22T05:37:58.720058+0000","last_peered":"2024-01-22T05:37:58.720058+0000","last_clean":"2024-01-22T05:37:58.720058+0000","last_became_active":"2024-01-22T05:37:58.251258+0000","last_became_peered":"2024-01-22T05:37:58.251258+0000","last_unstale":"2024-01-22T05:37:58.720058+0000","last_undegraded":"2024-01-22T05:37:58.720058+0000","last_fullsized":"2024-01-22T05:37:58.720058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732096+0000","last_change":"2024-01-22T05:37:58.724990+0000","last_active":"2024-01-22T05:37:58.732096+0000","last_peered":"2024-01-22T05:37:58.732096+0000","last_clean":"2024-01-22T05:37:58.732096+0000","last_became_active":"2024-01-22T05:37:58.724687+0000","last_became_peered":"2024-01-22T05:37:58.724687+0000","last_unstale":"2024-01-22T05:37:58.732096+0000","last_undegraded":"2024-01-22T05:37:58.732096+0000","last_fullsized":"2024-01-22T05:37:58.732096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732629+0000","last_change":"2024-01-22T05:37:58.729257+0000","last_active":"2024-01-22T05:37:58.732629+0000","last_peered":"2024-01-22T05:37:58.732629+0000","last_clean":"2024-01-22T05:37:58.732629+0000","last_became_active":"2024-01-22T05:37:58.728921+0000","last_became_peered":"2024-01-22T05:37:58.728921+0000","last_unstale":"2024-01-22T05:37:58.732629+0000","last_undegraded":"2024-01-22T05:37:58.732629+0000","last_fullsized":"2024-01-22T05:37:58.732629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727300+0000","last_change":"2024-01-22T05:37:58.720676+0000","last_active":"2024-01-22T05:37:58.727300+0000","last_peered":"2024-01-22T05:37:58.727300+0000","last_clean":"2024-01-22T05:37:58.727300+0000","last_became_active":"2024-01-22T05:37:58.720340+0000","last_became_peered":"2024-01-22T05:37:58.720340+0000","last_unstale":"2024-01-22T05:37:58.727300+0000","last_undegraded":"2024-01-22T05:37:58.727300+0000","last_fullsized":"2024-01-22T05:37:58.727300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:58.219613+0000","last_change":"2024-01-22T05:37:58.219613+0000","last_active":"2024-01-22T05:37:58.219613+0000","last_peered":"2024-01-22T05:37:58.219613+0000","last_clean":"2024-01-22T05:37:58.219613+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:58.219613+0000","last_undegraded":"2024-01-22T05:37:58.219613+0000","last_fullsized":"2024-01-22T05:37:58.219613+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:37:57.213781+0000","last_change":"2024-01-22T05:37:57.213781+0000","last_active":"2024-01-22T05:37:57.213781+0000","last_peered":"2024-01-22T05:37:57.213781+0000","last_clean":"2024-01-22T05:37:57.213781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:37:57.213781+0000","last_undegraded":"2024-01-22T05:37:57.213781+0000","last_fullsized":"2024-01-22T05:37:57.213781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":6,"up_from":14,"seq":60129542146,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542146,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":76523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":50575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542146,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:38:02.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:38:03.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.161+0000 7f3c09c00700 1 Processor -- start 2024-01-22T05:38:03.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.161+0000 7f3c09c00700 1 -- start start 2024-01-22T05:38:03.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.162+0000 7f3c09c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c041543d0 0x7f3c040a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.162+0000 7f3c09c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c040aa220 0x7f3c040c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c09c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c040c66e0 con 0x7f3c04153ff0 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c09c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c040c0750 con 0x7f3c041543d0 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c09c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040aa6b0 con 0x7f3c040aa220 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c041543d0 0x7f3c040a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c041543d0 0x7f3c040a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55062/0 (socket says 172.21.15.100:55062) 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 -- 172.21.15.100:0/3904595410 learned_addr learned my addr 172.21.15.100:0/3904595410 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c03400700 1 --2- 172.21.15.100:0/3904595410 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c040aa220 0x7f3c040c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 -- 172.21.15.100:0/3904595410 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c040aa220 msgr2=0x7f3c040c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 --2- 172.21.15.100:0/3904595410 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c040aa220 0x7f3c040c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 -- 172.21.15.100:0/3904595410 >> v1:172.21.15.169:6789/0 conn(0x7f3c04153ff0 legacy=0x7f3c040c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 -- 172.21.15.100:0/3904595410 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c040bfe20 con 0x7f3c041543d0 2024-01-22T05:38:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c03400700 1 --2- 172.21.15.100:0/3904595410 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c040aa220 0x7f3c040c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.163+0000 7f3c02000700 1 --2- 172.21.15.100:0/3904595410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c041543d0 0x7f3c040a9d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3bec006fd0 tx=0x7f3bec0090f0).ready entity=mon.0 client_cookie=c44291b0cbcec852 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c01600700 1 -- 172.21.15.100:0/3904595410 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00b600 con 0x7f3c041543d0 2024-01-22T05:38:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c01600700 1 -- 172.21.15.100:0/3904595410 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00b760 con 0x7f3c041543d0 2024-01-22T05:38:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c01600700 1 -- 172.21.15.100:0/3904595410 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00bae0 con 0x7f3c041543d0 2024-01-22T05:38:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 -- 172.21.15.100:0/3904595410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c041543d0 msgr2=0x7f3c040a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 --2- 172.21.15.100:0/3904595410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c041543d0 0x7f3c040a9d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3bec006fd0 tx=0x7f3bec0090f0).stop 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 -- 172.21.15.100:0/3904595410 shutdown_connections 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 --2- 172.21.15.100:0/3904595410 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c040aa220 0x7f3c040c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 --2- 172.21.15.100:0/3904595410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c041543d0 0x7f3c040a9d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 -- 172.21.15.100:0/3904595410 >> 172.21.15.100:0/3904595410 conn(0x7f3c040c82a0 msgr2=0x7f3c0405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 -- 172.21.15.100:0/3904595410 shutdown_connections 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.164+0000 7f3c09c00700 1 -- 172.21.15.100:0/3904595410 wait complete. 2024-01-22T05:38:03.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.166+0000 7f3c09c00700 1 Processor -- start 2024-01-22T05:38:03.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.167+0000 7f3c09c00700 1 -- start start 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c09c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c040aa220 0x7f3c040b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c09c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c04153ff0 0x7f3c0414d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c09c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c041543d0 0x7f3c040c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c09c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c04153240 con 0x7f3c040aa220 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c09c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0414e3a0 con 0x7f3c04153ff0 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c09c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040c1f60 con 0x7f3c041543d0 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c040aa220 0x7f3c040b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c040aa220 0x7f3c040b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55070/0 (socket says 172.21.15.100:55070) 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 -- 172.21.15.100:0/1700541998 learned_addr learned my addr 172.21.15.100:0/1700541998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02000700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c04153ff0 0x7f3c0414d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c03400700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c041543d0 0x7f3c040c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 -- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c041543d0 msgr2=0x7f3c040c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c041543d0 0x7f3c040c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 -- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c04153ff0 msgr2=0x7f3c0414d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c04153ff0 0x7f3c0414d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.168+0000 7f3c02a00700 1 -- 172.21.15.100:0/1700541998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec009370 con 0x7f3c040aa220 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.169+0000 7f3c02a00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c040aa220 0x7f3c040b0700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3bf400c440 tx=0x7f3bf4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.169+0000 7f3bfa000700 1 -- 172.21.15.100:0/1700541998 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400f470 con 0x7f3c040aa220 2024-01-22T05:38:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.169+0000 7f3bfa000700 1 -- 172.21.15.100:0/1700541998 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf400f5f0 con 0x7f3c040aa220 2024-01-22T05:38:03.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.169+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c040c2240 con 0x7f3c040aa220 2024-01-22T05:38:03.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.169+0000 7f3bfa000700 1 -- 172.21.15.100:0/1700541998 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400f9b0 con 0x7f3c040aa220 2024-01-22T05:38:03.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.169+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c040c2800 con 0x7f3c040aa220 2024-01-22T05:38:03.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.170+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c040c29f0 con 0x7f3c040aa220 2024-01-22T05:38:03.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.171+0000 7f3bfa000700 1 -- 172.21.15.100:0/1700541998 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3bf4012400 con 0x7f3c040aa220 2024-01-22T05:38:03.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.172+0000 7f3bfa000700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3bdc05f150 0x7f3bdc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.172+0000 7f3bfa000700 1 -- 172.21.15.100:0/1700541998 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3bf4079720 con 0x7f3c040aa220 2024-01-22T05:38:03.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.172+0000 7f3c02000700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3bdc05f150 0x7f3bdc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.172+0000 7f3c02000700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3bdc05f150 0x7f3bdc061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3bec009130 tx=0x7f3bec017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:03.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.175+0000 7f3bfa000700 1 -- 172.21.15.100:0/1700541998 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3bf4048b00 con 0x7f3c040aa220 2024-01-22T05:38:03.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.342+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c0405fdb0 con 0x7f3bdc05f150 2024-01-22T05:38:03.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.352+0000 7f3bfa000700 1 -- 172.21.15.100:0/1700541998 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336459 (secure 0 0 0) 0x7f3c0405fdb0 con 0x7f3bdc05f150 2024-01-22T05:38:03.356 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:03.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3bdc05f150 msgr2=0x7f3bdc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3bdc05f150 0x7f3bdc061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3bec009130 tx=0x7f3bec017000).stop 2024-01-22T05:38:03.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c040aa220 msgr2=0x7f3c040b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c040aa220 0x7f3c040b0700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3bf400c440 tx=0x7f3bf4007de0).stop 2024-01-22T05:38:03.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 shutdown_connections 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3bdc05f150 0x7f3bdc061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c041543d0 0x7f3c040c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c040aa220 0x7f3c040b0700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 --2- 172.21.15.100:0/1700541998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c04153ff0 0x7f3c0414d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.356+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 >> 172.21.15.100:0/1700541998 conn(0x7f3c040c82a0 msgr2=0x7f3c040c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.357+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 shutdown_connections 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.357+0000 7f3c09c00700 1 -- 172.21.15.100:0/1700541998 wait complete. 2024-01-22T05:38:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:38:03.373 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-22T05:38:03.130709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378544,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596176,"statfs":{"total":773094113280,"available":770658484224,"internally_reserved":0,"allocated":1818624,"data_stored":643052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000442"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729846+0000","last_change":"2024-01-22T05:37:58.727081+0000","last_active":"2024-01-22T05:37:58.729846+0000","last_peered":"2024-01-22T05:37:58.729846+0000","last_clean":"2024-01-22T05:37:58.729846+0000","last_became_active":"2024-01-22T05:37:58.725736+0000","last_became_peered":"2024-01-22T05:37:58.725736+0000","last_unstale":"2024-01-22T05:37:58.729846+0000","last_undegraded":"2024-01-22T05:37:58.729846+0000","last_fullsized":"2024-01-22T05:37:58.729846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689450+0000","last_change":"2024-01-22T05:37:58.259700+0000","last_active":"2024-01-22T05:37:58.689450+0000","last_peered":"2024-01-22T05:37:58.689450+0000","last_clean":"2024-01-22T05:37:58.689450+0000","last_became_active":"2024-01-22T05:37:58.259421+0000","last_became_peered":"2024-01-22T05:37:58.259421+0000","last_unstale":"2024-01-22T05:37:58.689450+0000","last_undegraded":"2024-01-22T05:37:58.689450+0000","last_fullsized":"2024-01-22T05:37:58.689450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727312+0000","last_change":"2024-01-22T05:37:58.720751+0000","last_active":"2024-01-22T05:37:58.727312+0000","last_peered":"2024-01-22T05:37:58.727312+0000","last_clean":"2024-01-22T05:37:58.727312+0000","last_became_active":"2024-01-22T05:37:58.720447+0000","last_became_peered":"2024-01-22T05:37:58.720447+0000","last_unstale":"2024-01-22T05:37:58.727312+0000","last_undegraded":"2024-01-22T05:37:58.727312+0000","last_fullsized":"2024-01-22T05:37:58.727312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696152+0000","last_change":"2024-01-22T05:37:58.248478+0000","last_active":"2024-01-22T05:37:58.696152+0000","last_peered":"2024-01-22T05:37:58.696152+0000","last_clean":"2024-01-22T05:37:58.696152+0000","last_became_active":"2024-01-22T05:37:58.248115+0000","last_became_peered":"2024-01-22T05:37:58.248115+0000","last_unstale":"2024-01-22T05:37:58.696152+0000","last_undegraded":"2024-01-22T05:37:58.696152+0000","last_fullsized":"2024-01-22T05:37:58.696152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730986+0000","last_change":"2024-01-22T05:37:58.728642+0000","last_active":"2024-01-22T05:37:58.730986+0000","last_peered":"2024-01-22T05:37:58.730986+0000","last_clean":"2024-01-22T05:37:58.730986+0000","last_became_active":"2024-01-22T05:37:58.728277+0000","last_became_peered":"2024-01-22T05:37:58.728277+0000","last_unstale":"2024-01-22T05:37:58.730986+0000","last_undegraded":"2024-01-22T05:37:58.730986+0000","last_fullsized":"2024-01-22T05:37:58.730986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702519+0000","last_change":"2024-01-22T05:37:58.248744+0000","last_active":"2024-01-22T05:37:58.702519+0000","last_peered":"2024-01-22T05:37:58.702519+0000","last_clean":"2024-01-22T05:37:58.702519+0000","last_became_active":"2024-01-22T05:37:58.248261+0000","last_became_peered":"2024-01-22T05:37:58.248261+0000","last_unstale":"2024-01-22T05:37:58.702519+0000","last_undegraded":"2024-01-22T05:37:58.702519+0000","last_fullsized":"2024-01-22T05:37:58.702519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707363+0000","last_change":"2024-01-22T05:37:58.705253+0000","last_active":"2024-01-22T05:37:58.707363+0000","last_peered":"2024-01-22T05:37:58.707363+0000","last_clean":"2024-01-22T05:37:58.707363+0000","last_became_active":"2024-01-22T05:37:58.704907+0000","last_became_peered":"2024-01-22T05:37:58.704907+0000","last_unstale":"2024-01-22T05:37:58.707363+0000","last_undegraded":"2024-01-22T05:37:58.707363+0000","last_fullsized":"2024-01-22T05:37:58.707363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702127+0000","last_change":"2024-01-22T05:37:58.263344+0000","last_active":"2024-01-22T05:37:58.702127+0000","last_peered":"2024-01-22T05:37:58.702127+0000","last_clean":"2024-01-22T05:37:58.702127+0000","last_became_active":"2024-01-22T05:37:58.263056+0000","last_became_peered":"2024-01-22T05:37:58.263056+0000","last_unstale":"2024-01-22T05:37:58.702127+0000","last_undegraded":"2024-01-22T05:37:58.702127+0000","last_fullsized":"2024-01-22T05:37:58.702127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726308+0000","last_change":"2024-01-22T05:37:58.720495+0000","last_active":"2024-01-22T05:37:58.726308+0000","last_peered":"2024-01-22T05:37:58.726308+0000","last_clean":"2024-01-22T05:37:58.726308+0000","last_became_active":"2024-01-22T05:37:58.713824+0000","last_became_peered":"2024-01-22T05:37:58.713824+0000","last_unstale":"2024-01-22T05:37:58.726308+0000","last_undegraded":"2024-01-22T05:37:58.726308+0000","last_fullsized":"2024-01-22T05:37:58.726308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700930+0000","last_change":"2024-01-22T05:37:58.264631+0000","last_active":"2024-01-22T05:37:58.700930+0000","last_peered":"2024-01-22T05:37:58.700930+0000","last_clean":"2024-01-22T05:37:58.700930+0000","last_became_active":"2024-01-22T05:37:58.264164+0000","last_became_peered":"2024-01-22T05:37:58.264164+0000","last_unstale":"2024-01-22T05:37:58.700930+0000","last_undegraded":"2024-01-22T05:37:58.700930+0000","last_fullsized":"2024-01-22T05:37:58.700930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716320+0000","last_change":"2024-01-22T05:37:58.712852+0000","last_active":"2024-01-22T05:37:58.716320+0000","last_peered":"2024-01-22T05:37:58.716320+0000","last_clean":"2024-01-22T05:37:58.716320+0000","last_became_active":"2024-01-22T05:37:58.712580+0000","last_became_peered":"2024-01-22T05:37:58.712580+0000","last_unstale":"2024-01-22T05:37:58.716320+0000","last_undegraded":"2024-01-22T05:37:58.716320+0000","last_fullsized":"2024-01-22T05:37:58.716320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718571+0000","last_change":"2024-01-22T05:37:58.250312+0000","last_active":"2024-01-22T05:37:58.718571+0000","last_peered":"2024-01-22T05:37:58.718571+0000","last_clean":"2024-01-22T05:37:58.718571+0000","last_became_active":"2024-01-22T05:37:58.250058+0000","last_became_peered":"2024-01-22T05:37:58.250058+0000","last_unstale":"2024-01-22T05:37:58.718571+0000","last_undegraded":"2024-01-22T05:37:58.718571+0000","last_fullsized":"2024-01-22T05:37:58.718571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723610+0000","last_change":"2024-01-22T05:37:58.720917+0000","last_active":"2024-01-22T05:37:58.723610+0000","last_peered":"2024-01-22T05:37:58.723610+0000","last_clean":"2024-01-22T05:37:58.723610+0000","last_became_active":"2024-01-22T05:37:58.720566+0000","last_became_peered":"2024-01-22T05:37:58.720566+0000","last_unstale":"2024-01-22T05:37:58.723610+0000","last_undegraded":"2024-01-22T05:37:58.723610+0000","last_fullsized":"2024-01-22T05:37:58.723610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727860+0000","last_change":"2024-01-22T05:37:58.262225+0000","last_active":"2024-01-22T05:37:58.727860+0000","last_peered":"2024-01-22T05:37:58.727860+0000","last_clean":"2024-01-22T05:37:58.727860+0000","last_became_active":"2024-01-22T05:37:58.261931+0000","last_became_peered":"2024-01-22T05:37:58.261931+0000","last_unstale":"2024-01-22T05:37:58.727860+0000","last_undegraded":"2024-01-22T05:37:58.727860+0000","last_fullsized":"2024-01-22T05:37:58.727860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716463+0000","last_change":"2024-01-22T05:37:58.713713+0000","last_active":"2024-01-22T05:37:58.716463+0000","last_peered":"2024-01-22T05:37:58.716463+0000","last_clean":"2024-01-22T05:37:58.716463+0000","last_became_active":"2024-01-22T05:37:58.713222+0000","last_became_peered":"2024-01-22T05:37:58.713222+0000","last_unstale":"2024-01-22T05:37:58.716463+0000","last_undegraded":"2024-01-22T05:37:58.716463+0000","last_fullsized":"2024-01-22T05:37:58.716463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.725718+0000","last_change":"2024-01-22T05:37:58.263422+0000","last_active":"2024-01-22T05:37:58.725718+0000","last_peered":"2024-01-22T05:37:58.725718+0000","last_clean":"2024-01-22T05:37:58.725718+0000","last_became_active":"2024-01-22T05:37:58.263038+0000","last_became_peered":"2024-01-22T05:37:58.263038+0000","last_unstale":"2024-01-22T05:37:58.725718+0000","last_undegraded":"2024-01-22T05:37:58.725718+0000","last_fullsized":"2024-01-22T05:37:58.725718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724388+0000","last_change":"2024-01-22T05:37:58.720659+0000","last_active":"2024-01-22T05:37:58.724388+0000","last_peered":"2024-01-22T05:37:58.724388+0000","last_clean":"2024-01-22T05:37:58.724388+0000","last_became_active":"2024-01-22T05:37:58.720356+0000","last_became_peered":"2024-01-22T05:37:58.720356+0000","last_unstale":"2024-01-22T05:37:58.724388+0000","last_undegraded":"2024-01-22T05:37:58.724388+0000","last_fullsized":"2024-01-22T05:37:58.724388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700696+0000","last_change":"2024-01-22T05:37:58.266202+0000","last_active":"2024-01-22T05:37:58.700696+0000","last_peered":"2024-01-22T05:37:58.700696+0000","last_clean":"2024-01-22T05:37:58.700696+0000","last_became_active":"2024-01-22T05:37:58.265864+0000","last_became_peered":"2024-01-22T05:37:58.265864+0000","last_unstale":"2024-01-22T05:37:58.700696+0000","last_undegraded":"2024-01-22T05:37:58.700696+0000","last_fullsized":"2024-01-22T05:37:58.700696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729642+0000","last_change":"2024-01-22T05:37:58.724022+0000","last_active":"2024-01-22T05:37:58.729642+0000","last_peered":"2024-01-22T05:37:58.729642+0000","last_clean":"2024-01-22T05:37:58.729642+0000","last_became_active":"2024-01-22T05:37:58.723620+0000","last_became_peered":"2024-01-22T05:37:58.723620+0000","last_unstale":"2024-01-22T05:37:58.729642+0000","last_undegraded":"2024-01-22T05:37:58.729642+0000","last_fullsized":"2024-01-22T05:37:58.729642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705714+0000","last_change":"2024-01-22T05:37:58.256227+0000","last_active":"2024-01-22T05:37:58.705714+0000","last_peered":"2024-01-22T05:37:58.705714+0000","last_clean":"2024-01-22T05:37:58.705714+0000","last_became_active":"2024-01-22T05:37:58.255884+0000","last_became_peered":"2024-01-22T05:37:58.255884+0000","last_unstale":"2024-01-22T05:37:58.705714+0000","last_undegraded":"2024-01-22T05:37:58.705714+0000","last_fullsized":"2024-01-22T05:37:58.705714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729732+0000","last_change":"2024-01-22T05:37:58.723121+0000","last_active":"2024-01-22T05:37:58.729732+0000","last_peered":"2024-01-22T05:37:58.729732+0000","last_clean":"2024-01-22T05:37:58.729732+0000","last_became_active":"2024-01-22T05:37:58.722807+0000","last_became_peered":"2024-01-22T05:37:58.722807+0000","last_unstale":"2024-01-22T05:37:58.729732+0000","last_undegraded":"2024-01-22T05:37:58.729732+0000","last_fullsized":"2024-01-22T05:37:58.729732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728450+0000","last_change":"2024-01-22T05:37:58.258876+0000","last_active":"2024-01-22T05:37:58.728450+0000","last_peered":"2024-01-22T05:37:58.728450+0000","last_clean":"2024-01-22T05:37:58.728450+0000","last_became_active":"2024-01-22T05:37:58.258599+0000","last_became_peered":"2024-01-22T05:37:58.258599+0000","last_unstale":"2024-01-22T05:37:58.728450+0000","last_undegraded":"2024-01-22T05:37:58.728450+0000","last_fullsized":"2024-01-22T05:37:58.728450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723711+0000","last_change":"2024-01-22T05:37:58.715284+0000","last_active":"2024-01-22T05:37:58.723711+0000","last_peered":"2024-01-22T05:37:58.723711+0000","last_clean":"2024-01-22T05:37:58.723711+0000","last_became_active":"2024-01-22T05:37:58.715003+0000","last_became_peered":"2024-01-22T05:37:58.715003+0000","last_unstale":"2024-01-22T05:37:58.723711+0000","last_undegraded":"2024-01-22T05:37:58.723711+0000","last_fullsized":"2024-01-22T05:37:58.723711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718376+0000","last_change":"2024-01-22T05:37:58.253681+0000","last_active":"2024-01-22T05:37:58.718376+0000","last_peered":"2024-01-22T05:37:58.718376+0000","last_clean":"2024-01-22T05:37:58.718376+0000","last_became_active":"2024-01-22T05:37:58.252995+0000","last_became_peered":"2024-01-22T05:37:58.252995+0000","last_unstale":"2024-01-22T05:37:58.718376+0000","last_undegraded":"2024-01-22T05:37:58.718376+0000","last_fullsized":"2024-01-22T05:37:58.718376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722299+0000","last_change":"2024-01-22T05:37:58.718097+0000","last_active":"2024-01-22T05:37:58.722299+0000","last_peered":"2024-01-22T05:37:58.722299+0000","last_clean":"2024-01-22T05:37:58.722299+0000","last_became_active":"2024-01-22T05:37:58.717375+0000","last_became_peered":"2024-01-22T05:37:58.717375+0000","last_unstale":"2024-01-22T05:37:58.722299+0000","last_undegraded":"2024-01-22T05:37:58.722299+0000","last_fullsized":"2024-01-22T05:37:58.722299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719556+0000","last_change":"2024-01-22T05:37:58.257304+0000","last_active":"2024-01-22T05:37:58.719556+0000","last_peered":"2024-01-22T05:37:58.719556+0000","last_clean":"2024-01-22T05:37:58.719556+0000","last_became_active":"2024-01-22T05:37:58.257020+0000","last_became_peered":"2024-01-22T05:37:58.257020+0000","last_unstale":"2024-01-22T05:37:58.719556+0000","last_undegraded":"2024-01-22T05:37:58.719556+0000","last_fullsized":"2024-01-22T05:37:58.719556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717620+0000","last_change":"2024-01-22T05:37:58.713314+0000","last_active":"2024-01-22T05:37:58.717620+0000","last_peered":"2024-01-22T05:37:58.717620+0000","last_clean":"2024-01-22T05:37:58.717620+0000","last_became_active":"2024-01-22T05:37:58.713006+0000","last_became_peered":"2024-01-22T05:37:58.713006+0000","last_unstale":"2024-01-22T05:37:58.717620+0000","last_undegraded":"2024-01-22T05:37:58.717620+0000","last_fullsized":"2024-01-22T05:37:58.717620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714189+0000","last_change":"2024-01-22T05:37:58.262212+0000","last_active":"2024-01-22T05:37:58.714189+0000","last_peered":"2024-01-22T05:37:58.714189+0000","last_clean":"2024-01-22T05:37:58.714189+0000","last_became_active":"2024-01-22T05:37:58.261871+0000","last_became_peered":"2024-01-22T05:37:58.261871+0000","last_unstale":"2024-01-22T05:37:58.714189+0000","last_undegraded":"2024-01-22T05:37:58.714189+0000","last_fullsized":"2024-01-22T05:37:58.714189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724071+0000","last_change":"2024-01-22T05:37:58.716253+0000","last_active":"2024-01-22T05:37:58.724071+0000","last_peered":"2024-01-22T05:37:58.724071+0000","last_clean":"2024-01-22T05:37:58.724071+0000","last_became_active":"2024-01-22T05:37:58.715943+0000","last_became_peered":"2024-01-22T05:37:58.715943+0000","last_unstale":"2024-01-22T05:37:58.724071+0000","last_undegraded":"2024-01-22T05:37:58.724071+0000","last_fullsized":"2024-01-22T05:37:58.724071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697258+0000","last_change":"2024-01-22T05:37:58.260069+0000","last_active":"2024-01-22T05:37:58.697258+0000","last_peered":"2024-01-22T05:37:58.697258+0000","last_clean":"2024-01-22T05:37:58.697258+0000","last_became_active":"2024-01-22T05:37:58.257371+0000","last_became_peered":"2024-01-22T05:37:58.257371+0000","last_unstale":"2024-01-22T05:37:58.697258+0000","last_undegraded":"2024-01-22T05:37:58.697258+0000","last_fullsized":"2024-01-22T05:37:58.697258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723329+0000","last_change":"2024-01-22T05:37:58.713209+0000","last_active":"2024-01-22T05:37:58.723329+0000","last_peered":"2024-01-22T05:37:58.723329+0000","last_clean":"2024-01-22T05:37:58.723329+0000","last_became_active":"2024-01-22T05:37:58.712865+0000","last_became_peered":"2024-01-22T05:37:58.712865+0000","last_unstale":"2024-01-22T05:37:58.723329+0000","last_undegraded":"2024-01-22T05:37:58.723329+0000","last_fullsized":"2024-01-22T05:37:58.723329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715117+0000","last_change":"2024-01-22T05:37:58.261836+0000","last_active":"2024-01-22T05:37:58.715117+0000","last_peered":"2024-01-22T05:37:58.715117+0000","last_clean":"2024-01-22T05:37:58.715117+0000","last_became_active":"2024-01-22T05:37:58.261533+0000","last_became_peered":"2024-01-22T05:37:58.261533+0000","last_unstale":"2024-01-22T05:37:58.715117+0000","last_undegraded":"2024-01-22T05:37:58.715117+0000","last_fullsized":"2024-01-22T05:37:58.715117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730485+0000","last_change":"2024-01-22T05:37:58.724748+0000","last_active":"2024-01-22T05:37:58.730485+0000","last_peered":"2024-01-22T05:37:58.730485+0000","last_clean":"2024-01-22T05:37:58.730485+0000","last_became_active":"2024-01-22T05:37:58.724181+0000","last_became_peered":"2024-01-22T05:37:58.724181+0000","last_unstale":"2024-01-22T05:37:58.730485+0000","last_undegraded":"2024-01-22T05:37:58.730485+0000","last_fullsized":"2024-01-22T05:37:58.730485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709832+0000","last_change":"2024-01-22T05:37:58.257196+0000","last_active":"2024-01-22T05:37:58.709832+0000","last_peered":"2024-01-22T05:37:58.709832+0000","last_clean":"2024-01-22T05:37:58.709832+0000","last_became_active":"2024-01-22T05:37:58.256932+0000","last_became_peered":"2024-01-22T05:37:58.256932+0000","last_unstale":"2024-01-22T05:37:58.709832+0000","last_undegraded":"2024-01-22T05:37:58.709832+0000","last_fullsized":"2024-01-22T05:37:58.709832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724590+0000","last_change":"2024-01-22T05:37:58.720229+0000","last_active":"2024-01-22T05:37:58.724590+0000","last_peered":"2024-01-22T05:37:58.724590+0000","last_clean":"2024-01-22T05:37:58.724590+0000","last_became_active":"2024-01-22T05:37:58.719862+0000","last_became_peered":"2024-01-22T05:37:58.719862+0000","last_unstale":"2024-01-22T05:37:58.724590+0000","last_undegraded":"2024-01-22T05:37:58.724590+0000","last_fullsized":"2024-01-22T05:37:58.724590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709188+0000","last_change":"2024-01-22T05:37:58.263404+0000","last_active":"2024-01-22T05:37:58.709188+0000","last_peered":"2024-01-22T05:37:58.709188+0000","last_clean":"2024-01-22T05:37:58.709188+0000","last_became_active":"2024-01-22T05:37:58.263016+0000","last_became_peered":"2024-01-22T05:37:58.263016+0000","last_unstale":"2024-01-22T05:37:58.709188+0000","last_undegraded":"2024-01-22T05:37:58.709188+0000","last_fullsized":"2024-01-22T05:37:58.709188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719869+0000","last_change":"2024-01-22T05:37:58.717161+0000","last_active":"2024-01-22T05:37:58.719869+0000","last_peered":"2024-01-22T05:37:58.719869+0000","last_clean":"2024-01-22T05:37:58.719869+0000","last_became_active":"2024-01-22T05:37:58.716723+0000","last_became_peered":"2024-01-22T05:37:58.716723+0000","last_unstale":"2024-01-22T05:37:58.719869+0000","last_undegraded":"2024-01-22T05:37:58.719869+0000","last_fullsized":"2024-01-22T05:37:58.719869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703194+0000","last_change":"2024-01-22T05:37:58.247858+0000","last_active":"2024-01-22T05:37:58.703194+0000","last_peered":"2024-01-22T05:37:58.703194+0000","last_clean":"2024-01-22T05:37:58.703194+0000","last_became_active":"2024-01-22T05:37:58.247562+0000","last_became_peered":"2024-01-22T05:37:58.247562+0000","last_unstale":"2024-01-22T05:37:58.703194+0000","last_undegraded":"2024-01-22T05:37:58.703194+0000","last_fullsized":"2024-01-22T05:37:58.703194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701497+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:37:58.701497+0000","last_peered":"2024-01-22T05:37:58.701497+0000","last_clean":"2024-01-22T05:37:58.701497+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:37:58.701497+0000","last_undegraded":"2024-01-22T05:37:58.701497+0000","last_fullsized":"2024-01-22T05:37:58.701497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700257+0000","last_change":"2024-01-22T05:37:58.252358+0000","last_active":"2024-01-22T05:37:58.700257+0000","last_peered":"2024-01-22T05:37:58.700257+0000","last_clean":"2024-01-22T05:37:58.700257+0000","last_became_active":"2024-01-22T05:37:58.248516+0000","last_became_peered":"2024-01-22T05:37:58.248516+0000","last_unstale":"2024-01-22T05:37:58.700257+0000","last_undegraded":"2024-01-22T05:37:58.700257+0000","last_fullsized":"2024-01-22T05:37:58.700257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726815+0000","last_change":"2024-01-22T05:37:58.721521+0000","last_active":"2024-01-22T05:37:58.726815+0000","last_peered":"2024-01-22T05:37:58.726815+0000","last_clean":"2024-01-22T05:37:58.726815+0000","last_became_active":"2024-01-22T05:37:58.721152+0000","last_became_peered":"2024-01-22T05:37:58.721152+0000","last_unstale":"2024-01-22T05:37:58.726815+0000","last_undegraded":"2024-01-22T05:37:58.726815+0000","last_fullsized":"2024-01-22T05:37:58.726815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.708232+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:37:58.708232+0000","last_peered":"2024-01-22T05:37:58.708232+0000","last_clean":"2024-01-22T05:37:58.708232+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:37:58.708232+0000","last_undegraded":"2024-01-22T05:37:58.708232+0000","last_fullsized":"2024-01-22T05:37:58.708232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696621+0000","last_change":"2024-01-22T05:37:58.252041+0000","last_active":"2024-01-22T05:37:58.696621+0000","last_peered":"2024-01-22T05:37:58.696621+0000","last_clean":"2024-01-22T05:37:58.696621+0000","last_became_active":"2024-01-22T05:37:58.251676+0000","last_became_peered":"2024-01-22T05:37:58.251676+0000","last_unstale":"2024-01-22T05:37:58.696621+0000","last_undegraded":"2024-01-22T05:37:58.696621+0000","last_fullsized":"2024-01-22T05:37:58.696621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715221+0000","last_change":"2024-01-22T05:37:58.707436+0000","last_active":"2024-01-22T05:37:58.715221+0000","last_peered":"2024-01-22T05:37:58.715221+0000","last_clean":"2024-01-22T05:37:58.715221+0000","last_became_active":"2024-01-22T05:37:58.707144+0000","last_became_peered":"2024-01-22T05:37:58.707144+0000","last_unstale":"2024-01-22T05:37:58.715221+0000","last_undegraded":"2024-01-22T05:37:58.715221+0000","last_fullsized":"2024-01-22T05:37:58.715221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718108+0000","last_change":"2024-01-22T05:37:58.716084+0000","last_active":"2024-01-22T05:37:58.718108+0000","last_peered":"2024-01-22T05:37:58.718108+0000","last_clean":"2024-01-22T05:37:58.718108+0000","last_became_active":"2024-01-22T05:37:58.715755+0000","last_became_peered":"2024-01-22T05:37:58.715755+0000","last_unstale":"2024-01-22T05:37:58.718108+0000","last_undegraded":"2024-01-22T05:37:58.718108+0000","last_fullsized":"2024-01-22T05:37:58.718108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.695763+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:37:58.695763+0000","last_peered":"2024-01-22T05:37:58.695763+0000","last_clean":"2024-01-22T05:37:58.695763+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:37:58.695763+0000","last_undegraded":"2024-01-22T05:37:58.695763+0000","last_fullsized":"2024-01-22T05:37:58.695763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702299+0000","last_change":"2024-01-22T05:37:58.255676+0000","last_active":"2024-01-22T05:37:58.702299+0000","last_peered":"2024-01-22T05:37:58.702299+0000","last_clean":"2024-01-22T05:37:58.702299+0000","last_became_active":"2024-01-22T05:37:58.253263+0000","last_became_peered":"2024-01-22T05:37:58.253263+0000","last_unstale":"2024-01-22T05:37:58.702299+0000","last_undegraded":"2024-01-22T05:37:58.702299+0000","last_fullsized":"2024-01-22T05:37:58.702299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724371+0000","last_change":"2024-01-22T05:37:58.720166+0000","last_active":"2024-01-22T05:37:58.724371+0000","last_peered":"2024-01-22T05:37:58.724371+0000","last_clean":"2024-01-22T05:37:58.724371+0000","last_became_active":"2024-01-22T05:37:58.719849+0000","last_became_peered":"2024-01-22T05:37:58.719849+0000","last_unstale":"2024-01-22T05:37:58.724371+0000","last_undegraded":"2024-01-22T05:37:58.724371+0000","last_fullsized":"2024-01-22T05:37:58.724371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705514+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:37:58.705514+0000","last_peered":"2024-01-22T05:37:58.705514+0000","last_clean":"2024-01-22T05:37:58.705514+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:37:58.705514+0000","last_undegraded":"2024-01-22T05:37:58.705514+0000","last_fullsized":"2024-01-22T05:37:58.705514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.688444+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:37:58.688444+0000","last_peered":"2024-01-22T05:37:58.688444+0000","last_clean":"2024-01-22T05:37:58.688444+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:37:58.688444+0000","last_undegraded":"2024-01-22T05:37:58.688444+0000","last_fullsized":"2024-01-22T05:37:58.688444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.694912+0000","last_change":"2024-01-22T05:37:58.248432+0000","last_active":"2024-01-22T05:37:58.694912+0000","last_peered":"2024-01-22T05:37:58.694912+0000","last_clean":"2024-01-22T05:37:58.694912+0000","last_became_active":"2024-01-22T05:37:58.248051+0000","last_became_peered":"2024-01-22T05:37:58.248051+0000","last_unstale":"2024-01-22T05:37:58.694912+0000","last_undegraded":"2024-01-22T05:37:58.694912+0000","last_fullsized":"2024-01-22T05:37:58.694912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732489+0000","last_change":"2024-01-22T05:37:58.726657+0000","last_active":"2024-01-22T05:37:58.732489+0000","last_peered":"2024-01-22T05:37:58.732489+0000","last_clean":"2024-01-22T05:37:58.732489+0000","last_became_active":"2024-01-22T05:37:58.724582+0000","last_became_peered":"2024-01-22T05:37:58.724582+0000","last_unstale":"2024-01-22T05:37:58.732489+0000","last_undegraded":"2024-01-22T05:37:58.732489+0000","last_fullsized":"2024-01-22T05:37:58.732489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704038+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:37:58.704038+0000","last_peered":"2024-01-22T05:37:58.704038+0000","last_clean":"2024-01-22T05:37:58.704038+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:37:58.704038+0000","last_undegraded":"2024-01-22T05:37:58.704038+0000","last_fullsized":"2024-01-22T05:37:58.704038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699091+0000","last_change":"2024-01-22T05:37:58.244890+0000","last_active":"2024-01-22T05:37:58.699091+0000","last_peered":"2024-01-22T05:37:58.699091+0000","last_clean":"2024-01-22T05:37:58.699091+0000","last_became_active":"2024-01-22T05:37:58.244624+0000","last_became_peered":"2024-01-22T05:37:58.244624+0000","last_unstale":"2024-01-22T05:37:58.699091+0000","last_undegraded":"2024-01-22T05:37:58.699091+0000","last_fullsized":"2024-01-22T05:37:58.699091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714275+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:37:58.714275+0000","last_peered":"2024-01-22T05:37:58.714275+0000","last_clean":"2024-01-22T05:37:58.714275+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:37:58.714275+0000","last_undegraded":"2024-01-22T05:37:58.714275+0000","last_fullsized":"2024-01-22T05:37:58.714275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704938+0000","last_change":"2024-01-22T05:37:58.256019+0000","last_active":"2024-01-22T05:37:58.704938+0000","last_peered":"2024-01-22T05:37:58.704938+0000","last_clean":"2024-01-22T05:37:58.704938+0000","last_became_active":"2024-01-22T05:37:58.255206+0000","last_became_peered":"2024-01-22T05:37:58.255206+0000","last_unstale":"2024-01-22T05:37:58.704938+0000","last_undegraded":"2024-01-22T05:37:58.704938+0000","last_fullsized":"2024-01-22T05:37:58.704938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716866+0000","last_change":"2024-01-22T05:37:58.715826+0000","last_active":"2024-01-22T05:37:58.716866+0000","last_peered":"2024-01-22T05:37:58.716866+0000","last_clean":"2024-01-22T05:37:58.716866+0000","last_became_active":"2024-01-22T05:37:58.715462+0000","last_became_peered":"2024-01-22T05:37:58.715462+0000","last_unstale":"2024-01-22T05:37:58.716866+0000","last_undegraded":"2024-01-22T05:37:58.716866+0000","last_fullsized":"2024-01-22T05:37:58.716866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718886+0000","last_change":"2024-01-22T05:37:58.248570+0000","last_active":"2024-01-22T05:37:58.718886+0000","last_peered":"2024-01-22T05:37:58.718886+0000","last_clean":"2024-01-22T05:37:58.718886+0000","last_became_active":"2024-01-22T05:37:58.248217+0000","last_became_peered":"2024-01-22T05:37:58.248217+0000","last_unstale":"2024-01-22T05:37:58.718886+0000","last_undegraded":"2024-01-22T05:37:58.718886+0000","last_fullsized":"2024-01-22T05:37:58.718886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703823+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:37:58.703823+0000","last_peered":"2024-01-22T05:37:58.703823+0000","last_clean":"2024-01-22T05:37:58.703823+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:37:58.703823+0000","last_undegraded":"2024-01-22T05:37:58.703823+0000","last_fullsized":"2024-01-22T05:37:58.703823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.721675+0000","last_change":"2024-01-22T05:37:58.714917+0000","last_active":"2024-01-22T05:37:58.721675+0000","last_peered":"2024-01-22T05:37:58.721675+0000","last_clean":"2024-01-22T05:37:58.721675+0000","last_became_active":"2024-01-22T05:37:58.714575+0000","last_became_peered":"2024-01-22T05:37:58.714575+0000","last_unstale":"2024-01-22T05:37:58.721675+0000","last_undegraded":"2024-01-22T05:37:58.721675+0000","last_fullsized":"2024-01-22T05:37:58.721675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707640+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:37:58.707640+0000","last_peered":"2024-01-22T05:37:58.707640+0000","last_clean":"2024-01-22T05:37:58.707640+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:37:58.707640+0000","last_undegraded":"2024-01-22T05:37:58.707640+0000","last_fullsized":"2024-01-22T05:37:58.707640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705408+0000","last_change":"2024-01-22T05:37:58.253114+0000","last_active":"2024-01-22T05:37:58.705408+0000","last_peered":"2024-01-22T05:37:58.705408+0000","last_clean":"2024-01-22T05:37:58.705408+0000","last_became_active":"2024-01-22T05:37:58.252823+0000","last_became_peered":"2024-01-22T05:37:58.252823+0000","last_unstale":"2024-01-22T05:37:58.705408+0000","last_undegraded":"2024-01-22T05:37:58.705408+0000","last_fullsized":"2024-01-22T05:37:58.705408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715774+0000","last_change":"2024-01-22T05:37:58.707388+0000","last_active":"2024-01-22T05:37:58.715774+0000","last_peered":"2024-01-22T05:37:58.715774+0000","last_clean":"2024-01-22T05:37:58.715774+0000","last_became_active":"2024-01-22T05:37:58.707099+0000","last_became_peered":"2024-01-22T05:37:58.707099+0000","last_unstale":"2024-01-22T05:37:58.715774+0000","last_undegraded":"2024-01-22T05:37:58.715774+0000","last_fullsized":"2024-01-22T05:37:58.715774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727511+0000","last_change":"2024-01-22T05:37:58.721226+0000","last_active":"2024-01-22T05:37:58.727511+0000","last_peered":"2024-01-22T05:37:58.727511+0000","last_clean":"2024-01-22T05:37:58.727511+0000","last_became_active":"2024-01-22T05:37:58.714690+0000","last_became_peered":"2024-01-22T05:37:58.714690+0000","last_unstale":"2024-01-22T05:37:58.727511+0000","last_undegraded":"2024-01-22T05:37:58.727511+0000","last_fullsized":"2024-01-22T05:37:58.727511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701838+0000","last_change":"2024-01-22T05:37:58.253254+0000","last_active":"2024-01-22T05:37:58.701838+0000","last_peered":"2024-01-22T05:37:58.701838+0000","last_clean":"2024-01-22T05:37:58.701838+0000","last_became_active":"2024-01-22T05:37:58.252839+0000","last_became_peered":"2024-01-22T05:37:58.252839+0000","last_unstale":"2024-01-22T05:37:58.701838+0000","last_undegraded":"2024-01-22T05:37:58.701838+0000","last_fullsized":"2024-01-22T05:37:58.701838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728419+0000","last_change":"2024-01-22T05:37:58.724996+0000","last_active":"2024-01-22T05:37:58.728419+0000","last_peered":"2024-01-22T05:37:58.728419+0000","last_clean":"2024-01-22T05:37:58.728419+0000","last_became_active":"2024-01-22T05:37:58.724730+0000","last_became_peered":"2024-01-22T05:37:58.724730+0000","last_unstale":"2024-01-22T05:37:58.728419+0000","last_undegraded":"2024-01-22T05:37:58.728419+0000","last_fullsized":"2024-01-22T05:37:58.728419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689345+0000","last_change":"2024-01-22T05:37:58.261431+0000","last_active":"2024-01-22T05:37:58.689345+0000","last_peered":"2024-01-22T05:37:58.689345+0000","last_clean":"2024-01-22T05:37:58.689345+0000","last_became_active":"2024-01-22T05:37:58.261120+0000","last_became_peered":"2024-01-22T05:37:58.261120+0000","last_unstale":"2024-01-22T05:37:58.689345+0000","last_undegraded":"2024-01-22T05:37:58.689345+0000","last_fullsized":"2024-01-22T05:37:58.689345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717402+0000","last_change":"2024-01-22T05:37:58.709933+0000","last_active":"2024-01-22T05:37:58.717402+0000","last_peered":"2024-01-22T05:37:58.717402+0000","last_clean":"2024-01-22T05:37:58.717402+0000","last_became_active":"2024-01-22T05:37:58.707398+0000","last_became_peered":"2024-01-22T05:37:58.707398+0000","last_unstale":"2024-01-22T05:37:58.717402+0000","last_undegraded":"2024-01-22T05:37:58.717402+0000","last_fullsized":"2024-01-22T05:37:58.717402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726249+0000","last_change":"2024-01-22T05:37:58.265006+0000","last_active":"2024-01-22T05:37:58.726249+0000","last_peered":"2024-01-22T05:37:58.726249+0000","last_clean":"2024-01-22T05:37:58.726249+0000","last_became_active":"2024-01-22T05:37:58.264513+0000","last_became_peered":"2024-01-22T05:37:58.264513+0000","last_unstale":"2024-01-22T05:37:58.726249+0000","last_undegraded":"2024-01-22T05:37:58.726249+0000","last_fullsized":"2024-01-22T05:37:58.726249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712679+0000","last_change":"2024-01-22T05:37:58.710477+0000","last_active":"2024-01-22T05:37:58.712679+0000","last_peered":"2024-01-22T05:37:58.712679+0000","last_clean":"2024-01-22T05:37:58.712679+0000","last_became_active":"2024-01-22T05:37:58.710170+0000","last_became_peered":"2024-01-22T05:37:58.710170+0000","last_unstale":"2024-01-22T05:37:58.712679+0000","last_undegraded":"2024-01-22T05:37:58.712679+0000","last_fullsized":"2024-01-22T05:37:58.712679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732630+0000","last_change":"2024-01-22T05:37:58.249092+0000","last_active":"2024-01-22T05:37:58.732630+0000","last_peered":"2024-01-22T05:37:58.732630+0000","last_clean":"2024-01-22T05:37:58.732630+0000","last_became_active":"2024-01-22T05:37:58.248749+0000","last_became_peered":"2024-01-22T05:37:58.248749+0000","last_unstale":"2024-01-22T05:37:58.732630+0000","last_undegraded":"2024-01-22T05:37:58.732630+0000","last_fullsized":"2024-01-22T05:37:58.732630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724703+0000","last_change":"2024-01-22T05:37:58.721462+0000","last_active":"2024-01-22T05:37:58.724703+0000","last_peered":"2024-01-22T05:37:58.724703+0000","last_clean":"2024-01-22T05:37:58.724703+0000","last_became_active":"2024-01-22T05:37:58.721192+0000","last_became_peered":"2024-01-22T05:37:58.721192+0000","last_unstale":"2024-01-22T05:37:58.724703+0000","last_undegraded":"2024-01-22T05:37:58.724703+0000","last_fullsized":"2024-01-22T05:37:58.724703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732649+0000","last_change":"2024-01-22T05:37:58.256074+0000","last_active":"2024-01-22T05:37:58.732649+0000","last_peered":"2024-01-22T05:37:58.732649+0000","last_clean":"2024-01-22T05:37:58.732649+0000","last_became_active":"2024-01-22T05:37:58.253919+0000","last_became_peered":"2024-01-22T05:37:58.253919+0000","last_unstale":"2024-01-22T05:37:58.732649+0000","last_undegraded":"2024-01-22T05:37:58.732649+0000","last_fullsized":"2024-01-22T05:37:58.732649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732648+0000","last_change":"2024-01-22T05:37:58.730288+0000","last_active":"2024-01-22T05:37:58.732648+0000","last_peered":"2024-01-22T05:37:58.732648+0000","last_clean":"2024-01-22T05:37:58.732648+0000","last_became_active":"2024-01-22T05:37:58.729963+0000","last_became_peered":"2024-01-22T05:37:58.729963+0000","last_unstale":"2024-01-22T05:37:58.732648+0000","last_undegraded":"2024-01-22T05:37:58.732648+0000","last_fullsized":"2024-01-22T05:37:58.732648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699383+0000","last_change":"2024-01-22T05:37:58.249681+0000","last_active":"2024-01-22T05:37:58.699383+0000","last_peered":"2024-01-22T05:37:58.699383+0000","last_clean":"2024-01-22T05:37:58.699383+0000","last_became_active":"2024-01-22T05:37:58.249359+0000","last_became_peered":"2024-01-22T05:37:58.249359+0000","last_unstale":"2024-01-22T05:37:58.699383+0000","last_undegraded":"2024-01-22T05:37:58.699383+0000","last_fullsized":"2024-01-22T05:37:58.699383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726458+0000","last_change":"2024-01-22T05:37:58.719997+0000","last_active":"2024-01-22T05:37:58.726458+0000","last_peered":"2024-01-22T05:37:58.726458+0000","last_clean":"2024-01-22T05:37:58.726458+0000","last_became_active":"2024-01-22T05:37:58.717231+0000","last_became_peered":"2024-01-22T05:37:58.717231+0000","last_unstale":"2024-01-22T05:37:58.726458+0000","last_undegraded":"2024-01-22T05:37:58.726458+0000","last_fullsized":"2024-01-22T05:37:58.726458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.695952+0000","last_change":"2024-01-22T05:37:58.257047+0000","last_active":"2024-01-22T05:37:58.695952+0000","last_peered":"2024-01-22T05:37:58.695952+0000","last_clean":"2024-01-22T05:37:58.695952+0000","last_became_active":"2024-01-22T05:37:58.256649+0000","last_became_peered":"2024-01-22T05:37:58.256649+0000","last_unstale":"2024-01-22T05:37:58.695952+0000","last_undegraded":"2024-01-22T05:37:58.695952+0000","last_fullsized":"2024-01-22T05:37:58.695952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730507+0000","last_change":"2024-01-22T05:37:58.726471+0000","last_active":"2024-01-22T05:37:58.730507+0000","last_peered":"2024-01-22T05:37:58.730507+0000","last_clean":"2024-01-22T05:37:58.730507+0000","last_became_active":"2024-01-22T05:37:58.725949+0000","last_became_peered":"2024-01-22T05:37:58.725949+0000","last_unstale":"2024-01-22T05:37:58.730507+0000","last_undegraded":"2024-01-22T05:37:58.730507+0000","last_fullsized":"2024-01-22T05:37:58.730507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.708157+0000","last_change":"2024-01-22T05:37:58.263577+0000","last_active":"2024-01-22T05:37:58.708157+0000","last_peered":"2024-01-22T05:37:58.708157+0000","last_clean":"2024-01-22T05:37:58.708157+0000","last_became_active":"2024-01-22T05:37:58.263204+0000","last_became_peered":"2024-01-22T05:37:58.263204+0000","last_unstale":"2024-01-22T05:37:58.708157+0000","last_undegraded":"2024-01-22T05:37:58.708157+0000","last_fullsized":"2024-01-22T05:37:58.708157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724177+0000","last_change":"2024-01-22T05:37:58.717817+0000","last_active":"2024-01-22T05:37:58.724177+0000","last_peered":"2024-01-22T05:37:58.724177+0000","last_clean":"2024-01-22T05:37:58.724177+0000","last_became_active":"2024-01-22T05:37:58.717540+0000","last_became_peered":"2024-01-22T05:37:58.717540+0000","last_unstale":"2024-01-22T05:37:58.724177+0000","last_undegraded":"2024-01-22T05:37:58.724177+0000","last_fullsized":"2024-01-22T05:37:58.724177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699042+0000","last_change":"2024-01-22T05:37:58.253690+0000","last_active":"2024-01-22T05:37:58.699042+0000","last_peered":"2024-01-22T05:37:58.699042+0000","last_clean":"2024-01-22T05:37:58.699042+0000","last_became_active":"2024-01-22T05:37:58.253367+0000","last_became_peered":"2024-01-22T05:37:58.253367+0000","last_unstale":"2024-01-22T05:37:58.699042+0000","last_undegraded":"2024-01-22T05:37:58.699042+0000","last_fullsized":"2024-01-22T05:37:58.699042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723711+0000","last_change":"2024-01-22T05:37:58.709446+0000","last_active":"2024-01-22T05:37:58.723711+0000","last_peered":"2024-01-22T05:37:58.723711+0000","last_clean":"2024-01-22T05:37:58.723711+0000","last_became_active":"2024-01-22T05:37:58.709099+0000","last_became_peered":"2024-01-22T05:37:58.709099+0000","last_unstale":"2024-01-22T05:37:58.723711+0000","last_undegraded":"2024-01-22T05:37:58.723711+0000","last_fullsized":"2024-01-22T05:37:58.723711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704828+0000","last_change":"2024-01-22T05:37:58.260823+0000","last_active":"2024-01-22T05:37:58.704828+0000","last_peered":"2024-01-22T05:37:58.704828+0000","last_clean":"2024-01-22T05:37:58.704828+0000","last_became_active":"2024-01-22T05:37:58.260527+0000","last_became_peered":"2024-01-22T05:37:58.260527+0000","last_unstale":"2024-01-22T05:37:58.704828+0000","last_undegraded":"2024-01-22T05:37:58.704828+0000","last_fullsized":"2024-01-22T05:37:58.704828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712095+0000","last_change":"2024-01-22T05:37:58.706792+0000","last_active":"2024-01-22T05:37:58.712095+0000","last_peered":"2024-01-22T05:37:58.712095+0000","last_clean":"2024-01-22T05:37:58.712095+0000","last_became_active":"2024-01-22T05:37:58.706496+0000","last_became_peered":"2024-01-22T05:37:58.706496+0000","last_unstale":"2024-01-22T05:37:58.712095+0000","last_undegraded":"2024-01-22T05:37:58.712095+0000","last_fullsized":"2024-01-22T05:37:58.712095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704962+0000","last_change":"2024-01-22T05:37:58.258446+0000","last_active":"2024-01-22T05:37:58.704962+0000","last_peered":"2024-01-22T05:37:58.704962+0000","last_clean":"2024-01-22T05:37:58.704962+0000","last_became_active":"2024-01-22T05:37:58.258012+0000","last_became_peered":"2024-01-22T05:37:58.258012+0000","last_unstale":"2024-01-22T05:37:58.704962+0000","last_undegraded":"2024-01-22T05:37:58.704962+0000","last_fullsized":"2024-01-22T05:37:58.704962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732126+0000","last_change":"2024-01-22T05:37:58.726698+0000","last_active":"2024-01-22T05:37:58.732126+0000","last_peered":"2024-01-22T05:37:58.732126+0000","last_clean":"2024-01-22T05:37:58.732126+0000","last_became_active":"2024-01-22T05:37:58.725892+0000","last_became_peered":"2024-01-22T05:37:58.725892+0000","last_unstale":"2024-01-22T05:37:58.732126+0000","last_undegraded":"2024-01-22T05:37:58.732126+0000","last_fullsized":"2024-01-22T05:37:58.732126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701123+0000","last_change":"2024-01-22T05:37:58.264437+0000","last_active":"2024-01-22T05:37:58.701123+0000","last_peered":"2024-01-22T05:37:58.701123+0000","last_clean":"2024-01-22T05:37:58.701123+0000","last_became_active":"2024-01-22T05:37:58.263796+0000","last_became_peered":"2024-01-22T05:37:58.263796+0000","last_unstale":"2024-01-22T05:37:58.701123+0000","last_undegraded":"2024-01-22T05:37:58.701123+0000","last_fullsized":"2024-01-22T05:37:58.701123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.720620+0000","last_change":"2024-01-22T05:37:58.714745+0000","last_active":"2024-01-22T05:37:58.720620+0000","last_peered":"2024-01-22T05:37:58.720620+0000","last_clean":"2024-01-22T05:37:58.720620+0000","last_became_active":"2024-01-22T05:37:58.714462+0000","last_became_peered":"2024-01-22T05:37:58.714462+0000","last_unstale":"2024-01-22T05:37:58.720620+0000","last_undegraded":"2024-01-22T05:37:58.720620+0000","last_fullsized":"2024-01-22T05:37:58.720620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702263+0000","last_change":"2024-01-22T05:37:58.255003+0000","last_active":"2024-01-22T05:37:58.702263+0000","last_peered":"2024-01-22T05:37:58.702263+0000","last_clean":"2024-01-22T05:37:58.702263+0000","last_became_active":"2024-01-22T05:37:58.253856+0000","last_became_peered":"2024-01-22T05:37:58.253856+0000","last_unstale":"2024-01-22T05:37:58.702263+0000","last_undegraded":"2024-01-22T05:37:58.702263+0000","last_fullsized":"2024-01-22T05:37:58.702263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722299+0000","last_change":"2024-01-22T05:37:58.718905+0000","last_active":"2024-01-22T05:37:58.722299+0000","last_peered":"2024-01-22T05:37:58.722299+0000","last_clean":"2024-01-22T05:37:58.722299+0000","last_became_active":"2024-01-22T05:37:58.717276+0000","last_became_peered":"2024-01-22T05:37:58.717276+0000","last_unstale":"2024-01-22T05:37:58.722299+0000","last_undegraded":"2024-01-22T05:37:58.722299+0000","last_fullsized":"2024-01-22T05:37:58.722299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.706505+0000","last_change":"2024-01-22T05:37:58.265209+0000","last_active":"2024-01-22T05:37:58.706505+0000","last_peered":"2024-01-22T05:37:58.706505+0000","last_clean":"2024-01-22T05:37:58.706505+0000","last_became_active":"2024-01-22T05:37:58.264930+0000","last_became_peered":"2024-01-22T05:37:58.264930+0000","last_unstale":"2024-01-22T05:37:58.706505+0000","last_undegraded":"2024-01-22T05:37:58.706505+0000","last_fullsized":"2024-01-22T05:37:58.706505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712277+0000","last_change":"2024-01-22T05:37:58.706093+0000","last_active":"2024-01-22T05:37:58.712277+0000","last_peered":"2024-01-22T05:37:58.712277+0000","last_clean":"2024-01-22T05:37:58.712277+0000","last_became_active":"2024-01-22T05:37:58.705804+0000","last_became_peered":"2024-01-22T05:37:58.705804+0000","last_unstale":"2024-01-22T05:37:58.712277+0000","last_undegraded":"2024-01-22T05:37:58.712277+0000","last_fullsized":"2024-01-22T05:37:58.712277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696681+0000","last_change":"2024-01-22T05:37:58.249283+0000","last_active":"2024-01-22T05:37:58.696681+0000","last_peered":"2024-01-22T05:37:58.696681+0000","last_clean":"2024-01-22T05:37:58.696681+0000","last_became_active":"2024-01-22T05:37:58.248923+0000","last_became_peered":"2024-01-22T05:37:58.248923+0000","last_unstale":"2024-01-22T05:37:58.696681+0000","last_undegraded":"2024-01-22T05:37:58.696681+0000","last_fullsized":"2024-01-22T05:37:58.696681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729793+0000","last_change":"2024-01-22T05:37:58.724869+0000","last_active":"2024-01-22T05:37:58.729793+0000","last_peered":"2024-01-22T05:37:58.729793+0000","last_clean":"2024-01-22T05:37:58.729793+0000","last_became_active":"2024-01-22T05:37:58.724551+0000","last_became_peered":"2024-01-22T05:37:58.724551+0000","last_unstale":"2024-01-22T05:37:58.729793+0000","last_undegraded":"2024-01-22T05:37:58.729793+0000","last_fullsized":"2024-01-22T05:37:58.729793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689553+0000","last_change":"2024-01-22T05:37:58.256442+0000","last_active":"2024-01-22T05:37:58.689553+0000","last_peered":"2024-01-22T05:37:58.689553+0000","last_clean":"2024-01-22T05:37:58.689553+0000","last_became_active":"2024-01-22T05:37:58.256136+0000","last_became_peered":"2024-01-22T05:37:58.256136+0000","last_unstale":"2024-01-22T05:37:58.689553+0000","last_undegraded":"2024-01-22T05:37:58.689553+0000","last_fullsized":"2024-01-22T05:37:58.689553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717228+0000","last_change":"2024-01-22T05:37:58.711074+0000","last_active":"2024-01-22T05:37:58.717228+0000","last_peered":"2024-01-22T05:37:58.717228+0000","last_clean":"2024-01-22T05:37:58.717228+0000","last_became_active":"2024-01-22T05:37:58.710803+0000","last_became_peered":"2024-01-22T05:37:58.710803+0000","last_unstale":"2024-01-22T05:37:58.717228+0000","last_undegraded":"2024-01-22T05:37:58.717228+0000","last_fullsized":"2024-01-22T05:37:58.717228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.720058+0000","last_change":"2024-01-22T05:37:58.252113+0000","last_active":"2024-01-22T05:37:58.720058+0000","last_peered":"2024-01-22T05:37:58.720058+0000","last_clean":"2024-01-22T05:37:58.720058+0000","last_became_active":"2024-01-22T05:37:58.251258+0000","last_became_peered":"2024-01-22T05:37:58.251258+0000","last_unstale":"2024-01-22T05:37:58.720058+0000","last_undegraded":"2024-01-22T05:37:58.720058+0000","last_fullsized":"2024-01-22T05:37:58.720058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.721993+0000","last_change":"2024-01-22T05:37:58.716869+0000","last_active":"2024-01-22T05:37:58.721993+0000","last_peered":"2024-01-22T05:37:58.721993+0000","last_clean":"2024-01-22T05:37:58.721993+0000","last_became_active":"2024-01-22T05:37:58.716086+0000","last_became_peered":"2024-01-22T05:37:58.716086+0000","last_unstale":"2024-01-22T05:37:58.721993+0000","last_undegraded":"2024-01-22T05:37:58.721993+0000","last_fullsized":"2024-01-22T05:37:58.721993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697140+0000","last_change":"2024-01-22T05:37:58.254343+0000","last_active":"2024-01-22T05:37:58.697140+0000","last_peered":"2024-01-22T05:37:58.697140+0000","last_clean":"2024-01-22T05:37:58.697140+0000","last_became_active":"2024-01-22T05:37:58.247951+0000","last_became_peered":"2024-01-22T05:37:58.247951+0000","last_unstale":"2024-01-22T05:37:58.697140+0000","last_undegraded":"2024-01-22T05:37:58.697140+0000","last_fullsized":"2024-01-22T05:37:58.697140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712952+0000","last_change":"2024-01-22T05:37:58.711776+0000","last_active":"2024-01-22T05:37:58.712952+0000","last_peered":"2024-01-22T05:37:58.712952+0000","last_clean":"2024-01-22T05:37:58.712952+0000","last_became_active":"2024-01-22T05:37:58.711428+0000","last_became_peered":"2024-01-22T05:37:58.711428+0000","last_unstale":"2024-01-22T05:37:58.712952+0000","last_undegraded":"2024-01-22T05:37:58.712952+0000","last_fullsized":"2024-01-22T05:37:58.712952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729786+0000","last_change":"2024-01-22T05:37:58.264800+0000","last_active":"2024-01-22T05:37:58.729786+0000","last_peered":"2024-01-22T05:37:58.729786+0000","last_clean":"2024-01-22T05:37:58.729786+0000","last_became_active":"2024-01-22T05:37:58.264190+0000","last_became_peered":"2024-01-22T05:37:58.264190+0000","last_unstale":"2024-01-22T05:37:58.729786+0000","last_undegraded":"2024-01-22T05:37:58.729786+0000","last_fullsized":"2024-01-22T05:37:58.729786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732096+0000","last_change":"2024-01-22T05:37:58.724990+0000","last_active":"2024-01-22T05:37:58.732096+0000","last_peered":"2024-01-22T05:37:58.732096+0000","last_clean":"2024-01-22T05:37:58.732096+0000","last_became_active":"2024-01-22T05:37:58.724687+0000","last_became_peered":"2024-01-22T05:37:58.724687+0000","last_unstale":"2024-01-22T05:37:58.732096+0000","last_undegraded":"2024-01-22T05:37:58.732096+0000","last_fullsized":"2024-01-22T05:37:58.732096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696561+0000","last_change":"2024-01-22T05:37:58.257083+0000","last_active":"2024-01-22T05:37:58.696561+0000","last_peered":"2024-01-22T05:37:58.696561+0000","last_clean":"2024-01-22T05:37:58.696561+0000","last_became_active":"2024-01-22T05:37:58.256792+0000","last_became_peered":"2024-01-22T05:37:58.256792+0000","last_unstale":"2024-01-22T05:37:58.696561+0000","last_undegraded":"2024-01-22T05:37:58.696561+0000","last_fullsized":"2024-01-22T05:37:58.696561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727963+0000","last_change":"2024-01-22T05:37:58.724961+0000","last_active":"2024-01-22T05:37:58.727963+0000","last_peered":"2024-01-22T05:37:58.727963+0000","last_clean":"2024-01-22T05:37:58.727963+0000","last_became_active":"2024-01-22T05:37:58.724672+0000","last_became_peered":"2024-01-22T05:37:58.724672+0000","last_unstale":"2024-01-22T05:37:58.727963+0000","last_undegraded":"2024-01-22T05:37:58.727963+0000","last_fullsized":"2024-01-22T05:37:58.727963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707872+0000","last_change":"2024-01-22T05:37:58.263297+0000","last_active":"2024-01-22T05:37:58.707872+0000","last_peered":"2024-01-22T05:37:58.707872+0000","last_clean":"2024-01-22T05:37:58.707872+0000","last_became_active":"2024-01-22T05:37:58.262968+0000","last_became_peered":"2024-01-22T05:37:58.262968+0000","last_unstale":"2024-01-22T05:37:58.707872+0000","last_undegraded":"2024-01-22T05:37:58.707872+0000","last_fullsized":"2024-01-22T05:37:58.707872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732629+0000","last_change":"2024-01-22T05:37:58.729257+0000","last_active":"2024-01-22T05:37:58.732629+0000","last_peered":"2024-01-22T05:37:58.732629+0000","last_clean":"2024-01-22T05:37:58.732629+0000","last_became_active":"2024-01-22T05:37:58.728921+0000","last_became_peered":"2024-01-22T05:37:58.728921+0000","last_unstale":"2024-01-22T05:37:58.732629+0000","last_undegraded":"2024-01-22T05:37:58.732629+0000","last_fullsized":"2024-01-22T05:37:58.732629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729477+0000","last_change":"2024-01-22T05:37:58.251278+0000","last_active":"2024-01-22T05:37:58.729477+0000","last_peered":"2024-01-22T05:37:58.729477+0000","last_clean":"2024-01-22T05:37:58.729477+0000","last_became_active":"2024-01-22T05:37:58.251091+0000","last_became_peered":"2024-01-22T05:37:58.251091+0000","last_unstale":"2024-01-22T05:37:58.729477+0000","last_undegraded":"2024-01-22T05:37:58.729477+0000","last_fullsized":"2024-01-22T05:37:58.729477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709214+0000","last_change":"2024-01-22T05:37:58.705340+0000","last_active":"2024-01-22T05:37:58.709214+0000","last_peered":"2024-01-22T05:37:58.709214+0000","last_clean":"2024-01-22T05:37:58.709214+0000","last_became_active":"2024-01-22T05:37:58.703766+0000","last_became_peered":"2024-01-22T05:37:58.703766+0000","last_unstale":"2024-01-22T05:37:58.709214+0000","last_undegraded":"2024-01-22T05:37:58.709214+0000","last_fullsized":"2024-01-22T05:37:58.709214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696495+0000","last_change":"2024-01-22T05:37:58.254002+0000","last_active":"2024-01-22T05:37:58.696495+0000","last_peered":"2024-01-22T05:37:58.696495+0000","last_clean":"2024-01-22T05:37:58.696495+0000","last_became_active":"2024-01-22T05:37:58.253662+0000","last_became_peered":"2024-01-22T05:37:58.253662+0000","last_unstale":"2024-01-22T05:37:58.696495+0000","last_undegraded":"2024-01-22T05:37:58.696495+0000","last_fullsized":"2024-01-22T05:37:58.696495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709220+0000","last_change":"2024-01-22T05:37:58.704985+0000","last_active":"2024-01-22T05:37:58.709220+0000","last_peered":"2024-01-22T05:37:58.709220+0000","last_clean":"2024-01-22T05:37:58.709220+0000","last_became_active":"2024-01-22T05:37:58.704622+0000","last_became_peered":"2024-01-22T05:37:58.704622+0000","last_unstale":"2024-01-22T05:37:58.709220+0000","last_undegraded":"2024-01-22T05:37:58.709220+0000","last_fullsized":"2024-01-22T05:37:58.709220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700540+0000","last_change":"2024-01-22T05:37:58.255249+0000","last_active":"2024-01-22T05:37:58.700540+0000","last_peered":"2024-01-22T05:37:58.700540+0000","last_clean":"2024-01-22T05:37:58.700540+0000","last_became_active":"2024-01-22T05:37:58.254043+0000","last_became_peered":"2024-01-22T05:37:58.254043+0000","last_unstale":"2024-01-22T05:37:58.700540+0000","last_undegraded":"2024-01-22T05:37:58.700540+0000","last_fullsized":"2024-01-22T05:37:58.700540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727550+0000","last_change":"2024-01-22T05:37:58.721667+0000","last_active":"2024-01-22T05:37:58.727550+0000","last_peered":"2024-01-22T05:37:58.727550+0000","last_clean":"2024-01-22T05:37:58.727550+0000","last_became_active":"2024-01-22T05:37:58.720955+0000","last_became_peered":"2024-01-22T05:37:58.720955+0000","last_unstale":"2024-01-22T05:37:58.727550+0000","last_undegraded":"2024-01-22T05:37:58.727550+0000","last_fullsized":"2024-01-22T05:37:58.727550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719022+0000","last_change":"2024-01-22T05:37:58.257358+0000","last_active":"2024-01-22T05:37:58.719022+0000","last_peered":"2024-01-22T05:37:58.719022+0000","last_clean":"2024-01-22T05:37:58.719022+0000","last_became_active":"2024-01-22T05:37:58.256833+0000","last_became_peered":"2024-01-22T05:37:58.256833+0000","last_unstale":"2024-01-22T05:37:58.719022+0000","last_undegraded":"2024-01-22T05:37:58.719022+0000","last_fullsized":"2024-01-22T05:37:58.719022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729529+0000","last_change":"2024-01-22T05:37:58.724890+0000","last_active":"2024-01-22T05:37:58.729529+0000","last_peered":"2024-01-22T05:37:58.729529+0000","last_clean":"2024-01-22T05:37:58.729529+0000","last_became_active":"2024-01-22T05:37:58.724468+0000","last_became_peered":"2024-01-22T05:37:58.724468+0000","last_unstale":"2024-01-22T05:37:58.729529+0000","last_undegraded":"2024-01-22T05:37:58.729529+0000","last_fullsized":"2024-01-22T05:37:58.729529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729961+0000","last_change":"2024-01-22T05:37:58.260261+0000","last_active":"2024-01-22T05:37:58.729961+0000","last_peered":"2024-01-22T05:37:58.729961+0000","last_clean":"2024-01-22T05:37:58.729961+0000","last_became_active":"2024-01-22T05:37:58.259704+0000","last_became_peered":"2024-01-22T05:37:58.259704+0000","last_unstale":"2024-01-22T05:37:58.729961+0000","last_undegraded":"2024-01-22T05:37:58.729961+0000","last_fullsized":"2024-01-22T05:37:58.729961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728107+0000","last_change":"2024-01-22T05:37:58.726130+0000","last_active":"2024-01-22T05:37:58.728107+0000","last_peered":"2024-01-22T05:37:58.728107+0000","last_clean":"2024-01-22T05:37:58.728107+0000","last_became_active":"2024-01-22T05:37:58.725859+0000","last_became_peered":"2024-01-22T05:37:58.725859+0000","last_unstale":"2024-01-22T05:37:58.728107+0000","last_undegraded":"2024-01-22T05:37:58.728107+0000","last_fullsized":"2024-01-22T05:37:58.728107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697755+0000","last_change":"2024-01-22T05:37:58.264803+0000","last_active":"2024-01-22T05:37:58.697755+0000","last_peered":"2024-01-22T05:37:58.697755+0000","last_clean":"2024-01-22T05:37:58.697755+0000","last_became_active":"2024-01-22T05:37:58.264462+0000","last_became_peered":"2024-01-22T05:37:58.264462+0000","last_unstale":"2024-01-22T05:37:58.697755+0000","last_undegraded":"2024-01-22T05:37:58.697755+0000","last_fullsized":"2024-01-22T05:37:58.697755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724696+0000","last_change":"2024-01-22T05:37:58.712538+0000","last_active":"2024-01-22T05:37:58.724696+0000","last_peered":"2024-01-22T05:37:58.724696+0000","last_clean":"2024-01-22T05:37:58.724696+0000","last_became_active":"2024-01-22T05:37:58.712227+0000","last_became_peered":"2024-01-22T05:37:58.712227+0000","last_unstale":"2024-01-22T05:37:58.724696+0000","last_undegraded":"2024-01-22T05:37:58.724696+0000","last_fullsized":"2024-01-22T05:37:58.724696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700878+0000","last_change":"2024-01-22T05:37:58.250185+0000","last_active":"2024-01-22T05:37:58.700878+0000","last_peered":"2024-01-22T05:37:58.700878+0000","last_clean":"2024-01-22T05:37:58.700878+0000","last_became_active":"2024-01-22T05:37:58.249870+0000","last_became_peered":"2024-01-22T05:37:58.249870+0000","last_unstale":"2024-01-22T05:37:58.700878+0000","last_undegraded":"2024-01-22T05:37:58.700878+0000","last_fullsized":"2024-01-22T05:37:58.700878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719474+0000","last_change":"2024-01-22T05:37:58.708704+0000","last_active":"2024-01-22T05:37:58.719474+0000","last_peered":"2024-01-22T05:37:58.719474+0000","last_clean":"2024-01-22T05:37:58.719474+0000","last_became_active":"2024-01-22T05:37:58.708449+0000","last_became_peered":"2024-01-22T05:37:58.708449+0000","last_unstale":"2024-01-22T05:37:58.719474+0000","last_undegraded":"2024-01-22T05:37:58.719474+0000","last_fullsized":"2024-01-22T05:37:58.719474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.690119+0000","last_change":"2024-01-22T05:37:58.246767+0000","last_active":"2024-01-22T05:37:58.690119+0000","last_peered":"2024-01-22T05:37:58.690119+0000","last_clean":"2024-01-22T05:37:58.690119+0000","last_became_active":"2024-01-22T05:37:58.245978+0000","last_became_peered":"2024-01-22T05:37:58.245978+0000","last_unstale":"2024-01-22T05:37:58.690119+0000","last_undegraded":"2024-01-22T05:37:58.690119+0000","last_fullsized":"2024-01-22T05:37:58.690119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727646+0000","last_change":"2024-01-22T05:37:58.721568+0000","last_active":"2024-01-22T05:37:58.727646+0000","last_peered":"2024-01-22T05:37:58.727646+0000","last_clean":"2024-01-22T05:37:58.727646+0000","last_became_active":"2024-01-22T05:37:58.720320+0000","last_became_peered":"2024-01-22T05:37:58.720320+0000","last_unstale":"2024-01-22T05:37:58.727646+0000","last_undegraded":"2024-01-22T05:37:58.727646+0000","last_fullsized":"2024-01-22T05:37:58.727646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702410+0000","last_change":"2024-01-22T05:37:58.254018+0000","last_active":"2024-01-22T05:37:58.702410+0000","last_peered":"2024-01-22T05:37:58.702410+0000","last_clean":"2024-01-22T05:37:58.702410+0000","last_became_active":"2024-01-22T05:37:58.253663+0000","last_became_peered":"2024-01-22T05:37:58.253663+0000","last_unstale":"2024-01-22T05:37:58.702410+0000","last_undegraded":"2024-01-22T05:37:58.702410+0000","last_fullsized":"2024-01-22T05:37:58.702410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727129+0000","last_change":"2024-01-22T05:37:58.722202+0000","last_active":"2024-01-22T05:37:58.727129+0000","last_peered":"2024-01-22T05:37:58.727129+0000","last_clean":"2024-01-22T05:37:58.727129+0000","last_became_active":"2024-01-22T05:37:58.721929+0000","last_became_peered":"2024-01-22T05:37:58.721929+0000","last_unstale":"2024-01-22T05:37:58.727129+0000","last_undegraded":"2024-01-22T05:37:58.727129+0000","last_fullsized":"2024-01-22T05:37:58.727129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696216+0000","last_change":"2024-01-22T05:37:58.249353+0000","last_active":"2024-01-22T05:37:58.696216+0000","last_peered":"2024-01-22T05:37:58.696216+0000","last_clean":"2024-01-22T05:37:58.696216+0000","last_became_active":"2024-01-22T05:37:58.247936+0000","last_became_peered":"2024-01-22T05:37:58.247936+0000","last_unstale":"2024-01-22T05:37:58.696216+0000","last_undegraded":"2024-01-22T05:37:58.696216+0000","last_fullsized":"2024-01-22T05:37:58.696216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729390+0000","last_change":"2024-01-22T05:37:58.725363+0000","last_active":"2024-01-22T05:37:58.729390+0000","last_peered":"2024-01-22T05:37:58.729390+0000","last_clean":"2024-01-22T05:37:58.729390+0000","last_became_active":"2024-01-22T05:37:58.725165+0000","last_became_peered":"2024-01-22T05:37:58.725165+0000","last_unstale":"2024-01-22T05:37:58.729390+0000","last_undegraded":"2024-01-22T05:37:58.729390+0000","last_fullsized":"2024-01-22T05:37:58.729390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714350+0000","last_change":"2024-01-22T05:37:58.259249+0000","last_active":"2024-01-22T05:37:58.714350+0000","last_peered":"2024-01-22T05:37:58.714350+0000","last_clean":"2024-01-22T05:37:58.714350+0000","last_became_active":"2024-01-22T05:37:58.258966+0000","last_became_peered":"2024-01-22T05:37:58.258966+0000","last_unstale":"2024-01-22T05:37:58.714350+0000","last_undegraded":"2024-01-22T05:37:58.714350+0000","last_fullsized":"2024-01-22T05:37:58.714350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718454+0000","last_change":"2024-01-22T05:37:58.706730+0000","last_active":"2024-01-22T05:37:58.718454+0000","last_peered":"2024-01-22T05:37:58.718454+0000","last_clean":"2024-01-22T05:37:58.718454+0000","last_became_active":"2024-01-22T05:37:58.706540+0000","last_became_peered":"2024-01-22T05:37:58.706540+0000","last_unstale":"2024-01-22T05:37:58.718454+0000","last_undegraded":"2024-01-22T05:37:58.718454+0000","last_fullsized":"2024-01-22T05:37:58.718454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723490+0000","last_change":"2024-01-22T05:37:58.260703+0000","last_active":"2024-01-22T05:37:58.723490+0000","last_peered":"2024-01-22T05:37:58.723490+0000","last_clean":"2024-01-22T05:37:58.723490+0000","last_became_active":"2024-01-22T05:37:58.255191+0000","last_became_peered":"2024-01-22T05:37:58.255191+0000","last_unstale":"2024-01-22T05:37:58.723490+0000","last_undegraded":"2024-01-22T05:37:58.723490+0000","last_fullsized":"2024-01-22T05:37:58.723490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727300+0000","last_change":"2024-01-22T05:37:58.720676+0000","last_active":"2024-01-22T05:37:58.727300+0000","last_peered":"2024-01-22T05:37:58.727300+0000","last_clean":"2024-01-22T05:37:58.727300+0000","last_became_active":"2024-01-22T05:37:58.720340+0000","last_became_peered":"2024-01-22T05:37:58.720340+0000","last_unstale":"2024-01-22T05:37:58.727300+0000","last_undegraded":"2024-01-22T05:37:58.727300+0000","last_fullsized":"2024-01-22T05:37:58.727300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724060+0000","last_change":"2024-01-22T05:37:58.252332+0000","last_active":"2024-01-22T05:37:58.724060+0000","last_peered":"2024-01-22T05:37:58.724060+0000","last_clean":"2024-01-22T05:37:58.724060+0000","last_became_active":"2024-01-22T05:37:58.251974+0000","last_became_peered":"2024-01-22T05:37:58.251974+0000","last_unstale":"2024-01-22T05:37:58.724060+0000","last_undegraded":"2024-01-22T05:37:58.724060+0000","last_fullsized":"2024-01-22T05:37:58.724060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722376+0000","last_change":"2024-01-22T05:37:58.710217+0000","last_active":"2024-01-22T05:37:58.722376+0000","last_peered":"2024-01-22T05:37:58.722376+0000","last_clean":"2024-01-22T05:37:58.722376+0000","last_became_active":"2024-01-22T05:37:58.708965+0000","last_became_peered":"2024-01-22T05:37:58.708965+0000","last_unstale":"2024-01-22T05:37:58.722376+0000","last_undegraded":"2024-01-22T05:37:58.722376+0000","last_fullsized":"2024-01-22T05:37:58.722376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.710339+0000","last_change":"2024-01-22T05:37:58.251023+0000","last_active":"2024-01-22T05:37:58.710339+0000","last_peered":"2024-01-22T05:37:58.710339+0000","last_clean":"2024-01-22T05:37:58.710339+0000","last_became_active":"2024-01-22T05:37:58.250678+0000","last_became_peered":"2024-01-22T05:37:58.250678+0000","last_unstale":"2024-01-22T05:37:58.710339+0000","last_undegraded":"2024-01-22T05:37:58.710339+0000","last_fullsized":"2024-01-22T05:37:58.710339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723126+0000","last_change":"2024-01-22T05:37:58.710302+0000","last_active":"2024-01-22T05:37:58.723126+0000","last_peered":"2024-01-22T05:37:58.723126+0000","last_clean":"2024-01-22T05:37:58.723126+0000","last_became_active":"2024-01-22T05:37:58.709580+0000","last_became_peered":"2024-01-22T05:37:58.709580+0000","last_unstale":"2024-01-22T05:37:58.723126+0000","last_undegraded":"2024-01-22T05:37:58.723126+0000","last_fullsized":"2024-01-22T05:37:58.723126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709432+0000","last_change":"2024-01-22T05:37:58.251159+0000","last_active":"2024-01-22T05:37:58.709432+0000","last_peered":"2024-01-22T05:37:58.709432+0000","last_clean":"2024-01-22T05:37:58.709432+0000","last_became_active":"2024-01-22T05:37:58.250824+0000","last_became_peered":"2024-01-22T05:37:58.250824+0000","last_unstale":"2024-01-22T05:37:58.709432+0000","last_undegraded":"2024-01-22T05:37:58.709432+0000","last_fullsized":"2024-01-22T05:37:58.709432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705513+0000","last_change":"2024-01-22T05:37:58.698080+0000","last_active":"2024-01-22T05:37:58.705513+0000","last_peered":"2024-01-22T05:37:58.705513+0000","last_clean":"2024-01-22T05:37:58.705513+0000","last_became_active":"2024-01-22T05:37:58.697818+0000","last_became_peered":"2024-01-22T05:37:58.697818+0000","last_unstale":"2024-01-22T05:37:58.705513+0000","last_undegraded":"2024-01-22T05:37:58.705513+0000","last_fullsized":"2024-01-22T05:37:58.705513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724005+0000","last_change":"2024-01-22T05:37:58.264651+0000","last_active":"2024-01-22T05:37:58.724005+0000","last_peered":"2024-01-22T05:37:58.724005+0000","last_clean":"2024-01-22T05:37:58.724005+0000","last_became_active":"2024-01-22T05:37:58.264021+0000","last_became_peered":"2024-01-22T05:37:58.264021+0000","last_unstale":"2024-01-22T05:37:58.724005+0000","last_undegraded":"2024-01-22T05:37:58.724005+0000","last_fullsized":"2024-01-22T05:37:58.724005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":78045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":76523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":77367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":83801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297304,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074536,"statfs":{"total":96636764160,"available":96332324864,"internally_reserved":0,"allocated":212992,"data_stored":76453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:38:03.379 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:38:03.379 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-22T05:38:03.379 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-22T05:38:03.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-22T05:38:03.380 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-22T05:38:03.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.596+0000 7f1b26200700 1 Processor -- start 2024-01-22T05:38:03.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.596+0000 7f1b26200700 1 -- start start 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b26200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b201543d0 0x7f1b200a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b26200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1b200aa220 0x7f1b200c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b26200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200c66e0 con 0x7f1b20153ff0 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b26200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200c0750 con 0x7f1b201543d0 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b26200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200aa6b0 con 0x7f1b200aa220 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1ea00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b201543d0 0x7f1b200a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1ea00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b201543d0 0x7f1b200a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55072/0 (socket says 172.21.15.100:55072) 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1ea00700 1 -- 172.21.15.100:0/61392315 learned_addr learned my addr 172.21.15.100:0/61392315 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1f400700 1 --1- 172.21.15.100:0/61392315 >> v1:172.21.15.100:6789/0 conn(0x7f1b20153ff0 0x7f1b200c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41140/0 (socket says 172.21.15.100:41140) 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1fe00700 1 --2- 172.21.15.100:0/61392315 >> v2:172.21.15.169:3300/0 conn(0x7f1b200aa220 0x7f1b200c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1ea00700 1 -- 172.21.15.100:0/61392315 >> v2:172.21.15.169:3300/0 conn(0x7f1b200aa220 msgr2=0x7f1b200c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1ea00700 1 --2- 172.21.15.100:0/61392315 >> v2:172.21.15.169:3300/0 conn(0x7f1b200aa220 0x7f1b200c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1ea00700 1 -- 172.21.15.100:0/61392315 >> v1:172.21.15.100:6789/0 conn(0x7f1b20153ff0 legacy=0x7f1b200c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1ea00700 1 -- 172.21.15.100:0/61392315 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200bfe20 con 0x7f1b201543d0 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.598+0000 7f1b1e000700 1 -- 172.21.15.100:0/61392315 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97024537 0 0) 0x7f1b200c66e0 con 0x7f1b20153ff0 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b1ea00700 1 --2- 172.21.15.100:0/61392315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b201543d0 0x7f1b200a9d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1b200cad60 tx=0x7f1b080090f0).ready entity=mon.0 client_cookie=5152e8d36f1ce1a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b1e000700 1 -- 172.21.15.100:0/61392315 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800b600 con 0x7f1b201543d0 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b1e000700 1 -- 172.21.15.100:0/61392315 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800b760 con 0x7f1b201543d0 2024-01-22T05:38:03.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b1e000700 1 -- 172.21.15.100:0/61392315 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800bae0 con 0x7f1b201543d0 2024-01-22T05:38:03.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 -- 172.21.15.100:0/61392315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b201543d0 msgr2=0x7f1b200a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 --2- 172.21.15.100:0/61392315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b201543d0 0x7f1b200a9d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1b200cad60 tx=0x7f1b080090f0).stop 2024-01-22T05:38:03.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 -- 172.21.15.100:0/61392315 shutdown_connections 2024-01-22T05:38:03.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 --2- 172.21.15.100:0/61392315 >> v2:172.21.15.169:3300/0 conn(0x7f1b200aa220 0x7f1b200c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 --2- 172.21.15.100:0/61392315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b201543d0 0x7f1b200a9d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 -- 172.21.15.100:0/61392315 >> 172.21.15.100:0/61392315 conn(0x7f1b200c82a0 msgr2=0x7f1b2005e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:03.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 -- 172.21.15.100:0/61392315 shutdown_connections 2024-01-22T05:38:03.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.599+0000 7f1b26200700 1 -- 172.21.15.100:0/61392315 wait complete. 2024-01-22T05:38:03.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.601+0000 7f1b26200700 1 Processor -- start 2024-01-22T05:38:03.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.601+0000 7f1b26200700 1 -- start start 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b26200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b200aa220 0x7f1b201548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b26200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b20153ff0 0x7f1b2014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b26200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b201543d0 0x7f1b200c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b26200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20154db0 con 0x7f1b20153ff0 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b26200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c4f80 con 0x7f1b201543d0 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b26200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20151310 con 0x7f1b200aa220 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b20153ff0 0x7f1b2014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b20153ff0 0x7f1b2014ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55076/0 (socket says 172.21.15.100:55076) 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 -- 172.21.15.100:0/3006092171 learned_addr learned my addr 172.21.15.100:0/3006092171 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 -- 172.21.15.100:0/3006092171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b200aa220 msgr2=0x7f1b201548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b200aa220 0x7f1b201548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 -- 172.21.15.100:0/3006092171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b201543d0 msgr2=0x7f1b200c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b201543d0 0x7f1b200c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:03.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.602+0000 7f1b1ea00700 1 -- 172.21.15.100:0/3006092171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08009370 con 0x7f1b20153ff0 2024-01-22T05:38:03.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.603+0000 7f1b1ea00700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b20153ff0 0x7f1b2014ed00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1b08009130 tx=0x7f1b08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:03.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.603+0000 7f1b16a00700 1 -- 172.21.15.100:0/3006092171 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800b8d0 con 0x7f1b20153ff0 2024-01-22T05:38:03.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.603+0000 7f1b16a00700 1 -- 172.21.15.100:0/3006092171 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800ba30 con 0x7f1b20153ff0 2024-01-22T05:38:03.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.603+0000 7f1b16a00700 1 -- 172.21.15.100:0/3006092171 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0801d680 con 0x7f1b20153ff0 2024-01-22T05:38:03.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.603+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b201515f0 con 0x7f1b20153ff0 2024-01-22T05:38:03.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.603+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b20150fc0 con 0x7f1b20153ff0 2024-01-22T05:38:03.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.604+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2005fdb0 con 0x7f1b20153ff0 2024-01-22T05:38:03.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.605+0000 7f1b16a00700 1 -- 172.21.15.100:0/3006092171 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1b0801d9f0 con 0x7f1b20153ff0 2024-01-22T05:38:03.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.606+0000 7f1b16a00700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1af805f150 0x7f1af8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:03.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.606+0000 7f1b16a00700 1 -- 172.21.15.100:0/3006092171 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b0807c170 con 0x7f1b20153ff0 2024-01-22T05:38:03.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.606+0000 7f1b1f400700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1af805f150 0x7f1af8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:03.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.607+0000 7f1b1f400700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1af805f150 0x7f1af8061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1b100011e0 tx=0x7f1b10007830).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:03.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.610+0000 7f1b16a00700 1 -- 172.21.15.100:0/3006092171 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b0804d430 con 0x7f1b20153ff0 2024-01-22T05:38:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.828+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1b200c0100 con 0x7f1b20153ff0 2024-01-22T05:38:03.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.830+0000 7f1b16a00700 1 -- 172.21.15.100:0/3006092171 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148955 (secure 0 0 0) 0x7f1b08050a50 con 0x7f1b20153ff0 2024-01-22T05:38:03.832 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1af805f150 msgr2=0x7f1af8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1af805f150 0x7f1af8061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1b100011e0 tx=0x7f1b10007830).stop 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b20153ff0 msgr2=0x7f1b2014ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b20153ff0 0x7f1b2014ed00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1b08009130 tx=0x7f1b08017000).stop 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 shutdown_connections 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1af805f150 0x7f1af8061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b201543d0 0x7f1b200c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b200aa220 0x7f1b201548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 --2- 172.21.15.100:0/3006092171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b20153ff0 0x7f1b2014ed00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 >> 172.21.15.100:0/3006092171 conn(0x7f1b200c82a0 msgr2=0x7f1b20153130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 shutdown_connections 2024-01-22T05:38:03.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:03.834+0000 7f1b26200700 1 -- 172.21.15.100:0/3006092171 wait complete. 2024-01-22T05:38:03.851 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":4,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":70830},{"type":"v1","addr":"172.21.15.100:6833","nonce":70830}]},"active_addr":"172.21.15.100:6833/70830","active_change":"2024-01-22T05:37:45.118682+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1071919768}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3335896416}]}]} 2024-01-22T05:38:03.855 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-22T05:38:03.855 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-22T05:38:03.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:04.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.037+0000 7f28dda00700 1 Processor -- start 2024-01-22T05:38:04.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.037+0000 7f28dda00700 1 -- start start 2024-01-22T05:38:04.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.038+0000 7f28dda00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 0x7f28d80a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.038+0000 7f28dda00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28d80aa220 0x7f28d80c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.038+0000 7f28dda00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80c66e0 con 0x7f28d8153ff0 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.038+0000 7f28dda00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80c0750 con 0x7f28d80aa220 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.038+0000 7f28dda00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80aa6b0 con 0x7f28d81543d0 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28d80aa220 0x7f28d80c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28d80aa220 0x7f28d80c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55086/0 (socket says 172.21.15.100:55086) 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 -- 172.21.15.100:0/3774345448 learned_addr learned my addr 172.21.15.100:0/3774345448 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d6000700 1 --2- 172.21.15.100:0/3774345448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 0x7f28d80a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 -- 172.21.15.100:0/3774345448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 msgr2=0x7f28d80a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 --2- 172.21.15.100:0/3774345448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 0x7f28d80a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 -- 172.21.15.100:0/3774345448 >> v1:172.21.15.169:6789/0 conn(0x7f28d8153ff0 legacy=0x7f28d80c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 -- 172.21.15.100:0/3774345448 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80bfe20 con 0x7f28d80aa220 2024-01-22T05:38:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.039+0000 7f28d7400700 1 --2- 172.21.15.100:0/3774345448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d80c0be0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f28d0009f20 tx=0x7f28d0009840).ready entity=mon.0 client_cookie=8e0b43dcd2fe1221 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28d5600700 1 -- 172.21.15.100:0/3774345448 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000e070 con 0x7f28d80aa220 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28d5600700 1 -- 172.21.15.100:0/3774345448 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d000ba80 con 0x7f28d80aa220 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28d5600700 1 -- 172.21.15.100:0/3774345448 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000be00 con 0x7f28d80aa220 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 -- 172.21.15.100:0/3774345448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 msgr2=0x7f28d80c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 --2- 172.21.15.100:0/3774345448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d80c0be0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f28d0009f20 tx=0x7f28d0009840).stop 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 -- 172.21.15.100:0/3774345448 shutdown_connections 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 --2- 172.21.15.100:0/3774345448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d80c0be0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 --2- 172.21.15.100:0/3774345448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 0x7f28d80a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 -- 172.21.15.100:0/3774345448 >> 172.21.15.100:0/3774345448 conn(0x7f28d80c82a0 msgr2=0x7f28d805e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 -- 172.21.15.100:0/3774345448 shutdown_connections 2024-01-22T05:38:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.040+0000 7f28dda00700 1 -- 172.21.15.100:0/3774345448 wait complete. 2024-01-22T05:38:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.042+0000 7f28dda00700 1 Processor -- start 2024-01-22T05:38:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.042+0000 7f28dda00700 1 -- start start 2024-01-22T05:38:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28dda00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28dda00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d8153ff0 0x7f28d814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28dda00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 0x7f28d8156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28dda00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8155950 con 0x7f28d80aa220 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28dda00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80c4710 con 0x7f28d8153ff0 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28dda00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80c4430 con 0x7f28d81543d0 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d81534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55094/0 (socket says 172.21.15.100:55094) 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 -- 172.21.15.100:0/2671755637 learned_addr learned my addr 172.21.15.100:0/2671755637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6000700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d8153ff0 0x7f28d814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 -- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 msgr2=0x7f28d8156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 0x7f28d8156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 -- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d8153ff0 msgr2=0x7f28d814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d8153ff0 0x7f28d814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.043+0000 7f28d6a00700 1 -- 172.21.15.100:0/2671755637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0009ae0 con 0x7f28d80aa220 2024-01-22T05:38:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.044+0000 7f28d6000700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d8153ff0 0x7f28d814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.044+0000 7f28d6a00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d81534f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28c800c4c0 tx=0x7f28c8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.044+0000 7f28ce000700 1 -- 172.21.15.100:0/2671755637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8007020 con 0x7f28d80aa220 2024-01-22T05:38:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.044+0000 7f28ce000700 1 -- 172.21.15.100:0/2671755637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c8001e90 con 0x7f28d80aa220 2024-01-22T05:38:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.044+0000 7f28ce000700 1 -- 172.21.15.100:0/2671755637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c80073b0 con 0x7f28d80aa220 2024-01-22T05:38:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.044+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d8155300 con 0x7f28d80aa220 2024-01-22T05:38:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.044+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d814dfb0 con 0x7f28d80aa220 2024-01-22T05:38:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.045+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d805fdb0 con 0x7f28d80aa220 2024-01-22T05:38:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.046+0000 7f28ce000700 1 -- 172.21.15.100:0/2671755637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f28c80068b0 con 0x7f28d80aa220 2024-01-22T05:38:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.047+0000 7f28ce000700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f28b005f150 0x7f28b0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.047+0000 7f28ce000700 1 -- 172.21.15.100:0/2671755637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f28c8079b80 con 0x7f28d80aa220 2024-01-22T05:38:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.047+0000 7f28d6000700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f28b005f150 0x7f28b0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.047+0000 7f28d6000700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f28b005f150 0x7f28b0061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f28d8152ce0 tx=0x7f28c0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.050+0000 7f28ce000700 1 -- 172.21.15.100:0/2671755637 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f28c804ae50 con 0x7f28d80aa220 2024-01-22T05:38:04.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.224+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28d80c0100 con 0x7f28d80aa220 2024-01-22T05:38:04.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.225+0000 7f28ce000700 1 -- 172.21.15.100:0/2671755637 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f28c804e470 con 0x7f28d80aa220 2024-01-22T05:38:04.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:04.225 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f28b005f150 msgr2=0x7f28b0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f28b005f150 0x7f28b0061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f28d8152ce0 tx=0x7f28c0008040).stop 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 msgr2=0x7f28d81534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d81534f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28c800c4c0 tx=0x7f28c8007e00).stop 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 shutdown_connections 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f28b005f150 0x7f28b0061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28d81543d0 0x7f28d8156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d80aa220 0x7f28d81534f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 --2- 172.21.15.100:0/2671755637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28d8153ff0 0x7f28d814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 >> 172.21.15.100:0/2671755637 conn(0x7f28d80c82a0 msgr2=0x7f28d80c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:04.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 shutdown_connections 2024-01-22T05:38:04.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.227+0000 7f28dda00700 1 -- 172.21.15.100:0/2671755637 wait complete. 2024-01-22T05:38:04.244 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-22T05:38:04.245 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:04.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.427+0000 7f91d8c00700 1 Processor -- start 2024-01-22T05:38:04.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.427+0000 7f91d8c00700 1 -- start start 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d8c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91d40c7d30 0x7f91d40be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d8c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d40928b0 con 0x7f91d4153ee0 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d8c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d40bfba0 con 0x7f91d40c45a0 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d8c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d40bef90 con 0x7f91d40c7d30 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d1e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f91d4153ee0 0x7f91d40c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41148/0 (socket says 172.21.15.100:41148) 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d1e00700 1 -- 172.21.15.100:0/290997908 learned_addr learned my addr 172.21.15.100:0/290997908 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d2800700 1 --2- 172.21.15.100:0/290997908 >> v2:172.21.15.100:3300/0 conn(0x7f91d40c7d30 0x7f91d40be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d0a00700 1 -- 172.21.15.100:0/290997908 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314952766 0 0) 0x7f91d40928b0 con 0x7f91d4153ee0 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d0a00700 1 -- 172.21.15.100:0/290997908 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b40033f0 con 0x7f91d4153ee0 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d2800700 1 -- 172.21.15.100:0/290997908 >> v1:172.21.15.169:6789/0 conn(0x7f91d40c45a0 legacy=0x7f91d40be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d2800700 1 -- 172.21.15.100:0/290997908 >> v1:172.21.15.100:6789/0 conn(0x7f91d4153ee0 legacy=0x7f91d40c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.429+0000 7f91d2800700 1 -- 172.21.15.100:0/290997908 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40bf270 con 0x7f91d40c7d30 2024-01-22T05:38:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d2800700 1 --2- 172.21.15.100:0/290997908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d40be9e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f91cc009e60 tx=0x7f91cc009780).ready entity=mon.0 client_cookie=d5a72cbf4e3c5980 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d0a00700 1 -- 172.21.15.100:0/290997908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc00e070 con 0x7f91d40c7d30 2024-01-22T05:38:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d0a00700 1 -- 172.21.15.100:0/290997908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc00bb60 con 0x7f91d40c7d30 2024-01-22T05:38:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d0a00700 1 -- 172.21.15.100:0/290997908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc012410 con 0x7f91d40c7d30 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d8c00700 1 -- 172.21.15.100:0/290997908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 msgr2=0x7f91d40be9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d8c00700 1 --2- 172.21.15.100:0/290997908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d40be9e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f91cc009e60 tx=0x7f91cc009780).stop 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d8c00700 1 -- 172.21.15.100:0/290997908 shutdown_connections 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d8c00700 1 --2- 172.21.15.100:0/290997908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d40be9e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d8c00700 1 -- 172.21.15.100:0/290997908 >> 172.21.15.100:0/290997908 conn(0x7f91d4091a00 msgr2=0x7f91d4091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.430+0000 7f91d8c00700 1 -- 172.21.15.100:0/290997908 shutdown_connections 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.431+0000 7f91d8c00700 1 -- 172.21.15.100:0/290997908 wait complete. 2024-01-22T05:38:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.432+0000 7f91d8c00700 1 Processor -- start 2024-01-22T05:38:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.432+0000 7f91d8c00700 1 -- start start 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d8c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91d40c45a0 0x7f91d4155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d8c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d4168290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d8c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d4153ee0 0x7f91d4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d8c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40ae7d0 con 0x7f91d40c7d30 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d8c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4156ee0 con 0x7f91d4153ee0 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d8c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4168780 con 0x7f91d40c45a0 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d1400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d4168290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d1400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d4168290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55100/0 (socket says 172.21.15.100:55100) 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d1400700 1 -- 172.21.15.100:0/2645641311 learned_addr learned my addr 172.21.15.100:0/2645641311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d2800700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d4153ee0 0x7f91d4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.433+0000 7f91d1e00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91d40c45a0 0x7f91d4155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d1400700 1 -- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91d40c45a0 msgr2=0x7f91d4155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d1400700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91d40c45a0 0x7f91d4155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d1400700 1 -- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d4153ee0 msgr2=0x7f91d4152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d1400700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d4153ee0 0x7f91d4152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d1400700 1 -- 172.21.15.100:0/2645641311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc009a20 con 0x7f91d40c7d30 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d1e00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91d40c45a0 0x7f91d4155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d1400700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d4168290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f91bc00c4c0 tx=0x7f91bc007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91c9600700 1 -- 172.21.15.100:0/2645641311 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc007020 con 0x7f91d40c7d30 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91c9600700 1 -- 172.21.15.100:0/2645641311 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc007180 con 0x7f91d40c7d30 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d41562d0 con 0x7f91d40c7d30 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91c9600700 1 -- 172.21.15.100:0/2645641311 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc007520 con 0x7f91d40c7d30 2024-01-22T05:38:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.434+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d4156890 con 0x7f91d40c7d30 2024-01-22T05:38:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.435+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d41535c0 con 0x7f91d40c7d30 2024-01-22T05:38:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.436+0000 7f91c9600700 1 -- 172.21.15.100:0/2645641311 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f91bc0068b0 con 0x7f91d40c7d30 2024-01-22T05:38:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.437+0000 7f91c9600700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f91ac05f150 0x7f91ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.437+0000 7f91c9600700 1 -- 172.21.15.100:0/2645641311 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f91bc0795c0 con 0x7f91d40c7d30 2024-01-22T05:38:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.437+0000 7f91d1e00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f91ac05f150 0x7f91ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.438+0000 7f91d1e00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f91ac05f150 0x7f91ac061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f91c4007fd0 tx=0x7f91c4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.442+0000 7f91c9600700 1 -- 172.21.15.100:0/2645641311 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f91bc047b00 con 0x7f91d40c7d30 2024-01-22T05:38:04.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.614+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91d405fe00 con 0x7f91d40c7d30 2024-01-22T05:38:04.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.615+0000 7f91c9600700 1 -- 172.21.15.100:0/2645641311 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f91bc04a890 con 0x7f91d40c7d30 2024-01-22T05:38:04.615 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f91ac05f150 msgr2=0x7f91ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f91ac05f150 0x7f91ac061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f91c4007fd0 tx=0x7f91c4009040).stop 2024-01-22T05:38:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 msgr2=0x7f91d4168290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d4168290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f91bc00c4c0 tx=0x7f91bc007dd0).stop 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 shutdown_connections 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f91ac05f150 0x7f91ac061610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d4153ee0 0x7f91d4152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91d40c45a0 0x7f91d4155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 --2- 172.21.15.100:0/2645641311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40c7d30 0x7f91d4168290 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 >> 172.21.15.100:0/2645641311 conn(0x7f91d4091a00 msgr2=0x7f91d40a79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 shutdown_connections 2024-01-22T05:38:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.617+0000 7f91d8c00700 1 -- 172.21.15.100:0/2645641311 wait complete. 2024-01-22T05:38:04.635 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-22T05:38:04.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.821+0000 7f49c1200700 1 Processor -- start 2024-01-22T05:38:04.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.821+0000 7f49c1200700 1 -- start start 2024-01-22T05:38:04.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49c1200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49c1200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49bc1586f0 0x7f49bc0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49c1200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0c1a40 con 0x7f49bc154260 2024-01-22T05:38:04.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49c1200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49bc0cbd30 con 0x7f49bc1586f0 2024-01-22T05:38:04.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49c1200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc158b80 con 0x7f49bc157d80 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49b9e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f49bc154260 0x7f49bc0cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41160/0 (socket says 172.21.15.100:41160) 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49b9e00700 1 -- 172.21.15.100:0/1706656830 learned_addr learned my addr 172.21.15.100:0/1706656830 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.822+0000 7f49ba800700 1 --2- 172.21.15.100:0/1706656830 >> v2:172.21.15.100:3300/0 conn(0x7f49bc1586f0 0x7f49bc0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49b8a00700 1 -- 172.21.15.100:0/1706656830 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553561456 0 0) 0x7f49bc0c1a40 con 0x7f49bc154260 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49b9400700 1 --2- 172.21.15.100:0/1706656830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49b8a00700 1 -- 172.21.15.100:0/1706656830 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f499c0033f0 con 0x7f49bc154260 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49ba800700 1 -- 172.21.15.100:0/1706656830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 msgr2=0x7f49bc158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49ba800700 1 --2- 172.21.15.100:0/1706656830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49ba800700 1 -- 172.21.15.100:0/1706656830 >> v1:172.21.15.100:6789/0 conn(0x7f49bc154260 legacy=0x7f49bc0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49ba800700 1 -- 172.21.15.100:0/1706656830 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc0c1110 con 0x7f49bc1586f0 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49ba800700 1 --2- 172.21.15.100:0/1706656830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc1586f0 0x7f49bc0c8c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f49b4009e90 tx=0x7f49b4009780).ready entity=mon.0 client_cookie=eda113e09dbf6647 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49b8a00700 1 -- 172.21.15.100:0/1706656830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400e070 con 0x7f49bc1586f0 2024-01-22T05:38:04.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49b8a00700 1 -- 172.21.15.100:0/1706656830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400bb20 con 0x7f49bc1586f0 2024-01-22T05:38:04.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.823+0000 7f49b8a00700 1 -- 172.21.15.100:0/1706656830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400bea0 con 0x7f49bc1586f0 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 -- 172.21.15.100:0/1706656830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc1586f0 msgr2=0x7f49bc0c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 --2- 172.21.15.100:0/1706656830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc1586f0 0x7f49bc0c8c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f49b4009e90 tx=0x7f49b4009780).stop 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 -- 172.21.15.100:0/1706656830 shutdown_connections 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 --2- 172.21.15.100:0/1706656830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc1586f0 0x7f49bc0c8c00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 --2- 172.21.15.100:0/1706656830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 -- 172.21.15.100:0/1706656830 >> 172.21.15.100:0/1706656830 conn(0x7f49bc05e9d0 msgr2=0x7f49bc0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 -- 172.21.15.100:0/1706656830 shutdown_connections 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.824+0000 7f49c1200700 1 -- 172.21.15.100:0/1706656830 wait complete. 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.825+0000 7f49c1200700 1 Processor -- start 2024-01-22T05:38:04.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.826+0000 7f49c1200700 1 -- start start 2024-01-22T05:38:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.826+0000 7f49c1200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc154260 0x7f49bc0adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.826+0000 7f49c1200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc0ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.826+0000 7f49c1200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49bc1586f0 0x7f49bc155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.826+0000 7f49c1200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc154640 con 0x7f49bc154260 2024-01-22T05:38:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.826+0000 7f49c1200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc1554a0 con 0x7f49bc1586f0 2024-01-22T05:38:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.826+0000 7f49c1200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc154890 con 0x7f49bc157d80 2024-01-22T05:38:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc154260 0x7f49bc0adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc154260 0x7f49bc0adf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55114/0 (socket says 172.21.15.100:55114) 2024-01-22T05:38:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 -- 172.21.15.100:0/2581356420 learned_addr learned my addr 172.21.15.100:0/2581356420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49ba800700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49bc1586f0 0x7f49bc155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9400700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc0ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 -- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 msgr2=0x7f49bc0ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc0ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 -- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49bc1586f0 msgr2=0x7f49bc155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49bc1586f0 0x7f49bc155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 -- 172.21.15.100:0/2581356420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009a20 con 0x7f49bc154260 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9400700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49bc157d80 0x7f49bc0ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49ba800700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49bc1586f0 0x7f49bc155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b9e00700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc154260 0x7f49bc0adf70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f49ac00c410 tx=0x7f49ac007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0072e0 con 0x7f49bc154260 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac007440 con 0x7f49bc154260 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc154b70 con 0x7f49bc154260 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.827+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac005880 con 0x7f49bc154260 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.828+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc155130 con 0x7f49bc154260 2024-01-22T05:38:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.828+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49bc05fdb0 con 0x7f49bc154260 2024-01-22T05:38:04.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.829+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f49ac005c70 con 0x7f49bc154260 2024-01-22T05:38:04.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.830+0000 7f49b1600700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f499405f150 0x7f4994061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.830+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f49ac079b90 con 0x7f49bc154260 2024-01-22T05:38:04.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.830+0000 7f49b9400700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f499405f150 0x7f4994061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.830+0000 7f49b1600700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7f49940684f0 0x7f499406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:04.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.830+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 --> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f499406afd0 con 0x7f49940684f0 2024-01-22T05:38:04.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.830+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49ac07e220 con 0x7f49bc154260 2024-01-22T05:38:04.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.831+0000 7f49ba800700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7f49940684f0 0x7f499406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:04.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.831+0000 7f49b9400700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f499405f150 0x7f4994061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f49bc1490d0 tx=0x7f49a4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.831+0000 7f49ba800700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7f49940684f0 0x7f499406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:04.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.832+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== osd.0 v2:172.21.15.100:6808/71172 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f499406afd0 con 0x7f49940684f0 2024-01-22T05:38:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.846+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 --> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49bc155780 con 0x7f49940684f0 2024-01-22T05:38:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49b1600700 1 -- 172.21.15.100:0/2581356420 <== osd.0 v2:172.21.15.100:6808/71172 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49bc155780 con 0x7f49940684f0 2024-01-22T05:38:04.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7f49940684f0 msgr2=0x7f499406a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7f49940684f0 0x7f499406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f499405f150 msgr2=0x7f4994061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f499405f150 0x7f4994061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f49bc1490d0 tx=0x7f49a4008040).stop 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc154260 msgr2=0x7f49bc0adf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 --2- 172.21.15.100:0/2581356420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49bc154260 0x7f49bc0adf70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f49ac00c410 tx=0x7f49ac007ae0).stop 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49ba800700 1 -- 172.21.15.100:0/2581356420 reap_dead start 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 shutdown_connections 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 >> 172.21.15.100:0/2581356420 conn(0x7f49bc05e9d0 msgr2=0x7f49bc0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.847+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 shutdown_connections 2024-01-22T05:38:04.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:04.848+0000 7f49c1200700 1 -- 172.21.15.100:0/2581356420 wait complete. 2024-01-22T05:38:04.863 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-01-22T05:38:04.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-22T05:38:05.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.046+0000 7f6b54000700 1 Processor -- start 2024-01-22T05:38:05.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.046+0000 7f6b54000700 1 -- start start 2024-01-22T05:38:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b54000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6b4c157d80 0x7f6b4c158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b54000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b4c1586f0 0x7f6b4c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b54000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c0c1a40 con 0x7f6b4c154260 2024-01-22T05:38:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b54000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c0cbd30 con 0x7f6b4c1586f0 2024-01-22T05:38:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b54000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c158b80 con 0x7f6b4c157d80 2024-01-22T05:38:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b52000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b4c1586f0 0x7f6b4c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b51600700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6b4c154260 0x7f6b4c0cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41170/0 (socket says 172.21.15.100:41170) 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.047+0000 7f6b51600700 1 -- 172.21.15.100:0/1400115810 learned_addr learned my addr 172.21.15.100:0/1400115810 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b50c00700 1 --2- 172.21.15.100:0/1400115810 >> v2:172.21.15.169:3300/0 conn(0x7f6b4c157d80 0x7f6b4c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b52000700 1 -- 172.21.15.100:0/1400115810 >> v2:172.21.15.169:3300/0 conn(0x7f6b4c157d80 msgr2=0x7f6b4c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b52000700 1 --2- 172.21.15.100:0/1400115810 >> v2:172.21.15.169:3300/0 conn(0x7f6b4c157d80 0x7f6b4c158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b52000700 1 -- 172.21.15.100:0/1400115810 >> v1:172.21.15.100:6789/0 conn(0x7f6b4c154260 legacy=0x7f6b4c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b52000700 1 -- 172.21.15.100:0/1400115810 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c0c1110 con 0x7f6b4c1586f0 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b52000700 1 --2- 172.21.15.100:0/1400115810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c0c8c00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6b4c083230 tx=0x7f6b44009780).ready entity=mon.0 client_cookie=d640146eb8fe2158 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b4be00700 1 -- 172.21.15.100:0/1400115810 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400e070 con 0x7f6b4c1586f0 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b4be00700 1 -- 172.21.15.100:0/1400115810 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4400bb60 con 0x7f6b4c1586f0 2024-01-22T05:38:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.048+0000 7f6b4be00700 1 -- 172.21.15.100:0/1400115810 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44012410 con 0x7f6b4c1586f0 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 -- 172.21.15.100:0/1400115810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 msgr2=0x7f6b4c0c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 --2- 172.21.15.100:0/1400115810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c0c8c00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6b4c083230 tx=0x7f6b44009780).stop 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 -- 172.21.15.100:0/1400115810 shutdown_connections 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 --2- 172.21.15.100:0/1400115810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c0c8c00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 --2- 172.21.15.100:0/1400115810 >> v2:172.21.15.169:3300/0 conn(0x7f6b4c157d80 0x7f6b4c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 -- 172.21.15.100:0/1400115810 >> 172.21.15.100:0/1400115810 conn(0x7f6b4c05e9d0 msgr2=0x7f6b4c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 -- 172.21.15.100:0/1400115810 shutdown_connections 2024-01-22T05:38:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.049+0000 7f6b54000700 1 -- 172.21.15.100:0/1400115810 wait complete. 2024-01-22T05:38:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.051+0000 7f6b54000700 1 Processor -- start 2024-01-22T05:38:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.051+0000 7f6b54000700 1 -- start start 2024-01-22T05:38:05.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.052+0000 7f6b54000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b4c154260 0x7f6b4c150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.052+0000 7f6b54000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b4c157d80 0x7f6b4c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.052+0000 7f6b54000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b54000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c0af140 con 0x7f6b4c1586f0 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b54000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c156f80 con 0x7f6b4c154260 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b54000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c157260 con 0x7f6b4c157d80 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55134/0 (socket says 172.21.15.100:55134) 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 -- 172.21.15.100:0/2082639527 learned_addr learned my addr 172.21.15.100:0/2082639527 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b51600700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b4c154260 0x7f6b4c150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b50c00700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b4c157d80 0x7f6b4c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 -- 172.21.15.100:0/2082639527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b4c157d80 msgr2=0x7f6b4c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b4c157d80 0x7f6b4c1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 -- 172.21.15.100:0/2082639527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b4c154260 msgr2=0x7f6b4c150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b4c154260 0x7f6b4c150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 -- 172.21.15.100:0/2082639527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44009a20 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.053+0000 7f6b52000700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c154640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6b4400b6c0 tx=0x7f6b44009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.054+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44012410 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.054+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44009440 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.054+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c157540 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.054+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4401d840 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.054+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c150d10 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.054+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b4c05fdb0 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.055+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6b4401dbb0 con 0x7f6b4c1586f0 2024-01-22T05:38:05.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.056+0000 7f6b48c00700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2405f150 0x7f6b24061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.056+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6b4407ca20 con 0x7f6b4c1586f0 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.056+0000 7f6b51600700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2405f150 0x7f6b24061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.056+0000 7f6b48c00700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f6b240684f0 0x7f6b2406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.056+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 --> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b2406afd0 con 0x7f6b240684f0 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.056+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b4407cd10 con 0x7f6b4c1586f0 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.057+0000 7f6b50c00700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f6b240684f0 0x7f6b2406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.057+0000 7f6b51600700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2405f150 0x7f6b24061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6b3c007fd0 tx=0x7f6b3c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.057+0000 7f6b50c00700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f6b240684f0 0x7f6b2406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.058+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== osd.1 v2:172.21.15.100:6800/71171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6b2406afd0 con 0x7f6b240684f0 2024-01-22T05:38:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.073+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 --> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b4c0c13f0 con 0x7f6b240684f0 2024-01-22T05:38:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.073+0000 7f6b48c00700 1 -- 172.21.15.100:0/2082639527 <== osd.1 v2:172.21.15.100:6800/71171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6b4c0c13f0 con 0x7f6b240684f0 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.073+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f6b240684f0 msgr2=0x7f6b2406a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.073+0000 7f6b54000700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f6b240684f0 0x7f6b2406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.073+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2405f150 msgr2=0x7f6b24061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.073+0000 7f6b54000700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2405f150 0x7f6b24061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6b3c007fd0 tx=0x7f6b3c009040).stop 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.074+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 msgr2=0x7f6b4c154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.074+0000 7f6b54000700 1 --2- 172.21.15.100:0/2082639527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b4c1586f0 0x7f6b4c154640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6b4400b6c0 tx=0x7f6b44009780).stop 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.074+0000 7f6b52000700 1 -- 172.21.15.100:0/2082639527 reap_dead start 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.074+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 shutdown_connections 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.074+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 >> 172.21.15.100:0/2082639527 conn(0x7f6b4c05e9d0 msgr2=0x7f6b4c151640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.074+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 shutdown_connections 2024-01-22T05:38:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.074+0000 7f6b54000700 1 -- 172.21.15.100:0/2082639527 wait complete. 2024-01-22T05:38:05.090 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-01-22T05:38:05.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-22T05:38:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.274+0000 7f8633800700 1 Processor -- start 2024-01-22T05:38:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.274+0000 7f8633800700 1 -- start start 2024-01-22T05:38:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8633800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c154260 0x7f862c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8633800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f862c0c5c80 0x7f862c0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8633800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f862c0c65f0 0x7f862c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8633800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c0c1a40 con 0x7f862c0c5c80 2024-01-22T05:38:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8633800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c0cbd30 con 0x7f862c0c65f0 2024-01-22T05:38:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8633800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c0c6aa0 con 0x7f862c154260 2024-01-22T05:38:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f862c0c5c80 0x7f862c0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f862c0c5c80 0x7f862c0c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55148/0 (socket says 172.21.15.100:55148) 2024-01-22T05:38:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 -- 172.21.15.100:0/3424313074 learned_addr learned my addr 172.21.15.100:0/3424313074 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8630e00700 1 --2- 172.21.15.100:0/3424313074 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c154260 0x7f862c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8631800700 1 --2- 172.21.15.100:0/3424313074 >> v2:172.21.15.169:3300/0 conn(0x7f862c0c65f0 0x7f862c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 -- 172.21.15.100:0/3424313074 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c154260 msgr2=0x7f862c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 --2- 172.21.15.100:0/3424313074 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c154260 0x7f862c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 -- 172.21.15.100:0/3424313074 >> v2:172.21.15.169:3300/0 conn(0x7f862c0c65f0 msgr2=0x7f862c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 --2- 172.21.15.100:0/3424313074 >> v2:172.21.15.169:3300/0 conn(0x7f862c0c65f0 0x7f862c157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f862be00700 1 -- 172.21.15.100:0/3424313074 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0c1110 con 0x7f862c0c5c80 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.276+0000 7f8630e00700 1 --2- 172.21.15.100:0/3424313074 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c154260 0x7f862c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f862be00700 1 --2- 172.21.15.100:0/3424313074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c0c5c80 0x7f862c0c6100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8614006fd0 tx=0x7f86140090f0).ready entity=mon.0 client_cookie=1f8c21a9d3bc1b27 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f862b400700 1 -- 172.21.15.100:0/3424313074 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400b520 con 0x7f862c0c5c80 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f862b400700 1 -- 172.21.15.100:0/3424313074 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861400b680 con 0x7f862c0c5c80 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f862b400700 1 -- 172.21.15.100:0/3424313074 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400ba00 con 0x7f862c0c5c80 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f8633800700 1 -- 172.21.15.100:0/3424313074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c0c5c80 msgr2=0x7f862c0c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f8633800700 1 --2- 172.21.15.100:0/3424313074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c0c5c80 0x7f862c0c6100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8614006fd0 tx=0x7f86140090f0).stop 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f8633800700 1 -- 172.21.15.100:0/3424313074 shutdown_connections 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f8633800700 1 --2- 172.21.15.100:0/3424313074 >> v2:172.21.15.169:3300/0 conn(0x7f862c0c65f0 0x7f862c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f8633800700 1 --2- 172.21.15.100:0/3424313074 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c154260 0x7f862c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f8633800700 1 --2- 172.21.15.100:0/3424313074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c0c5c80 0x7f862c0c6100 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.277+0000 7f8633800700 1 -- 172.21.15.100:0/3424313074 >> 172.21.15.100:0/3424313074 conn(0x7f862c05e9d0 msgr2=0x7f862c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.278+0000 7f8633800700 1 -- 172.21.15.100:0/3424313074 shutdown_connections 2024-01-22T05:38:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.278+0000 7f8633800700 1 -- 172.21.15.100:0/3424313074 wait complete. 2024-01-22T05:38:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.279+0000 7f8633800700 1 Processor -- start 2024-01-22T05:38:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.279+0000 7f8633800700 1 -- start start 2024-01-22T05:38:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.280+0000 7f8633800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c0c5c80 0x7f862c167560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.280+0000 7f8633800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f862c0c65f0 0x7f862c0c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.280+0000 7f8633800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c154260 0x7f862c0a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.280+0000 7f8633800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1652c0 con 0x7f862c154260 2024-01-22T05:38:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.280+0000 7f8633800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1646b0 con 0x7f862c0c65f0 2024-01-22T05:38:05.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.280+0000 7f8633800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c164990 con 0x7f862c0c5c80 2024-01-22T05:38:05.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.280+0000 7f8631800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c154260 0x7f862c0a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c154260 0x7f862c0a9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55162/0 (socket says 172.21.15.100:55162) 2024-01-22T05:38:05.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f862be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f862c0c65f0 0x7f862c0c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 -- 172.21.15.100:0/2287551155 learned_addr learned my addr 172.21.15.100:0/2287551155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:05.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8630e00700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c0c5c80 0x7f862c167560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 -- 172.21.15.100:0/2287551155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c0c5c80 msgr2=0x7f862c167560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862c0c5c80 0x7f862c167560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 -- 172.21.15.100:0/2287551155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f862c0c65f0 msgr2=0x7f862c0c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f862c0c65f0 0x7f862c0c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 -- 172.21.15.100:0/2287551155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614009370 con 0x7f862c154260 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8631800700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c154260 0x7f862c0a9500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f8624009e90 tx=0x7f862400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400caa0 con 0x7f862c154260 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400f040 con 0x7f862c154260 2024-01-22T05:38:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c164c70 con 0x7f862c154260 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400ce10 con 0x7f862c154260 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.281+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c0c22c0 con 0x7f862c154260 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.282+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f862c05fdb0 con 0x7f862c154260 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.283+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8624013610 con 0x7f862c154260 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f8623e00700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f860405f150 0x7f8604061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f862407ab10 con 0x7f862c154260 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f8630e00700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f860405f150 0x7f8604061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f8623e00700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f86040684f0 0x7f860406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 --> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f860406afd0 con 0x7f86040684f0 2024-01-22T05:38:05.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f862407f220 con 0x7f862c154260 2024-01-22T05:38:05.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f862be00700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f86040684f0 0x7f860406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.284+0000 7f8630e00700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f860405f150 0x7f8604061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f861c00baf0 tx=0x7f861c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.285+0000 7f862be00700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f86040684f0 0x7f860406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.286+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== osd.2 v2:172.21.15.100:6816/71181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f860406afd0 con 0x7f86040684f0 2024-01-22T05:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.300+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 --> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f862c0c13f0 con 0x7f86040684f0 2024-01-22T05:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.300+0000 7f8623e00700 1 -- 172.21.15.100:0/2287551155 <== osd.2 v2:172.21.15.100:6816/71181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f862c0c13f0 con 0x7f86040684f0 2024-01-22T05:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f86040684f0 msgr2=0x7f860406a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f86040684f0 0x7f860406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f860405f150 msgr2=0x7f8604061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f860405f150 0x7f8604061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f861c00baf0 tx=0x7f861c008040).stop 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c154260 msgr2=0x7f862c0a9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 --2- 172.21.15.100:0/2287551155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f862c154260 0x7f862c0a9500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f8624009e90 tx=0x7f862400b040).stop 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8631800700 1 -- 172.21.15.100:0/2287551155 reap_dead start 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 shutdown_connections 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 >> 172.21.15.100:0/2287551155 conn(0x7f862c05e9d0 msgr2=0x7f862c064910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 shutdown_connections 2024-01-22T05:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.301+0000 7f8633800700 1 -- 172.21.15.100:0/2287551155 wait complete. 2024-01-22T05:38:05.317 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-01-22T05:38:05.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-22T05:38:05.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.502+0000 7f6dda800700 1 Processor -- start 2024-01-22T05:38:05.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.502+0000 7f6dda800700 1 -- start start 2024-01-22T05:38:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.503+0000 7f6dda800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6dd4157d80 0x7f6dd4158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.503+0000 7f6dda800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40c1a40 con 0x7f6dd41586f0 2024-01-22T05:38:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.503+0000 7f6dda800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40cbd30 con 0x7f6dd4154260 2024-01-22T05:38:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.503+0000 7f6dda800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd4158b80 con 0x7f6dd4157d80 2024-01-22T05:38:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd3e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6dd41586f0 0x7f6dd40c8c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41178/0 (socket says 172.21.15.100:41178) 2024-01-22T05:38:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd3e00700 1 -- 172.21.15.100:0/3830153893 learned_addr learned my addr 172.21.15.100:0/3830153893 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2a00700 1 --2- 172.21.15.100:0/3830153893 >> v2:172.21.15.169:3300/0 conn(0x7f6dd4157d80 0x7f6dd4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2000700 1 -- 172.21.15.100:0/3830153893 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624273107 0 0) 0x7f6dd40c1a40 con 0x7f6dd41586f0 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2000700 1 -- 172.21.15.100:0/3830153893 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db40033f0 con 0x7f6dd41586f0 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2a00700 1 -- 172.21.15.100:0/3830153893 >> v1:172.21.15.169:6789/0 conn(0x7f6dd4154260 legacy=0x7f6dd40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2000700 1 -- 172.21.15.100:0/3830153893 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408973091 0 0) 0x7f6dd40cbd30 con 0x7f6dd4154260 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2a00700 1 -- 172.21.15.100:0/3830153893 >> v1:172.21.15.100:6789/0 conn(0x7f6dd41586f0 legacy=0x7f6dd40c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2a00700 1 -- 172.21.15.100:0/3830153893 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40c1110 con 0x7f6dd4157d80 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.504+0000 7f6dd2a00700 1 --2- 172.21.15.100:0/3830153893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd4157d80 0x7f6dd4158200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6dbc009760 tx=0x7f6dbc009060).ready entity=mon.1 client_cookie=bab3a369e48f4757 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dd2000700 1 -- 172.21.15.100:0/3830153893 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00f510 con 0x7f6dd4157d80 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dd2000700 1 -- 172.21.15.100:0/3830153893 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00f670 con 0x7f6dd4157d80 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dd2000700 1 -- 172.21.15.100:0/3830153893 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00f9f0 con 0x7f6dd4157d80 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dda800700 1 -- 172.21.15.100:0/3830153893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd4157d80 msgr2=0x7f6dd4158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dda800700 1 --2- 172.21.15.100:0/3830153893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd4157d80 0x7f6dd4158200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6dbc009760 tx=0x7f6dbc009060).stop 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dda800700 1 -- 172.21.15.100:0/3830153893 shutdown_connections 2024-01-22T05:38:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dda800700 1 --2- 172.21.15.100:0/3830153893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd4157d80 0x7f6dd4158200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dda800700 1 -- 172.21.15.100:0/3830153893 >> 172.21.15.100:0/3830153893 conn(0x7f6dd405e9d0 msgr2=0x7f6dd40cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dda800700 1 -- 172.21.15.100:0/3830153893 shutdown_connections 2024-01-22T05:38:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.505+0000 7f6dda800700 1 -- 172.21.15.100:0/3830153893 wait complete. 2024-01-22T05:38:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.507+0000 7f6dda800700 1 Processor -- start 2024-01-22T05:38:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.507+0000 7f6dda800700 1 -- start start 2024-01-22T05:38:05.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dda800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6dd4154260 0x7f6dd4155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dda800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd4157d80 0x7f6dd40afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dda800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd41586f0 0x7f6dd40ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dda800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40adf70 con 0x7f6dd4157d80 2024-01-22T05:38:05.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dda800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4155e40 con 0x7f6dd41586f0 2024-01-22T05:38:05.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dda800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4156120 con 0x7f6dd4154260 2024-01-22T05:38:05.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dd2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd4157d80 0x7f6dd40afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dd2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd4157d80 0x7f6dd40afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55166/0 (socket says 172.21.15.100:55166) 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dd2a00700 1 -- 172.21.15.100:0/2100955972 learned_addr learned my addr 172.21.15.100:0/2100955972 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dd3e00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd41586f0 0x7f6dd40ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dd2a00700 1 -- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6dd4154260 msgr2=0x7f6dd4155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.508+0000 7f6dd3400700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6dd4154260 0x7f6dd4155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dd2a00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6dd4154260 0x7f6dd4155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dd2a00700 1 -- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd41586f0 msgr2=0x7f6dd40ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dd2a00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd41586f0 0x7f6dd40ab470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dd2a00700 1 -- 172.21.15.100:0/2100955972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0092a0 con 0x7f6dd4157d80 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dd3400700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6dd4154260 0x7f6dd4155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dd3e00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6dd41586f0 0x7f6dd40ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dd2a00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd4157d80 0x7f6dd40afe70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6dbc009e00 tx=0x7f6dbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00f7e0 con 0x7f6dd4157d80 2024-01-22T05:38:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00f960 con 0x7f6dd4157d80 2024-01-22T05:38:05.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc01b660 con 0x7f6dd4157d80 2024-01-22T05:38:05.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd4156400 con 0x7f6dd4157d80 2024-01-22T05:38:05.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.509+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd40b0360 con 0x7f6dd4157d80 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.510+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dd40b0570 con 0x7f6dd4157d80 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.511+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6dbc01ba10 con 0x7f6dd4157d80 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dcaa00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6dac05f150 0x7f6dac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6dbc07bda0 con 0x7f6dd4157d80 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dd3400700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6dac05f150 0x7f6dac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dcaa00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7f6dac0684f0 0x7f6dac06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 --> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dac06afd0 con 0x7f6dac0684f0 2024-01-22T05:38:05.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dbc07e300 con 0x7f6dd4157d80 2024-01-22T05:38:05.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dd3e00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7f6dac0684f0 0x7f6dac06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.512+0000 7f6dd3400700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6dac05f150 0x7f6dac061610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f6dc4001230 tx=0x7f6dc4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.513+0000 7f6dd3e00700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7f6dac0684f0 0x7f6dac06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.513+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== osd.3 v2:172.21.15.100:6817/71188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6dac06afd0 con 0x7f6dac0684f0 2024-01-22T05:38:05.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.528+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 --> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6dd4083b80 con 0x7f6dac0684f0 2024-01-22T05:38:05.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.528+0000 7f6dcaa00700 1 -- 172.21.15.100:0/2100955972 <== osd.3 v2:172.21.15.100:6817/71188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6dd4083b80 con 0x7f6dac0684f0 2024-01-22T05:38:05.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7f6dac0684f0 msgr2=0x7f6dac06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7f6dac0684f0 0x7f6dac06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6dac05f150 msgr2=0x7f6dac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6dac05f150 0x7f6dac061610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f6dc4001230 tx=0x7f6dc4009040).stop 2024-01-22T05:38:05.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd4157d80 msgr2=0x7f6dd40afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 --2- 172.21.15.100:0/2100955972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd4157d80 0x7f6dd40afe70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6dbc009e00 tx=0x7f6dbc017000).stop 2024-01-22T05:38:05.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dd3e00700 1 -- 172.21.15.100:0/2100955972 reap_dead start 2024-01-22T05:38:05.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 shutdown_connections 2024-01-22T05:38:05.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 >> 172.21.15.100:0/2100955972 conn(0x7f6dd405e9d0 msgr2=0x7f6dd41515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 shutdown_connections 2024-01-22T05:38:05.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.529+0000 7f6dda800700 1 -- 172.21.15.100:0/2100955972 wait complete. 2024-01-22T05:38:05.545 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-01-22T05:38:05.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-22T05:38:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.728+0000 7ff027a00700 1 Processor -- start 2024-01-22T05:38:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.728+0000 7ff027a00700 1 -- start start 2024-01-22T05:38:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.729+0000 7ff027a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff020154260 0x7ff0200cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff027a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff0200c5c80 0x7ff0200c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff027a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0200c1a40 con 0x7ff0200c65f0 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff027a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0200cbd30 con 0x7ff020154260 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff027a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0200c6a80 con 0x7ff0200c5c80 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff020154260 0x7ff0200cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff020154260 0x7ff0200cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55180/0 (socket says 172.21.15.100:55180) 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 -- 172.21.15.100:0/1634771340 learned_addr learned my addr 172.21.15.100:0/1634771340 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff01fe00700 1 --2- 172.21.15.100:0/1634771340 >> v2:172.21.15.169:3300/0 conn(0x7ff0200c5c80 0x7ff0200c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 -- 172.21.15.100:0/1634771340 >> v2:172.21.15.169:3300/0 conn(0x7ff0200c5c80 msgr2=0x7ff0200c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 --2- 172.21.15.100:0/1634771340 >> v2:172.21.15.169:3300/0 conn(0x7ff0200c5c80 0x7ff0200c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 -- 172.21.15.100:0/1634771340 >> v1:172.21.15.169:6789/0 conn(0x7ff0200c65f0 legacy=0x7ff020157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 -- 172.21.15.100:0/1634771340 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0200c1110 con 0x7ff020154260 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.730+0000 7ff025000700 1 --2- 172.21.15.100:0/1634771340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff020154260 0x7ff0200cb4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff020083230 tx=0x7ff0100090f0).ready entity=mon.0 client_cookie=581e085dd6f7e628 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff01f400700 1 -- 172.21.15.100:0/1634771340 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000b520 con 0x7ff020154260 2024-01-22T05:38:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff01f400700 1 -- 172.21.15.100:0/1634771340 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000b680 con 0x7ff020154260 2024-01-22T05:38:05.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff01f400700 1 -- 172.21.15.100:0/1634771340 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000ba00 con 0x7ff020154260 2024-01-22T05:38:05.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 -- 172.21.15.100:0/1634771340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff020154260 msgr2=0x7ff0200cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 --2- 172.21.15.100:0/1634771340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff020154260 0x7ff0200cb4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff020083230 tx=0x7ff0100090f0).stop 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 -- 172.21.15.100:0/1634771340 shutdown_connections 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 --2- 172.21.15.100:0/1634771340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff020154260 0x7ff0200cb4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 --2- 172.21.15.100:0/1634771340 >> v2:172.21.15.169:3300/0 conn(0x7ff0200c5c80 0x7ff0200c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 -- 172.21.15.100:0/1634771340 >> 172.21.15.100:0/1634771340 conn(0x7ff02005e9d0 msgr2=0x7ff0200cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 -- 172.21.15.100:0/1634771340 shutdown_connections 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.731+0000 7ff027a00700 1 -- 172.21.15.100:0/1634771340 wait complete. 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.733+0000 7ff027a00700 1 Processor -- start 2024-01-22T05:38:05.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.733+0000 7ff027a00700 1 -- start start 2024-01-22T05:38:05.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff027a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0200c5c80 0x7ff0200c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff027a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0200c65f0 0x7ff0200ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff027a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff020154260 0x7ff0200635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff027a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200c2270 con 0x7ff0200c5c80 2024-01-22T05:38:05.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff027a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0201656d0 con 0x7ff0200c65f0 2024-01-22T05:38:05.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff027a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200c3880 con 0x7ff020154260 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0200c5c80 0x7ff0200c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0200c5c80 0x7ff0200c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55192/0 (socket says 172.21.15.100:55192) 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 -- 172.21.15.100:0/1641209371 learned_addr learned my addr 172.21.15.100:0/1641209371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025a00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff020154260 0x7ff0200635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff01fe00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0200c65f0 0x7ff0200ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 -- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff020154260 msgr2=0x7ff0200635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff020154260 0x7ff0200635f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 -- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0200c65f0 msgr2=0x7ff0200ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0200c65f0 0x7ff0200ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025000700 1 -- 172.21.15.100:0/1641209371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010009310 con 0x7ff0200c5c80 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff025a00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff020154260 0x7ff0200635f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.734+0000 7ff01fe00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0200c65f0 0x7ff0200ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:05.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.735+0000 7ff025000700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0200c5c80 0x7ff0200c3390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff020083620 tx=0x7ff010015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.735+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000b7f0 con 0x7ff0200c5c80 2024-01-22T05:38:05.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.735+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000b950 con 0x7ff0200c5c80 2024-01-22T05:38:05.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.735+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0201653f0 con 0x7ff0200c5c80 2024-01-22T05:38:05.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.735+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01001b660 con 0x7ff0200c5c80 2024-01-22T05:38:05.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.735+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0200aacc0 con 0x7ff0200c5c80 2024-01-22T05:38:05.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.736+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff02005fdb0 con 0x7ff0200c5c80 2024-01-22T05:38:05.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.737+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff01001ba50 con 0x7ff0200c5c80 2024-01-22T05:38:05.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.737+0000 7ff017e00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff805f150 0x7feff8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.737+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff01007bba0 con 0x7ff0200c5c80 2024-01-22T05:38:05.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.738+0000 7ff01fe00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff805f150 0x7feff8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.738+0000 7ff017e00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7feff80684f0 0x7feff806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.738+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 --> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feff806afd0 con 0x7feff80684f0 2024-01-22T05:38:05.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.738+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff010080220 con 0x7ff0200c5c80 2024-01-22T05:38:05.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.738+0000 7ff025a00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7feff80684f0 0x7feff806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.738+0000 7ff01fe00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff805f150 0x7feff8061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff0200c5330 tx=0x7ff008008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.739+0000 7ff025a00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7feff80684f0 0x7feff806a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.740+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== osd.4 v2:172.21.15.169:6800/71444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7feff806afd0 con 0x7feff80684f0 2024-01-22T05:38:05.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.754+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 --> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff0200c13f0 con 0x7feff80684f0 2024-01-22T05:38:05.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.755+0000 7ff017e00700 1 -- 172.21.15.100:0/1641209371 <== osd.4 v2:172.21.15.169:6800/71444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff0200c13f0 con 0x7feff80684f0 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.755+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7feff80684f0 msgr2=0x7feff806a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.755+0000 7ff027a00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7feff80684f0 0x7feff806a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.755+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff805f150 msgr2=0x7feff8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.755+0000 7ff027a00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff805f150 0x7feff8061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff0200c5330 tx=0x7ff008008040).stop 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.756+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0200c5c80 msgr2=0x7ff0200c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.756+0000 7ff027a00700 1 --2- 172.21.15.100:0/1641209371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0200c5c80 0x7ff0200c3390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff020083620 tx=0x7ff010015000).stop 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.756+0000 7ff025a00700 1 -- 172.21.15.100:0/1641209371 reap_dead start 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.756+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 shutdown_connections 2024-01-22T05:38:05.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.756+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 >> 172.21.15.100:0/1641209371 conn(0x7ff02005e9d0 msgr2=0x7ff0200a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.756+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 shutdown_connections 2024-01-22T05:38:05.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.756+0000 7ff027a00700 1 -- 172.21.15.100:0/1641209371 wait complete. 2024-01-22T05:38:05.771 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-01-22T05:38:05.772 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-22T05:38:05.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.957+0000 7fb8f2000700 1 Processor -- start 2024-01-22T05:38:05.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.957+0000 7fb8f2000700 1 -- start start 2024-01-22T05:38:05.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.958+0000 7fb8f2000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec0c9c10 0x7fb8ec15f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.958+0000 7fb8f2000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0c1a40 con 0x7fb8ec154260 2024-01-22T05:38:05.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.958+0000 7fb8f2000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0cbd30 con 0x7fb8ec157d80 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.958+0000 7fb8f2000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c1110 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.958+0000 7fb8eb400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb8ec154260 0x7fb8ec0cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41184/0 (socket says 172.21.15.100:41184) 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.958+0000 7fb8eb400700 1 -- 172.21.15.100:0/80333237 learned_addr learned my addr 172.21.15.100:0/80333237 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.958+0000 7fb8ebe00700 1 --2- 172.21.15.100:0/80333237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec0c9c10 0x7fb8ec15f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811017792 0 0) 0x7fb8ec0c1a40 con 0x7fb8ec154260 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8cc0033f0 con 0x7fb8ec154260 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812546096 0 0) 0x7fb8ec0cbd30 con 0x7fb8ec157d80 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ec0c1a40 con 0x7fb8ec157d80 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ebe00700 1 -- 172.21.15.100:0/80333237 >> v1:172.21.15.169:6789/0 conn(0x7fb8ec157d80 legacy=0x7fb8ec158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ebe00700 1 -- 172.21.15.100:0/80333237 >> v1:172.21.15.100:6789/0 conn(0x7fb8ec154260 legacy=0x7fb8ec0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703303587 0 0) 0x7fb8cc0033f0 con 0x7fb8ec154260 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ebe00700 1 -- 172.21.15.100:0/80333237 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0c13f0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ebe00700 1 --2- 172.21.15.100:0/80333237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec0c9c10 0x7fb8ec15f0c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb8e4009e90 tx=0x7fb8e4009780).ready entity=mon.2 client_cookie=a341866f38be5dbc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.959+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400e070 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400b7a0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8ea000700 1 -- 172.21.15.100:0/80333237 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0015f0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8f2000700 1 -- 172.21.15.100:0/80333237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec0c9c10 msgr2=0x7fb8ec15f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8f2000700 1 --2- 172.21.15.100:0/80333237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec0c9c10 0x7fb8ec15f0c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb8e4009e90 tx=0x7fb8e4009780).stop 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8f2000700 1 -- 172.21.15.100:0/80333237 shutdown_connections 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8f2000700 1 --2- 172.21.15.100:0/80333237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec0c9c10 0x7fb8ec15f0c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8f2000700 1 -- 172.21.15.100:0/80333237 >> 172.21.15.100:0/80333237 conn(0x7fb8ec05e9d0 msgr2=0x7fb8ec0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8f2000700 1 -- 172.21.15.100:0/80333237 shutdown_connections 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.960+0000 7fb8f2000700 1 -- 172.21.15.100:0/80333237 wait complete. 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.962+0000 7fb8f2000700 1 Processor -- start 2024-01-22T05:38:05.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.962+0000 7fb8f2000700 1 -- start start 2024-01-22T05:38:05.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8f2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ec0c9c10 0x7fb8ec165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8f2000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8ec154260 0x7fb8ec0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8f2000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec157d80 0x7fb8ec156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8f2000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0aa9c0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8f2000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec165500 con 0x7fb8ec154260 2024-01-22T05:38:05.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8f2000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec164290 con 0x7fb8ec157d80 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ec0c9c10 0x7fb8ec165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ec0c9c10 0x7fb8ec165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55196/0 (socket says 172.21.15.100:55196) 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 -- 172.21.15.100:0/1392274540 learned_addr learned my addr 172.21.15.100:0/1392274540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eaa00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8ec154260 0x7fb8ec0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8ebe00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec157d80 0x7fb8ec156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 -- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec157d80 msgr2=0x7fb8ec156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec157d80 0x7fb8ec156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 -- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8ec154260 msgr2=0x7fb8ec0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8ec154260 0x7fb8ec0af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 -- 172.21.15.100:0/1392274540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009a20 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eaa00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8ec154260 0x7fb8ec0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8ebe00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8ec157d80 0x7fb8ec156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.963+0000 7fb8eb400700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ec0c9c10 0x7fb8ec165010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb8dc00c810 tx=0x7fb8dc0013b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.964+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc007320 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.964+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc0074a0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.964+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec164570 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.964+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0058c0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.964+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec164b30 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.965+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8ec05fdb0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.965+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb8dc005c30 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.966+0000 7fb8e2a00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb8c405f150 0x7fb8c4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.966+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb8dc07a1c0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.966+0000 7fb8eaa00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb8c405f150 0x7fb8c4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.966+0000 7fb8e2a00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7fb8c40684f0 0x7fb8c406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.966+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 --> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8c406afd0 con 0x7fb8c40684f0 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.966+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8dc07c7e0 con 0x7fb8ec0c9c10 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.967+0000 7fb8ebe00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7fb8c40684f0 0x7fb8c406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:05.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.967+0000 7fb8eaa00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb8c405f150 0x7fb8c4061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb8d4003720 tx=0x7fb8d4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.967+0000 7fb8ebe00700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7fb8c40684f0 0x7fb8c406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:05.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.968+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== osd.5 v2:172.21.15.169:6808/71446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fb8c406afd0 con 0x7fb8c40684f0 2024-01-22T05:38:05.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.983+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 --> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8ec164cf0 con 0x7fb8c40684f0 2024-01-22T05:38:05.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8e2a00700 1 -- 172.21.15.100:0/1392274540 <== osd.5 v2:172.21.15.169:6808/71446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb8ec164cf0 con 0x7fb8c40684f0 2024-01-22T05:38:05.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7fb8c40684f0 msgr2=0x7fb8c406a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7fb8c40684f0 0x7fb8c406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb8c405f150 msgr2=0x7fb8c4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb8c405f150 0x7fb8c4061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb8d4003720 tx=0x7fb8d4009040).stop 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ec0c9c10 msgr2=0x7fb8ec165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 --2- 172.21.15.100:0/1392274540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ec0c9c10 0x7fb8ec165010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb8dc00c810 tx=0x7fb8dc0013b0).stop 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8ebe00700 1 -- 172.21.15.100:0/1392274540 reap_dead start 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 shutdown_connections 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 >> 172.21.15.100:0/1392274540 conn(0x7fb8ec05e9d0 msgr2=0x7fb8ec0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 shutdown_connections 2024-01-22T05:38:05.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:05.984+0000 7fb8f2000700 1 -- 172.21.15.100:0/1392274540 wait complete. 2024-01-22T05:38:06.002 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-01-22T05:38:06.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-22T05:38:06.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.186+0000 7faefbc00700 1 Processor -- start 2024-01-22T05:38:06.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.186+0000 7faefbc00700 1 -- start start 2024-01-22T05:38:06.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.187+0000 7faefbc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 0x7faef40aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.187+0000 7faefbc00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef40c74b0 con 0x7faef40a9f60 2024-01-22T05:38:06.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.187+0000 7faefbc00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef4158660 con 0x7faef40c1940 2024-01-22T05:38:06.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.187+0000 7faefbc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef4158940 con 0x7faef405e900 2024-01-22T05:38:06.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.187+0000 7faef9200700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faef40a9f60 0x7faef405e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41186/0 (socket says 172.21.15.100:41186) 2024-01-22T05:38:06.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.187+0000 7faef9200700 1 -- 172.21.15.100:0/3787384363 learned_addr learned my addr 172.21.15.100:0/3787384363 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16171021 0 0) 0x7faef40c74b0 con 0x7faef40a9f60 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faeebe00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 0x7faef40aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed40033f0 con 0x7faef40a9f60 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874819695 0 0) 0x7faed40033f0 con 0x7faef40a9f60 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 msgr2=0x7faef40aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 0x7faef40aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 >> v1:172.21.15.169:6789/0 conn(0x7faef40c1940 legacy=0x7faef4098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef40c7140 con 0x7faef40a9f60 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7faee4001470 con 0x7faef40a9f60 2024-01-22T05:38:06.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 >> v1:172.21.15.100:6789/0 conn(0x7faef40a9f60 legacy=0x7faef405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 0x7faed4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed4003e00 0x7faed4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faed4004b80 0x7faed4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4158940 con 0x7faed4003e00 2024-01-22T05:38:06.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed400b8e0 con 0x7faed4004b80 2024-01-22T05:38:06.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.188+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed400baa0 con 0x7faef405e900 2024-01-22T05:38:06.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faeebe00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed4003e00 0x7faed4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faef9c00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faed4004b80 0x7faed4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faef9200700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 0x7faed4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faeebe00700 1 -- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 msgr2=0x7faed4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faeebe00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faef405e900 0x7faed4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faeebe00700 1 -- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faed4004b80 msgr2=0x7faed4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faeebe00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faed4004b80 0x7faed4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faeebe00700 1 -- 172.21.15.100:0/3787384363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40033f0 con 0x7faed4003e00 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faef9c00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faed4004b80 0x7faed4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faeebe00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed4003e00 0x7faed4004690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7faef405ed00 tx=0x7faedc009060).ready entity=mon.0 client_cookie=403f942f9b366cbb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc009e90 con 0x7faed4003e00 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc009430 con 0x7faed4003e00 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.189+0000 7faef3e00700 1 -- 172.21.15.100:0/3787384363 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00e850 con 0x7faed4003e00 2024-01-22T05:38:06.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.190+0000 7faefbc00700 1 -- 172.21.15.100:0/3787384363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed4003e00 msgr2=0x7faed4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.190+0000 7faefbc00700 1 --2- 172.21.15.100:0/3787384363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed4003e00 0x7faed4004690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7faef405ed00 tx=0x7faedc009060).stop 2024-01-22T05:38:06.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.190+0000 7faef9c00700 1 -- 172.21.15.100:0/3787384363 reap_dead start 2024-01-22T05:38:06.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.190+0000 7faefbc00700 1 -- 172.21.15.100:0/3787384363 shutdown_connections 2024-01-22T05:38:06.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.190+0000 7faefbc00700 1 -- 172.21.15.100:0/3787384363 >> 172.21.15.100:0/3787384363 conn(0x7faef40cada0 msgr2=0x7faef40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:06.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.190+0000 7faefbc00700 1 -- 172.21.15.100:0/3787384363 shutdown_connections 2024-01-22T05:38:06.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.190+0000 7faefbc00700 1 -- 172.21.15.100:0/3787384363 wait complete. 2024-01-22T05:38:06.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.191+0000 7faefbc00700 1 Processor -- start 2024-01-22T05:38:06.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.191+0000 7faefbc00700 1 -- start start 2024-01-22T05:38:06.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.192+0000 7faefbc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faed4003e00 0x7faef41529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.192+0000 7faefbc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faef40c32d0 0x7faef40c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.192+0000 7faefbc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faef4155720 0x7faef4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.192+0000 7faefbc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4152e90 con 0x7faef4155720 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.192+0000 7faefbc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef40ad1a0 con 0x7faef40c32d0 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.192+0000 7faefbc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef4154680 con 0x7faed4003e00 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faef4155720 0x7faef4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faef4155720 0x7faef4155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55200/0 (socket says 172.21.15.100:55200) 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 -- 172.21.15.100:0/3418382573 learned_addr learned my addr 172.21.15.100:0/3418382573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9200700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faed4003e00 0x7faef41529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faeebe00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faef40c32d0 0x7faef40c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 -- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faed4003e00 msgr2=0x7faef41529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faed4003e00 0x7faef41529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 -- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faef40c32d0 msgr2=0x7faef40c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faef40c32d0 0x7faef40c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 -- 172.21.15.100:0/3418382573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4154960 con 0x7faef4155720 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef9c00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faef4155720 0x7faef4155b80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7faeec0013d0 tx=0x7faeec009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec002490 con 0x7faef4155720 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec0025f0 con 0x7faef4155720 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec002970 con 0x7faef4155720 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.193+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef4154c40 con 0x7faef4155720 2024-01-22T05:38:06.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.194+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef4155200 con 0x7faef4155720 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.194+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faef405fdb0 con 0x7faef4155720 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.195+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faeec003070 con 0x7faef4155720 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.196+0000 7faef0c00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7faecc05f150 0x7faecc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.196+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faeec079c20 con 0x7faef4155720 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.196+0000 7faef9200700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7faecc05f150 0x7faecc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.196+0000 7faef0c00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7faecc0684f0 0x7faecc06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.196+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 --> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faecc06afd0 con 0x7faecc0684f0 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.196+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeec07e220 con 0x7faef4155720 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.197+0000 7faef9200700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7faecc05f150 0x7faecc061610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7faef40c5340 tx=0x7faee4007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.197+0000 7faeebe00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7faecc0684f0 0x7faecc06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.197+0000 7faeebe00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7faecc0684f0 0x7faecc06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.199+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== osd.6 v2:172.21.15.169:6823/71469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7faecc06afd0 con 0x7faecc0684f0 2024-01-22T05:38:06.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.213+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 --> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faef40ca030 con 0x7faecc0684f0 2024-01-22T05:38:06.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.213+0000 7faef0c00700 1 -- 172.21.15.100:0/3418382573 <== osd.6 v2:172.21.15.169:6823/71469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faef40ca030 con 0x7faecc0684f0 2024-01-22T05:38:06.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7faecc0684f0 msgr2=0x7faecc06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7faecc0684f0 0x7faecc06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7faecc05f150 msgr2=0x7faecc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7faecc05f150 0x7faecc061610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7faef40c5340 tx=0x7faee4007040).stop 2024-01-22T05:38:06.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faef4155720 msgr2=0x7faef4155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 --2- 172.21.15.100:0/3418382573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faef4155720 0x7faef4155b80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7faeec0013d0 tx=0x7faeec009040).stop 2024-01-22T05:38:06.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faef9c00700 1 -- 172.21.15.100:0/3418382573 reap_dead start 2024-01-22T05:38:06.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 shutdown_connections 2024-01-22T05:38:06.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 >> 172.21.15.100:0/3418382573 conn(0x7faef40cada0 msgr2=0x7faef4153500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:06.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 shutdown_connections 2024-01-22T05:38:06.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.214+0000 7faefbc00700 1 -- 172.21.15.100:0/3418382573 wait complete. 2024-01-22T05:38:06.230 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-01-22T05:38:06.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-22T05:38:06.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.417+0000 7f825ce00700 1 Processor -- start 2024-01-22T05:38:06.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.417+0000 7f825ce00700 1 -- start start 2024-01-22T05:38:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.418+0000 7f825ce00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8258153e90 0x7f8258154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.418+0000 7f825ce00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c88c0 0x7f8258157c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.418+0000 7f825ce00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82580c0310 con 0x7f82580c8ca0 2024-01-22T05:38:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.418+0000 7f825ce00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580c6f20 con 0x7f8258153e90 2024-01-22T05:38:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.418+0000 7f825ce00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580c71c0 con 0x7f82580c88c0 2024-01-22T05:38:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8258153e90 0x7f8258154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c88c0 0x7f8258157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8258153e90 0x7f8258154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:37960/0 (socket says 172.21.15.100:37960) 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c88c0 0x7f8258157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:53510/0 (socket says 172.21.15.100:53510) 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 -- 172.21.15.100:0/3784062627 learned_addr learned my addr 172.21.15.100:0/3784062627 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8256800700 1 --1- 172.21.15.100:0/3784062627 >> v1:172.21.15.169:6789/0 conn(0x7f82580c8ca0 0x7f82580c61d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:53612/0 (socket says 172.21.15.100:53612) 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 -- 172.21.15.100:0/3784062627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c88c0 msgr2=0x7f8258157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 --2- 172.21.15.100:0/3784062627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c88c0 0x7f8258157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 -- 172.21.15.100:0/3784062627 >> v1:172.21.15.169:6789/0 conn(0x7f82580c8ca0 legacy=0x7f82580c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 -- 172.21.15.100:0/3784062627 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580bfcc0 con 0x7f8258153e90 2024-01-22T05:38:06.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.419+0000 7f8255e00700 1 --2- 172.21.15.100:0/3784062627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 0x7f8258154270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8248009810 tx=0x7f8248009060).ready entity=mon.1 client_cookie=b5783849f990eab9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f8254a00700 1 -- 172.21.15.100:0/3784062627 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248005880 con 0x7f8258153e90 2024-01-22T05:38:06.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f8254a00700 1 -- 172.21.15.100:0/3784062627 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82480059e0 con 0x7f8258153e90 2024-01-22T05:38:06.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f8254a00700 1 -- 172.21.15.100:0/3784062627 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248005d60 con 0x7f8258153e90 2024-01-22T05:38:06.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 -- 172.21.15.100:0/3784062627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 msgr2=0x7f8258154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 --2- 172.21.15.100:0/3784062627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 0x7f8258154270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8248009810 tx=0x7f8248009060).stop 2024-01-22T05:38:06.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 -- 172.21.15.100:0/3784062627 shutdown_connections 2024-01-22T05:38:06.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 --2- 172.21.15.100:0/3784062627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 0x7f8258154270 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 --2- 172.21.15.100:0/3784062627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c88c0 0x7f8258157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 -- 172.21.15.100:0/3784062627 >> 172.21.15.100:0/3784062627 conn(0x7f82580943b0 msgr2=0x7f825805e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:06.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 -- 172.21.15.100:0/3784062627 shutdown_connections 2024-01-22T05:38:06.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.420+0000 7f825ce00700 1 -- 172.21.15.100:0/3784062627 wait complete. 2024-01-22T05:38:06.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.422+0000 7f825ce00700 1 Processor -- start 2024-01-22T05:38:06.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.422+0000 7f825ce00700 1 -- start start 2024-01-22T05:38:06.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f825ce00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82580c88c0 0x7f82581519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f825ce00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c8ca0 0x7f825814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f825ce00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 0x7f8258164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f825ce00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825814ff20 con 0x7f82580c88c0 2024-01-22T05:38:06.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f825ce00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580c25e0 con 0x7f8258153e90 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f825ce00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580c4bb0 con 0x7f82580c8ca0 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82580c88c0 0x7f82581519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82580c88c0 0x7f82581519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55202/0 (socket says 172.21.15.100:55202) 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 -- 172.21.15.100:0/2606407079 learned_addr learned my addr 172.21.15.100:0/2606407079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8256800700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 0x7f8258164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255400700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c8ca0 0x7f825814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 -- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c8ca0 msgr2=0x7f825814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c8ca0 0x7f825814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 -- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 msgr2=0x7f8258164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 0x7f8258164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.423+0000 7f8255e00700 1 -- 172.21.15.100:0/2606407079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8248009300 con 0x7f82580c88c0 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f8256800700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8258153e90 0x7f8258164520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f8255400700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82580c8ca0 0x7f825814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:06.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f8255e00700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82580c88c0 0x7f82581519f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8248009eb0 tx=0x7f8248016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800b790 con 0x7f82580c88c0 2024-01-22T05:38:06.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824800b8f0 con 0x7f82580c88c0 2024-01-22T05:38:06.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82581650e0 con 0x7f82580c88c0 2024-01-22T05:38:06.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800bc90 con 0x7f82580c88c0 2024-01-22T05:38:06.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.424+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82580c1f90 con 0x7f82580c88c0 2024-01-22T05:38:06.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.425+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8258082f90 con 0x7f82580c88c0 2024-01-22T05:38:06.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.426+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8248018070 con 0x7f82580c88c0 2024-01-22T05:38:06.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.426+0000 7f824d600700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f823005f150 0x7f8230061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.427+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f824807be50 con 0x7f82580c88c0 2024-01-22T05:38:06.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.427+0000 7f8255400700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f823005f150 0x7f8230061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.427+0000 7f824d600700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f8230068470 0x7f823006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.427+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 --> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f823006af50 con 0x7f8230068470 2024-01-22T05:38:06.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.427+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f824807c140 con 0x7f82580c88c0 2024-01-22T05:38:06.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.427+0000 7f8255400700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f823005f150 0x7f8230061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f82581656a0 tx=0x7f8240008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.427+0000 7f8256800700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f8230068470 0x7f823006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.428+0000 7f8256800700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f8230068470 0x7f823006a8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.429+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== osd.7 v2:172.21.15.169:6816/71472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f823006af50 con 0x7f8230068470 2024-01-22T05:38:06.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.443+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 --> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f825806c680 con 0x7f8230068470 2024-01-22T05:38:06.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.444+0000 7f824d600700 1 -- 172.21.15.100:0/2606407079 <== osd.7 v2:172.21.15.169:6816/71472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f825806c680 con 0x7f8230068470 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.444+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f8230068470 msgr2=0x7f823006a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.444+0000 7f825ce00700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f8230068470 0x7f823006a8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.444+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f823005f150 msgr2=0x7f8230061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.444+0000 7f825ce00700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f823005f150 0x7f8230061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f82581656a0 tx=0x7f8240008040).stop 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.444+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82580c88c0 msgr2=0x7f82581519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.444+0000 7f825ce00700 1 --2- 172.21.15.100:0/2606407079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82580c88c0 0x7f82581519f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8248009eb0 tx=0x7f8248016000).stop 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.445+0000 7f8256800700 1 -- 172.21.15.100:0/2606407079 reap_dead start 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.445+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 shutdown_connections 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.445+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 >> 172.21.15.100:0/2606407079 conn(0x7f82580943b0 msgr2=0x7f8258064820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.445+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 shutdown_connections 2024-01-22T05:38:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.445+0000 7f825ce00700 1 -- 172.21.15.100:0/2606407079 wait complete. 2024-01-22T05:38:06.461 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-01-22T05:38:06.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-22T05:38:06.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.644+0000 7f43eba00700 1 Processor -- start 2024-01-22T05:38:06.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.644+0000 7f43eba00700 1 -- start start 2024-01-22T05:38:06.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.645+0000 7f43eba00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43e4154260 0x7f43e40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.645+0000 7f43eba00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 0x7f43e40c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.645+0000 7f43eba00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e40c1a40 con 0x7f43e40c65f0 2024-01-22T05:38:06.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.645+0000 7f43eba00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e40cbd30 con 0x7f43e4154260 2024-01-22T05:38:06.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.645+0000 7f43eba00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40c6a80 con 0x7f43e40c5c80 2024-01-22T05:38:06.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.645+0000 7f43e9a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f43e40c65f0 0x7f43e4157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41200/0 (socket says 172.21.15.100:41200) 2024-01-22T05:38:06.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.645+0000 7f43e9a00700 1 -- 172.21.15.100:0/1204608787 learned_addr learned my addr 172.21.15.100:0/1204608787 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:06.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e9000700 1 --2- 172.21.15.100:0/1204608787 >> v2:172.21.15.169:3300/0 conn(0x7f43e4154260 0x7f43e40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3e00700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 0x7f43e40c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308916080 0 0) 0x7f43e40c1a40 con 0x7f43e40c65f0 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c40033f0 con 0x7f43e40c65f0 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446375264 0 0) 0x7f43c40033f0 con 0x7f43e40c65f0 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 msgr2=0x7f43e40c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 0x7f43e40c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 >> v2:172.21.15.169:3300/0 conn(0x7f43e4154260 msgr2=0x7f43e40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 --2- 172.21.15.100:0/1204608787 >> v2:172.21.15.169:3300/0 conn(0x7f43e4154260 0x7f43e40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40c1110 con 0x7f43e40c65f0 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f43dc0017f0 con 0x7f43e40c65f0 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e9000700 1 --2- 172.21.15.100:0/1204608787 >> v2:172.21.15.169:3300/0 conn(0x7f43e4154260 0x7f43e40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 >> v1:172.21.15.100:6789/0 conn(0x7f43e40c65f0 legacy=0x7f43e4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43c4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 0x7f43c4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c4004b80 0x7f43c4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40cbd30 con 0x7f43c40038e0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40c6a80 con 0x7f43c4004b80 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.646+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c400b8e0 con 0x7f43e40c5c80 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9000700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43c4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9a00700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c4004b80 0x7f43c4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e3e00700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 0x7f43c4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9000700 1 -- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 msgr2=0x7f43c4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9000700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e40c5c80 0x7f43c4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9000700 1 -- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c4004b80 msgr2=0x7f43c4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9000700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c4004b80 0x7f43c4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9000700 1 -- 172.21.15.100:0/1204608787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40033f0 con 0x7f43c40038e0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e9000700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43c4003d00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f43d4009d00 tx=0x7f43d4006f40).ready entity=mon.0 client_cookie=c418baf6d6d58863 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4009e60 con 0x7f43c40038e0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4009670 con 0x7f43c40038e0 2024-01-22T05:38:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.647+0000 7f43e3400700 1 -- 172.21.15.100:0/1204608787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d400eb30 con 0x7f43c40038e0 2024-01-22T05:38:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.648+0000 7f43eba00700 1 -- 172.21.15.100:0/1204608787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 msgr2=0x7f43c4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.648+0000 7f43eba00700 1 --2- 172.21.15.100:0/1204608787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43c4003d00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f43d4009d00 tx=0x7f43d4006f40).stop 2024-01-22T05:38:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.648+0000 7f43e9a00700 1 -- 172.21.15.100:0/1204608787 reap_dead start 2024-01-22T05:38:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.648+0000 7f43eba00700 1 -- 172.21.15.100:0/1204608787 shutdown_connections 2024-01-22T05:38:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.648+0000 7f43eba00700 1 -- 172.21.15.100:0/1204608787 >> 172.21.15.100:0/1204608787 conn(0x7f43e405e9d0 msgr2=0x7f43e40cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.648+0000 7f43eba00700 1 -- 172.21.15.100:0/1204608787 shutdown_connections 2024-01-22T05:38:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.648+0000 7f43eba00700 1 -- 172.21.15.100:0/1204608787 wait complete. 2024-01-22T05:38:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.649+0000 7f43eba00700 1 Processor -- start 2024-01-22T05:38:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.650+0000 7f43eba00700 1 -- start start 2024-01-22T05:38:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43eba00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43e4149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43eba00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e4163c50 0x7f43e40c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43eba00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43e41640d0 0x7f43e40c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43eba00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40c43b0 con 0x7f43c40038e0 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43eba00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40c34a0 con 0x7f43e41640d0 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43eba00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41496f0 con 0x7f43e4163c50 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43e4149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43e4149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55222/0 (socket says 172.21.15.100:55222) 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 -- 172.21.15.100:0/137546181 learned_addr learned my addr 172.21.15.100:0/137546181 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e3e00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e4163c50 0x7f43e40c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9a00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43e41640d0 0x7f43e40c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 -- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e4163c50 msgr2=0x7f43e40c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e4163c50 0x7f43e40c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 -- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43e41640d0 msgr2=0x7f43e40c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43e41640d0 0x7f43e40c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 -- 172.21.15.100:0/137546181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40aa9c0 con 0x7f43c40038e0 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9a00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43e41640d0 0x7f43e40c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.651+0000 7f43e9000700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43e4149200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f43c4004490 tx=0x7f43d4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.652+0000 7f43dbe00700 1 -- 172.21.15.100:0/137546181 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4006030 con 0x7f43c40038e0 2024-01-22T05:38:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.652+0000 7f43dbe00700 1 -- 172.21.15.100:0/137546181 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4006190 con 0x7f43c40038e0 2024-01-22T05:38:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.652+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e40aaca0 con 0x7f43c40038e0 2024-01-22T05:38:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.652+0000 7f43dbe00700 1 -- 172.21.15.100:0/137546181 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4006550 con 0x7f43c40038e0 2024-01-22T05:38:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.652+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e40ab260 con 0x7f43c40038e0 2024-01-22T05:38:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.653+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e405fdb0 con 0x7f43c40038e0 2024-01-22T05:38:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.653+0000 7f43dbe00700 1 -- 172.21.15.100:0/137546181 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f43d401b460 con 0x7f43c40038e0 2024-01-22T05:38:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.655+0000 7f43dbe00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43bc05f150 0x7f43bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.655+0000 7f43dbe00700 1 -- 172.21.15.100:0/137546181 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f43d407b990 con 0x7f43c40038e0 2024-01-22T05:38:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.655+0000 7f43e3e00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43bc05f150 0x7f43bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.655+0000 7f43e3e00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43bc05f150 0x7f43bc061610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f43e4152b40 tx=0x7f43cc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:06.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.659+0000 7f43dbe00700 1 -- 172.21.15.100:0/137546181 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f43d404cc00 con 0x7f43c40038e0 2024-01-22T05:38:06.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.833+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43e40c13f0 con 0x7f43c40038e0 2024-01-22T05:38:06.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.834+0000 7f43dbe00700 1 -- 172.21.15.100:0/137546181 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43d4050220 con 0x7f43c40038e0 2024-01-22T05:38:06.834 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-01-22T05:38:06.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43bc05f150 msgr2=0x7f43bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43bc05f150 0x7f43bc061610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f43e4152b40 tx=0x7f43cc009060).stop 2024-01-22T05:38:06.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 msgr2=0x7f43e4149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:06.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43e4149200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f43c4004490 tx=0x7f43d4019000).stop 2024-01-22T05:38:06.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 shutdown_connections 2024-01-22T05:38:06.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43bc05f150 0x7f43bc061610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43e41640d0 0x7f43e40c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43c40038e0 0x7f43e4149200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 --2- 172.21.15.100:0/137546181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43e4163c50 0x7f43e40c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:06.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 >> 172.21.15.100:0/137546181 conn(0x7f43e405e9d0 msgr2=0x7f43e40c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:06.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 shutdown_connections 2024-01-22T05:38:06.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:06.836+0000 7f43eba00700 1 -- 172.21.15.100:0/137546181 wait complete. 2024-01-22T05:38:06.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2024-01-22T05:38:06.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-22T05:38:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.036+0000 7f3cf3000700 1 Processor -- start 2024-01-22T05:38:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.036+0000 7f3cf3000700 1 -- start start 2024-01-22T05:38:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.037+0000 7f3cf3000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3cec064e40 0x7f3cec065220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.037+0000 7f3cf3000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cf3000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec0c2480 con 0x7f3cec069690 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cf3000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec069b20 con 0x7f3cec064e40 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cf3000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0c1b50 con 0x7f3cec064370 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3cec064e40 0x7f3cec065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3cec064e40 0x7f3cec065220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55238/0 (socket says 172.21.15.100:55238) 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 -- 172.21.15.100:0/1544166769 learned_addr learned my addr 172.21.15.100:0/1544166769 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3ceb400700 1 --2- 172.21.15.100:0/1544166769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 -- 172.21.15.100:0/1544166769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 msgr2=0x7f3cec0691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 --2- 172.21.15.100:0/1544166769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec0691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 -- 172.21.15.100:0/1544166769 >> v1:172.21.15.169:6789/0 conn(0x7f3cec069690 legacy=0x7f3cec0c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 -- 172.21.15.100:0/1544166769 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0c1e30 con 0x7f3cec064e40 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.038+0000 7f3cebe00700 1 --2- 172.21.15.100:0/1544166769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec064e40 0x7f3cec065220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3cdc006fd0 tx=0x7f3cdc00b3b0).ready entity=mon.0 client_cookie=7aba809069b4e167 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3ceaa00700 1 -- 172.21.15.100:0/1544166769 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00db00 con 0x7f3cec064e40 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3ceaa00700 1 -- 172.21.15.100:0/1544166769 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00dc60 con 0x7f3cec064e40 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3ceaa00700 1 -- 172.21.15.100:0/1544166769 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc010470 con 0x7f3cec064e40 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 -- 172.21.15.100:0/1544166769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec064e40 msgr2=0x7f3cec065220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1544166769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec064e40 0x7f3cec065220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3cdc006fd0 tx=0x7f3cdc00b3b0).stop 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 -- 172.21.15.100:0/1544166769 shutdown_connections 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1544166769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec064e40 0x7f3cec065220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1544166769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec0691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 -- 172.21.15.100:0/1544166769 >> 172.21.15.100:0/1544166769 conn(0x7f3cec0630c0 msgr2=0x7f3cec0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 -- 172.21.15.100:0/1544166769 shutdown_connections 2024-01-22T05:38:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.039+0000 7f3cf3000700 1 -- 172.21.15.100:0/1544166769 wait complete. 2024-01-22T05:38:07.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.041+0000 7f3cf3000700 1 Processor -- start 2024-01-22T05:38:07.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.041+0000 7f3cf3000700 1 -- start start 2024-01-22T05:38:07.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf3000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf3000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cec064e40 0x7f3cec0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf3000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec0a9e00 0x7f3cec0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf3000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec14b1f0 con 0x7f3cec0a9e00 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf3000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0c0a40 con 0x7f3cec064e40 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf3000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec14eda0 con 0x7f3cec064370 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf1000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec0a9e00 0x7f3cec0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cebe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3ceb400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cec064e40 0x7f3cec0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf1000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec0a9e00 0x7f3cec0aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55246/0 (socket says 172.21.15.100:55246) 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.042+0000 7f3cf1000700 1 -- 172.21.15.100:0/1029667981 learned_addr learned my addr 172.21.15.100:0/1029667981 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf1000700 1 -- 172.21.15.100:0/1029667981 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 msgr2=0x7f3cec15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf1000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec15fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf1000700 1 -- 172.21.15.100:0/1029667981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cec064e40 msgr2=0x7f3cec0a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf1000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cec064e40 0x7f3cec0a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf1000700 1 -- 172.21.15.100:0/1029667981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc00b610 con 0x7f3cec0a9e00 2024-01-22T05:38:07.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf1000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec0a9e00 0x7f3cec0aa260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3ce400c840 tx=0x7f3ce4002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3ce3400700 1 -- 172.21.15.100:0/1029667981 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400e4a0 con 0x7f3cec0a9e00 2024-01-22T05:38:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3ce3400700 1 -- 172.21.15.100:0/1029667981 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400e620 con 0x7f3cec0a9e00 2024-01-22T05:38:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3ce3400700 1 -- 172.21.15.100:0/1029667981 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400e9e0 con 0x7f3cec0a9e00 2024-01-22T05:38:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec0bf870 con 0x7f3cec0a9e00 2024-01-22T05:38:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.043+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec14ea30 con 0x7f3cec0a9e00 2024-01-22T05:38:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.044+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec0bfd90 con 0x7f3cec0a9e00 2024-01-22T05:38:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.045+0000 7f3ce3400700 1 -- 172.21.15.100:0/1029667981 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3ce40123f0 con 0x7f3cec0a9e00 2024-01-22T05:38:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.046+0000 7f3ce3400700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3cc405f150 0x7f3cc4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.046+0000 7f3ce3400700 1 -- 172.21.15.100:0/1029667981 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3ce4079bd0 con 0x7f3cec0a9e00 2024-01-22T05:38:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.046+0000 7f3cebe00700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3cc405f150 0x7f3cc4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.047+0000 7f3cebe00700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3cc405f150 0x7f3cc4061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3cdc00bfd0 tx=0x7f3cdc00b3b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.050+0000 7f3ce3400700 1 -- 172.21.15.100:0/1029667981 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ce4047b00 con 0x7f3cec0a9e00 2024-01-22T05:38:07.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.221+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cec05fdb0 con 0x7f3cec0a9e00 2024-01-22T05:38:07.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.221+0000 7f3ce3400700 1 -- 172.21.15.100:0/1029667981 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cec0bfd90 con 0x7f3cec0a9e00 2024-01-22T05:38:07.222 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-01-22T05:38:07.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3cc405f150 msgr2=0x7f3cc4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3cc405f150 0x7f3cc4061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3cdc00bfd0 tx=0x7f3cdc00b3b0).stop 2024-01-22T05:38:07.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec0a9e00 msgr2=0x7f3cec0aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec0a9e00 0x7f3cec0aa260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3ce400c840 tx=0x7f3ce4002560).stop 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 shutdown_connections 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3cc405f150 0x7f3cc4061610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cec0a9e00 0x7f3cec0aa260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cec064370 0x7f3cec15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 --2- 172.21.15.100:0/1029667981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cec064e40 0x7f3cec0a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 >> 172.21.15.100:0/1029667981 conn(0x7f3cec0630c0 msgr2=0x7f3cec0c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 shutdown_connections 2024-01-22T05:38:07.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.224+0000 7f3cf3000700 1 -- 172.21.15.100:0/1029667981 wait complete. 2024-01-22T05:38:07.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-01-22T05:38:07.241 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-22T05:38:07.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.425+0000 7f6746600700 1 Processor -- start 2024-01-22T05:38:07.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.425+0000 7f6746600700 1 -- start start 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.426+0000 7f6746600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6740154040 0x7f67400c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.426+0000 7f6746600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 0x7f67400c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.426+0000 7f6746600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6740064830 con 0x7f6740154420 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.426+0000 7f6746600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400c1e00 con 0x7f6740154040 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.426+0000 7f6746600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740064b10 con 0x7f6740065fb0 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673ea00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6740154420 0x7f6740157d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41212/0 (socket says 172.21.15.100:41212) 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673ea00700 1 -- 172.21.15.100:0/675467686 learned_addr learned my addr 172.21.15.100:0/675467686 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673fe00700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 0x7f67400c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127010300 0 0) 0x7f6740064830 con 0x7f6740154420 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673f400700 1 --2- 172.21.15.100:0/675467686 >> v2:172.21.15.169:3300/0 conn(0x7f6740154040 0x7f67400c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67200033f0 con 0x7f6740154420 2024-01-22T05:38:07.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152741925 0 0) 0x7f67200033f0 con 0x7f6740154420 2024-01-22T05:38:07.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 msgr2=0x7f67400c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:07.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 0x7f67400c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 >> v2:172.21.15.169:3300/0 conn(0x7f6740154040 msgr2=0x7f67400c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 --2- 172.21.15.100:0/675467686 >> v2:172.21.15.169:3300/0 conn(0x7f6740154040 0x7f67400c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400bd010 con 0x7f6740154420 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f6728001470 con 0x7f6740154420 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.427+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 >> v1:172.21.15.100:6789/0 conn(0x7f6740154420 legacy=0x7f6740157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673e000700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67200038e0 0x7f6720003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673e000700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 0x7f6720004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673e000700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6720004b80 0x7f6720005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c1e00 con 0x7f67200038e0 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740064b10 con 0x7f6720004b80 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672000b8e0 con 0x7f6740065fb0 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673f400700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67200038e0 0x7f6720003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673ea00700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 0x7f6720004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673fe00700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6720004b80 0x7f6720005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673f400700 1 -- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 msgr2=0x7f6720004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673f400700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6740065fb0 0x7f6720004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673f400700 1 -- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6720004b80 msgr2=0x7f6720005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673f400700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6720004b80 0x7f6720005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673f400700 1 -- 172.21.15.100:0/675467686 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200033f0 con 0x7f67200038e0 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.428+0000 7f673f400700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67200038e0 0x7f6720003d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6730009a80 tx=0x7f6730009060).ready entity=mon.0 client_cookie=65b671a1c2e42dc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730009430 con 0x7f67200038e0 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673000e640 con 0x7f67200038e0 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f673e000700 1 -- 172.21.15.100:0/675467686 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000e9c0 con 0x7f67200038e0 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f6746600700 1 -- 172.21.15.100:0/675467686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67200038e0 msgr2=0x7f6720003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f6746600700 1 --2- 172.21.15.100:0/675467686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67200038e0 0x7f6720003d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6730009a80 tx=0x7f6730009060).stop 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f673fe00700 1 -- 172.21.15.100:0/675467686 reap_dead start 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f6746600700 1 -- 172.21.15.100:0/675467686 shutdown_connections 2024-01-22T05:38:07.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f6746600700 1 -- 172.21.15.100:0/675467686 >> 172.21.15.100:0/675467686 conn(0x7f67400c6e20 msgr2=0x7f67400c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:07.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f6746600700 1 -- 172.21.15.100:0/675467686 shutdown_connections 2024-01-22T05:38:07.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.429+0000 7f6746600700 1 -- 172.21.15.100:0/675467686 wait complete. 2024-01-22T05:38:07.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.431+0000 7f6746600700 1 Processor -- start 2024-01-22T05:38:07.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.431+0000 7f6746600700 1 -- start start 2024-01-22T05:38:07.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f6746600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67200038e0 0x7f67400ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f6746600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67401532a0 0x7f6740149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f6746600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67400a5f80 0x7f6740068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f6746600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740149500 con 0x7f67401532a0 2024-01-22T05:38:07.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f6746600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400ac510 con 0x7f67200038e0 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f6746600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67400ab900 con 0x7f67400a5f80 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67401532a0 0x7f6740149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67401532a0 0x7f6740149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55250/0 (socket says 172.21.15.100:55250) 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 -- 172.21.15.100:0/4249293767 learned_addr learned my addr 172.21.15.100:0/4249293767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673f400700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67200038e0 0x7f67400ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673fe00700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67400a5f80 0x7f6740068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 -- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67400a5f80 msgr2=0x7f6740068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67400a5f80 0x7f6740068fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 -- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67200038e0 msgr2=0x7f67400ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67200038e0 0x7f67400ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 -- 172.21.15.100:0/4249293767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400abbe0 con 0x7f67401532a0 2024-01-22T05:38:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673fe00700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67400a5f80 0x7f6740068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.432+0000 7f673ea00700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67401532a0 0x7f6740149010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6728004960 tx=0x7f6728001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.433+0000 7f6736a00700 1 -- 172.21.15.100:0/4249293767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728011590 con 0x7f67401532a0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.433+0000 7f6736a00700 1 -- 172.21.15.100:0/4249293767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280116f0 con 0x7f67401532a0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.433+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67400abec0 con 0x7f67401532a0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.433+0000 7f6736a00700 1 -- 172.21.15.100:0/4249293767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728011a70 con 0x7f67401532a0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.433+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67400ab560 con 0x7f67401532a0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.434+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67400ac360 con 0x7f67401532a0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.434+0000 7f6736a00700 1 -- 172.21.15.100:0/4249293767 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f672801d3b0 con 0x7f67401532a0 2024-01-22T05:38:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.436+0000 7f6736a00700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f671805f150 0x7f6718061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.436+0000 7f6736a00700 1 -- 172.21.15.100:0/4249293767 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6728079b20 con 0x7f67401532a0 2024-01-22T05:38:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.436+0000 7f673f400700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f671805f150 0x7f6718061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.436+0000 7f673f400700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f671805f150 0x7f6718061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6730006c40 tx=0x7f673001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:07.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.440+0000 7f6736a00700 1 -- 172.21.15.100:0/4249293767 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f672804ad80 con 0x7f67401532a0 2024-01-22T05:38:07.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.612+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f67400ac680 con 0x7f67401532a0 2024-01-22T05:38:07.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.612+0000 7f6736a00700 1 -- 172.21.15.100:0/4249293767 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6728019020 con 0x7f67401532a0 2024-01-22T05:38:07.612 INFO:teuthology.orchestra.run.smithi100.stdout:60129542147 2024-01-22T05:38:07.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f671805f150 msgr2=0x7f6718061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f671805f150 0x7f6718061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6730006c40 tx=0x7f673001a000).stop 2024-01-22T05:38:07.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67401532a0 msgr2=0x7f6740149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:07.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67401532a0 0x7f6740149010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6728004960 tx=0x7f6728001e90).stop 2024-01-22T05:38:07.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 shutdown_connections 2024-01-22T05:38:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f671805f150 0x7f6718061610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67200038e0 0x7f67400ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67400a5f80 0x7f6740068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 --2- 172.21.15.100:0/4249293767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67401532a0 0x7f6740149010 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 >> 172.21.15.100:0/4249293767 conn(0x7f67400c6e20 msgr2=0x7f67400a93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 shutdown_connections 2024-01-22T05:38:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:07.614+0000 7f6746600700 1 -- 172.21.15.100:0/4249293767 wait complete. 2024-01-22T05:38:07.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.2 2024-01-22T05:38:08.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-22T05:38:08.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.825+0000 7efc1ba00700 1 Processor -- start 2024-01-22T05:38:08.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.826+0000 7efc1ba00700 1 -- start start 2024-01-22T05:38:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.827+0000 7efc1ba00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc140a9f60 0x7efc140aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.827+0000 7efc1ba00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc140c74b0 con 0x7efc140c1940 2024-01-22T05:38:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.827+0000 7efc1ba00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc14158660 con 0x7efc1405e900 2024-01-22T05:38:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.827+0000 7efc1ba00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc14158940 con 0x7efc140a9f60 2024-01-22T05:38:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.827+0000 7efc13e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efc140c1940 0x7efc1405e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41228/0 (socket says 172.21.15.100:41228) 2024-01-22T05:38:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.827+0000 7efc13e00700 1 -- 172.21.15.100:0/3375670923 learned_addr learned my addr 172.21.15.100:0/3375670923 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.827+0000 7efc19000700 1 --2- 172.21.15.100:0/3375670923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc140a9f60 0x7efc140aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:08.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572908883 0 0) 0x7efc140c74b0 con 0x7efc140c1940 2024-01-22T05:38:08.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf40033f0 con 0x7efc140c1940 2024-01-22T05:38:08.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63385767 0 0) 0x7efc14158660 con 0x7efc1405e900 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc140c74b0 con 0x7efc1405e900 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc19000700 1 -- 172.21.15.100:0/3375670923 >> v1:172.21.15.169:6789/0 conn(0x7efc1405e900 legacy=0x7efc14098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc19000700 1 -- 172.21.15.100:0/3375670923 >> v1:172.21.15.100:6789/0 conn(0x7efc140c1940 legacy=0x7efc1405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292684003 0 0) 0x7efbf40033f0 con 0x7efc140c1940 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc19000700 1 -- 172.21.15.100:0/3375670923 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140c7140 con 0x7efc140a9f60 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc19000700 1 --2- 172.21.15.100:0/3375670923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc140a9f60 0x7efc140aa340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efc04009790 tx=0x7efc04009060).ready entity=mon.2 client_cookie=39676fd0061e804e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc001470 con 0x7efc140a9f60 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04011400 con 0x7efc140a9f60 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.828+0000 7efc13400700 1 -- 172.21.15.100:0/3375670923 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04011780 con 0x7efc140a9f60 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.829+0000 7efc1ba00700 1 -- 172.21.15.100:0/3375670923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc140a9f60 msgr2=0x7efc140aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.829+0000 7efc1ba00700 1 --2- 172.21.15.100:0/3375670923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc140a9f60 0x7efc140aa340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efc04009790 tx=0x7efc04009060).stop 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.829+0000 7efc1ba00700 1 -- 172.21.15.100:0/3375670923 shutdown_connections 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.829+0000 7efc1ba00700 1 --2- 172.21.15.100:0/3375670923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc140a9f60 0x7efc140aa340 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.829+0000 7efc1ba00700 1 -- 172.21.15.100:0/3375670923 >> 172.21.15.100:0/3375670923 conn(0x7efc140cada0 msgr2=0x7efc140cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.829+0000 7efc1ba00700 1 -- 172.21.15.100:0/3375670923 shutdown_connections 2024-01-22T05:38:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.829+0000 7efc1ba00700 1 -- 172.21.15.100:0/3375670923 wait complete. 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.830+0000 7efc1ba00700 1 Processor -- start 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.831+0000 7efc1ba00700 1 -- start start 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.831+0000 7efc1ba00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc1405e900 0x7efc140985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.831+0000 7efc1ba00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc140a9f60 0x7efc14064590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.831+0000 7efc1ba00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc140c1940 0x7efc14064a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.831+0000 7efc1ba00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14064f70 con 0x7efc140a9f60 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.831+0000 7efc1ba00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14098ad0 con 0x7efc140c1940 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.831+0000 7efc1ba00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc140c2890 con 0x7efc1405e900 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc140a9f60 0x7efc14064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc140a9f60 0x7efc14064590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55256/0 (socket says 172.21.15.100:55256) 2024-01-22T05:38:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 -- 172.21.15.100:0/1430418586 learned_addr learned my addr 172.21.15.100:0/1430418586 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc19000700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc1405e900 0x7efc140985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc19a00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc140c1940 0x7efc14064a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 -- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc1405e900 msgr2=0x7efc140985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc1405e900 0x7efc140985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 -- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc140c1940 msgr2=0x7efc14064a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc140c1940 0x7efc14064a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 -- 172.21.15.100:0/1430418586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040092a0 con 0x7efc140a9f60 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc13e00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc140a9f60 0x7efc14064590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7efbfc00c840 tx=0x7efbfc001960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc0be00700 1 -- 172.21.15.100:0/1430418586 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0072e0 con 0x7efc140a9f60 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc0be00700 1 -- 172.21.15.100:0/1430418586 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc007440 con 0x7efc140a9f60 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc140c1f60 con 0x7efc140a9f60 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.832+0000 7efc0be00700 1 -- 172.21.15.100:0/1430418586 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0057a0 con 0x7efc140a9f60 2024-01-22T05:38:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.833+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc140c2520 con 0x7efc140a9f60 2024-01-22T05:38:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.834+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1405fdb0 con 0x7efc140a9f60 2024-01-22T05:38:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.834+0000 7efc0be00700 1 -- 172.21.15.100:0/1430418586 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efbfc005bd0 con 0x7efc140a9f60 2024-01-22T05:38:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.835+0000 7efc0be00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efbec05f120 0x7efbec0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:08.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.835+0000 7efc0be00700 1 -- 172.21.15.100:0/1430418586 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efbfc079aa0 con 0x7efc140a9f60 2024-01-22T05:38:08.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.835+0000 7efc19000700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efbec05f120 0x7efbec0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:08.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.836+0000 7efc19000700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efbec05f120 0x7efbec0615e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efc040096e0 tx=0x7efc04016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:08.839+0000 7efc0be00700 1 -- 172.21.15.100:0/1430418586 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efbfc04ad70 con 0x7efc140a9f60 2024-01-22T05:38:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.008+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc140ca030 con 0x7efc140a9f60 2024-01-22T05:38:09.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.009+0000 7efc0be00700 1 -- 172.21.15.100:0/1430418586 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efbfc001aa0 con 0x7efc140a9f60 2024-01-22T05:38:09.009 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-01-22T05:38:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efbec05f120 msgr2=0x7efbec0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efbec05f120 0x7efbec0615e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efc040096e0 tx=0x7efc04016000).stop 2024-01-22T05:38:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc140a9f60 msgr2=0x7efc14064590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc140a9f60 0x7efc14064590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7efbfc00c840 tx=0x7efbfc001960).stop 2024-01-22T05:38:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 shutdown_connections 2024-01-22T05:38:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efbec05f120 0x7efbec0615e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc140c1940 0x7efc14064a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc1405e900 0x7efc140985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 --2- 172.21.15.100:0/1430418586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc140a9f60 0x7efc14064590 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 >> 172.21.15.100:0/1430418586 conn(0x7efc140cada0 msgr2=0x7efc14153890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 shutdown_connections 2024-01-22T05:38:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.011+0000 7efc1ba00700 1 -- 172.21.15.100:0/1430418586 wait complete. 2024-01-22T05:38:09.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.2 2024-01-22T05:38:09.028 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-22T05:38:09.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.214+0000 7f9748600700 1 Processor -- start 2024-01-22T05:38:09.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.214+0000 7f9748600700 1 -- start start 2024-01-22T05:38:09.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9748600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f97400a9f60 0x7f97400aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9748600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400c1940 0x7f97400ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9748600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f974005e1f0 0x7f974005e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9748600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97400c74b0 con 0x7f974005e1f0 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9748600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97400cab90 con 0x7f97400a9f60 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9748600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974005eb70 con 0x7f97400c1940 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9746600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f974005e1f0 0x7f974005e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9746600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f974005e1f0 0x7f974005e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55268/0 (socket says 172.21.15.100:55268) 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.215+0000 7f9746600700 1 -- 172.21.15.100:0/2953846509 learned_addr learned my addr 172.21.15.100:0/2953846509 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9745200700 1 --2- 172.21.15.100:0/2953846509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400c1940 0x7f97400ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9745c00700 1 --2- 172.21.15.100:0/2953846509 >> v2:172.21.15.169:3300/0 conn(0x7f97400a9f60 0x7f97400aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9746600700 1 -- 172.21.15.100:0/2953846509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400c1940 msgr2=0x7f97400ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9746600700 1 --2- 172.21.15.100:0/2953846509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400c1940 0x7f97400ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9746600700 1 -- 172.21.15.100:0/2953846509 >> v2:172.21.15.169:3300/0 conn(0x7f97400a9f60 msgr2=0x7f97400aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9746600700 1 --2- 172.21.15.100:0/2953846509 >> v2:172.21.15.169:3300/0 conn(0x7f97400a9f60 0x7f97400aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9746600700 1 -- 172.21.15.100:0/2953846509 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740158660 con 0x7f974005e1f0 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f9746600700 1 --2- 172.21.15.100:0/2953846509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974005e1f0 0x7f974005e680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f97400c8850 tx=0x7f9738009840).ready entity=mon.0 client_cookie=f5889bd2613d9057 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f973fe00700 1 -- 172.21.15.100:0/2953846509 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800e070 con 0x7f974005e1f0 2024-01-22T05:38:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f973fe00700 1 -- 172.21.15.100:0/2953846509 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800ba50 con 0x7f974005e1f0 2024-01-22T05:38:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.216+0000 7f973fe00700 1 -- 172.21.15.100:0/2953846509 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800bdd0 con 0x7f974005e1f0 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 -- 172.21.15.100:0/2953846509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974005e1f0 msgr2=0x7f974005e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 --2- 172.21.15.100:0/2953846509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974005e1f0 0x7f974005e680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f97400c8850 tx=0x7f9738009840).stop 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 -- 172.21.15.100:0/2953846509 shutdown_connections 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 --2- 172.21.15.100:0/2953846509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974005e1f0 0x7f974005e680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 --2- 172.21.15.100:0/2953846509 >> v2:172.21.15.169:3300/0 conn(0x7f97400a9f60 0x7f97400aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 --2- 172.21.15.100:0/2953846509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400c1940 0x7f97400ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 -- 172.21.15.100:0/2953846509 >> 172.21.15.100:0/2953846509 conn(0x7f97400cada0 msgr2=0x7f97400cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 -- 172.21.15.100:0/2953846509 shutdown_connections 2024-01-22T05:38:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.217+0000 7f9748600700 1 -- 172.21.15.100:0/2953846509 wait complete. 2024-01-22T05:38:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.218+0000 7f9748600700 1 Processor -- start 2024-01-22T05:38:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.219+0000 7f9748600700 1 -- start start 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.219+0000 7f9748600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f974005e1f0 0x7f974013db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.219+0000 7f9748600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400a9f60 0x7f9740154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9748600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97400c1940 0x7f97401528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9748600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9740152440 con 0x7f97400c1940 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9748600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974013e070 con 0x7f974005e1f0 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9748600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9740151830 con 0x7f97400a9f60 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97400c1940 0x7f97401528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97400c1940 0x7f97401528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55280/0 (socket says 172.21.15.100:55280) 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 -- 172.21.15.100:0/2032171077 learned_addr learned my addr 172.21.15.100:0/2032171077 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9745c00700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f974005e1f0 0x7f974013db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9745200700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400a9f60 0x7f9740154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 -- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400a9f60 msgr2=0x7f9740154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400a9f60 0x7f9740154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 -- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f974005e1f0 msgr2=0x7f974013db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f974005e1f0 0x7f974013db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 -- 172.21.15.100:0/2032171077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9738009ae0 con 0x7f97400c1940 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.220+0000 7f9746600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97400c1940 0x7f97401528d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f9738009fd0 tx=0x7f9738009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.221+0000 7f973cc00700 1 -- 172.21.15.100:0/2032171077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800bdd0 con 0x7f97400c1940 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.221+0000 7f973cc00700 1 -- 172.21.15.100:0/2032171077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9738009500 con 0x7f97400c1940 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.221+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9740151b10 con 0x7f97400c1940 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.221+0000 7f973cc00700 1 -- 172.21.15.100:0/2032171077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973801d6b0 con 0x7f97400c1940 2024-01-22T05:38:09.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.221+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97401520d0 con 0x7f97400c1940 2024-01-22T05:38:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.222+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974005fdb0 con 0x7f97400c1940 2024-01-22T05:38:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.223+0000 7f973cc00700 1 -- 172.21.15.100:0/2032171077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9738003040 con 0x7f97400c1940 2024-01-22T05:38:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.223+0000 7f973cc00700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f971805f180 0x7f9718061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.223+0000 7f973cc00700 1 -- 172.21.15.100:0/2032171077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f973807b510 con 0x7f97400c1940 2024-01-22T05:38:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.223+0000 7f9745c00700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f971805f180 0x7f9718061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.224+0000 7f9745c00700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f971805f180 0x7f9718061640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f973000bbc0 tx=0x7f9730008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:09.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.228+0000 7f973cc00700 1 -- 172.21.15.100:0/2032171077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f973804c720 con 0x7f97400c1940 2024-01-22T05:38:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.399+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f97400ca030 con 0x7f97400c1940 2024-01-22T05:38:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.400+0000 7f973cc00700 1 -- 172.21.15.100:0/2032171077 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9738022020 con 0x7f97400c1940 2024-01-22T05:38:09.400 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-01-22T05:38:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f971805f180 msgr2=0x7f9718061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f971805f180 0x7f9718061640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f973000bbc0 tx=0x7f9730008040).stop 2024-01-22T05:38:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97400c1940 msgr2=0x7f97401528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97400c1940 0x7f97401528d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f9738009fd0 tx=0x7f9738009840).stop 2024-01-22T05:38:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 shutdown_connections 2024-01-22T05:38:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f971805f180 0x7f9718061640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f974005e1f0 0x7f974013db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97400c1940 0x7f97401528d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 --2- 172.21.15.100:0/2032171077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97400a9f60 0x7f9740154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 >> 172.21.15.100:0/2032171077 conn(0x7f97400cada0 msgr2=0x7f9740153520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 shutdown_connections 2024-01-22T05:38:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.402+0000 7f9748600700 1 -- 172.21.15.100:0/2032171077 wait complete. 2024-01-22T05:38:09.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.3 2024-01-22T05:38:09.419 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-22T05:38:09.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.603+0000 7f7af0000700 1 Processor -- start 2024-01-22T05:38:09.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.603+0000 7f7af0000700 1 -- start start 2024-01-22T05:38:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.604+0000 7f7af0000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ae8154260 0x7f7ae80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.604+0000 7f7af0000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.604+0000 7f7af0000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae80c1a40 con 0x7f7ae80c65f0 2024-01-22T05:38:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.604+0000 7f7af0000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae80cbd30 con 0x7f7ae8154260 2024-01-22T05:38:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.604+0000 7f7af0000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80c6a80 con 0x7f7ae80c5c80 2024-01-22T05:38:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.604+0000 7f7aed600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ae8154260 0x7f7ae80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.604+0000 7f7aee000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7ae80c65f0 0x7f7ae8157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41238/0 (socket says 172.21.15.100:41238) 2024-01-22T05:38:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7aee000700 1 -- 172.21.15.100:0/1164814943 learned_addr learned my addr 172.21.15.100:0/1164814943 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7aed600700 1 -- 172.21.15.100:0/1164814943 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 msgr2=0x7f7ae80c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7aed600700 1 --2- 172.21.15.100:0/1164814943 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7aed600700 1 -- 172.21.15.100:0/1164814943 >> v1:172.21.15.100:6789/0 conn(0x7f7ae80c65f0 legacy=0x7f7ae8157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7aed600700 1 -- 172.21.15.100:0/1164814943 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae80c1110 con 0x7f7ae8154260 2024-01-22T05:38:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7ae7e00700 1 -- 172.21.15.100:0/1164814943 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624579982 0 0) 0x7f7ae80c1a40 con 0x7f7ae80c65f0 2024-01-22T05:38:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7aed600700 1 --2- 172.21.15.100:0/1164814943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae80cb4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7ad8009760 tx=0x7f7ad8006f40).ready entity=mon.0 client_cookie=56862a512a714f69 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7ae7e00700 1 -- 172.21.15.100:0/1164814943 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8005880 con 0x7f7ae8154260 2024-01-22T05:38:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7ae7e00700 1 -- 172.21.15.100:0/1164814943 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad80059e0 con 0x7f7ae8154260 2024-01-22T05:38:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.605+0000 7f7ae7e00700 1 -- 172.21.15.100:0/1164814943 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8005d60 con 0x7f7ae8154260 2024-01-22T05:38:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 -- 172.21.15.100:0/1164814943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 msgr2=0x7f7ae80cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 --2- 172.21.15.100:0/1164814943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae80cb4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7ad8009760 tx=0x7f7ad8006f40).stop 2024-01-22T05:38:09.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 -- 172.21.15.100:0/1164814943 shutdown_connections 2024-01-22T05:38:09.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 --2- 172.21.15.100:0/1164814943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae80cb4e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 --2- 172.21.15.100:0/1164814943 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:09.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 -- 172.21.15.100:0/1164814943 >> 172.21.15.100:0/1164814943 conn(0x7f7ae805e9d0 msgr2=0x7f7ae80cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:09.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 -- 172.21.15.100:0/1164814943 shutdown_connections 2024-01-22T05:38:09.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.606+0000 7f7af0000700 1 -- 172.21.15.100:0/1164814943 wait complete. 2024-01-22T05:38:09.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.607+0000 7f7af0000700 1 Processor -- start 2024-01-22T05:38:09.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.608+0000 7f7af0000700 1 -- start start 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.608+0000 7f7af0000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.608+0000 7f7af0000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae80c65f0 0x7f7ae81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7af0000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7af0000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81527a0 con 0x7f7ae8154260 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7af0000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80abcf0 con 0x7f7ae80c65f0 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7af0000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80abfd0 con 0x7f7ae80c5c80 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae8152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55302/0 (socket says 172.21.15.100:55302) 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 -- 172.21.15.100:0/1556130546 learned_addr learned my addr 172.21.15.100:0/1556130546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aed600700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aecc00700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae80c65f0 0x7f7ae81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 -- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 msgr2=0x7f7ae80ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 -- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae80c65f0 msgr2=0x7f7ae81522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae80c65f0 0x7f7ae81522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 -- 172.21.15.100:0/1556130546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad8009250 con 0x7f7ae8154260 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aed600700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.609+0000 7f7aee000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae8152cf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7ae000c7e0 tx=0x7f7ae0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.610+0000 7f7ae4c00700 1 -- 172.21.15.100:0/1556130546 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0005d30 con 0x7f7ae8154260 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.610+0000 7f7ae4c00700 1 -- 172.21.15.100:0/1556130546 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0005e90 con 0x7f7ae8154260 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.610+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae80ac2b0 con 0x7f7ae8154260 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.610+0000 7f7ae4c00700 1 -- 172.21.15.100:0/1556130546 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0007320 con 0x7f7ae8154260 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.610+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae80c20a0 con 0x7f7ae8154260 2024-01-22T05:38:09.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.611+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae80c22c0 con 0x7f7ae8154260 2024-01-22T05:38:09.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.611+0000 7f7ae4c00700 1 -- 172.21.15.100:0/1556130546 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7ae0007710 con 0x7f7ae8154260 2024-01-22T05:38:09.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.612+0000 7f7ae4c00700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7ac005f150 0x7f7ac0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.612+0000 7f7ae4c00700 1 -- 172.21.15.100:0/1556130546 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ae007a2b0 con 0x7f7ae8154260 2024-01-22T05:38:09.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.612+0000 7f7aed600700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7ac005f150 0x7f7ac0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.613+0000 7f7aed600700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7ac005f150 0x7f7ac0061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7ad8006f80 tx=0x7f7ad8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:09.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.616+0000 7f7ae4c00700 1 -- 172.21.15.100:0/1556130546 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ae004b460 con 0x7f7ae8154260 2024-01-22T05:38:09.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.789+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7ae80c13f0 con 0x7f7ae8154260 2024-01-22T05:38:09.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.790+0000 7f7ae4c00700 1 -- 172.21.15.100:0/1556130546 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ae004ea80 con 0x7f7ae8154260 2024-01-22T05:38:09.790 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-01-22T05:38:09.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7ac005f150 msgr2=0x7f7ac0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7ac005f150 0x7f7ac0061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7ad8006f80 tx=0x7f7ad8016000).stop 2024-01-22T05:38:09.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 msgr2=0x7f7ae8152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae8152cf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7ae000c7e0 tx=0x7f7ae0007f90).stop 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 shutdown_connections 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7ac005f150 0x7f7ac0061610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae8154260 0x7f7ae8152cf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ae80c5c80 0x7f7ae80ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 --2- 172.21.15.100:0/1556130546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ae80c65f0 0x7f7ae81522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 >> 172.21.15.100:0/1556130546 conn(0x7f7ae805e9d0 msgr2=0x7f7ae80c8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 shutdown_connections 2024-01-22T05:38:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.792+0000 7f7af0000700 1 -- 172.21.15.100:0/1556130546 wait complete. 2024-01-22T05:38:09.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-01-22T05:38:09.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-22T05:38:09.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.992+0000 7f9b15600700 1 Processor -- start 2024-01-22T05:38:09.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.992+0000 7f9b15600700 1 -- start start 2024-01-22T05:38:09.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.993+0000 7f9b15600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9b10154260 0x7f9b100cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.993+0000 7f9b15600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b100c5c80 0x7f9b100c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b15600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c65f0 0x7f9b10157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b15600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b100c1a40 con 0x7f9b100c5c80 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b15600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b100cbd30 con 0x7f9b10154260 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b15600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100c6a80 con 0x7f9b100c65f0 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b100c5c80 0x7f9b100c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0ea00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9b10154260 0x7f9b100cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0f400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c65f0 0x7f9b10157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b100c5c80 0x7f9b100c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55310/0 (socket says 172.21.15.100:55310) 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 -- 172.21.15.100:0/3473804211 learned_addr learned my addr 172.21.15.100:0/3473804211 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 -- 172.21.15.100:0/3473804211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c65f0 msgr2=0x7f9b10157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 --2- 172.21.15.100:0/3473804211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c65f0 0x7f9b10157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 -- 172.21.15.100:0/3473804211 >> v2:172.21.15.169:3300/0 conn(0x7f9b10154260 msgr2=0x7f9b100cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 --2- 172.21.15.100:0/3473804211 >> v2:172.21.15.169:3300/0 conn(0x7f9b10154260 0x7f9b100cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 -- 172.21.15.100:0/3473804211 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100c1110 con 0x7f9b100c5c80 2024-01-22T05:38:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.994+0000 7f9b0e000700 1 --2- 172.21.15.100:0/3473804211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100c5c80 0x7f9b100c6100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9b10083650 tx=0x7f9af80090f0).ready entity=mon.0 client_cookie=3eba85d3946878e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b0d600700 1 -- 172.21.15.100:0/3473804211 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800f510 con 0x7f9b100c5c80 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b0d600700 1 -- 172.21.15.100:0/3473804211 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af800f670 con 0x7f9b100c5c80 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b0d600700 1 -- 172.21.15.100:0/3473804211 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800fa10 con 0x7f9b100c5c80 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 -- 172.21.15.100:0/3473804211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100c5c80 msgr2=0x7f9b100c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 --2- 172.21.15.100:0/3473804211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100c5c80 0x7f9b100c6100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9b10083650 tx=0x7f9af80090f0).stop 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 -- 172.21.15.100:0/3473804211 shutdown_connections 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 --2- 172.21.15.100:0/3473804211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c65f0 0x7f9b10157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 --2- 172.21.15.100:0/3473804211 >> v2:172.21.15.169:3300/0 conn(0x7f9b10154260 0x7f9b100cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 --2- 172.21.15.100:0/3473804211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100c5c80 0x7f9b100c6100 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 -- 172.21.15.100:0/3473804211 >> 172.21.15.100:0/3473804211 conn(0x7f9b1005e9d0 msgr2=0x7f9b100cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 -- 172.21.15.100:0/3473804211 shutdown_connections 2024-01-22T05:38:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.995+0000 7f9b15600700 1 -- 172.21.15.100:0/3473804211 wait complete. 2024-01-22T05:38:10.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.997+0000 7f9b15600700 1 Processor -- start 2024-01-22T05:38:10.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.998+0000 7f9b15600700 1 -- start start 2024-01-22T05:38:10.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b15600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c5c80 0x7f9b10152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b15600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b100c65f0 0x7f9b100aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b15600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b10154260 0x7f9b100c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b15600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100aa9e0 con 0x7f9b10154260 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b15600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100aacc0 con 0x7f9b100c65f0 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b15600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100aafa0 con 0x7f9b100c5c80 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b0f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b10154260 0x7f9b100c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b0f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b10154260 0x7f9b100c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55318/0 (socket says 172.21.15.100:55318) 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b0f400700 1 -- 172.21.15.100:0/444375512 learned_addr learned my addr 172.21.15.100:0/444375512 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b0ea00700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c5c80 0x7f9b10152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b0e000700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b100c65f0 0x7f9b100aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b0f400700 1 -- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c5c80 msgr2=0x7f9b10152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:09.999+0000 7f9b0f400700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c5c80 0x7f9b10152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b0f400700 1 -- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b100c65f0 msgr2=0x7f9b100aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b0f400700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b100c65f0 0x7f9b100aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b0f400700 1 -- 172.21.15.100:0/444375512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009370 con 0x7f9b10154260 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b0ea00700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c5c80 0x7f9b10152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b0e000700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b100c65f0 0x7f9b100aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b0f400700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b10154260 0x7f9b100c2c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9b08009e90 tx=0x7f9b0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b06000700 1 -- 172.21.15.100:0/444375512 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800cc20 con 0x7f9b10154260 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b06000700 1 -- 172.21.15.100:0/444375512 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800f040 con 0x7f9b10154260 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b100ab280 con 0x7f9b10154260 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b06000700 1 -- 172.21.15.100:0/444375512 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08013400 con 0x7f9b10154260 2024-01-22T05:38:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.000+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b100c1f70 con 0x7f9b10154260 2024-01-22T05:38:10.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.001+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b100ab7a0 con 0x7f9b10154260 2024-01-22T05:38:10.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.002+0000 7f9b06000700 1 -- 172.21.15.100:0/444375512 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9b080137b0 con 0x7f9b10154260 2024-01-22T05:38:10.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.002+0000 7f9b06000700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9ae805f150 0x7f9ae8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.003+0000 7f9b06000700 1 -- 172.21.15.100:0/444375512 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9b0807aba0 con 0x7f9b10154260 2024-01-22T05:38:10.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.003+0000 7f9b0ea00700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9ae805f150 0x7f9ae8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.003+0000 7f9b0ea00700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9ae805f150 0x7f9ae8061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9b00006fd0 tx=0x7f9b00008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.006+0000 7f9b06000700 1 -- 172.21.15.100:0/444375512 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9b0804bdb0 con 0x7f9b10154260 2024-01-22T05:38:10.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.180+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9b1005fdb0 con 0x7f9b10154260 2024-01-22T05:38:10.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.180+0000 7f9b06000700 1 -- 172.21.15.100:0/444375512 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b0804f3d0 con 0x7f9b10154260 2024-01-22T05:38:10.180 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.182+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9ae805f150 msgr2=0x7f9ae8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.182+0000 7f9b15600700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9ae805f150 0x7f9ae8061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9b00006fd0 tx=0x7f9b00008040).stop 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.182+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b10154260 msgr2=0x7f9b100c2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.182+0000 7f9b15600700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b10154260 0x7f9b100c2c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9b08009e90 tx=0x7f9b0800b040).stop 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.182+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 shutdown_connections 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.183+0000 7f9b15600700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9ae805f150 0x7f9ae8061610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.183+0000 7f9b15600700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b10154260 0x7f9b100c2c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.183+0000 7f9b15600700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b100c5c80 0x7f9b10152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.183+0000 7f9b15600700 1 --2- 172.21.15.100:0/444375512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b100c65f0 0x7f9b100aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.183+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 >> 172.21.15.100:0/444375512 conn(0x7f9b1005e9d0 msgr2=0x7f9b100630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:10.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.183+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 shutdown_connections 2024-01-22T05:38:10.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.183+0000 7f9b15600700 1 -- 172.21.15.100:0/444375512 wait complete. 2024-01-22T05:38:10.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.5 2024-01-22T05:38:10.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-22T05:38:10.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.384+0000 7f5559800700 1 Processor -- start 2024-01-22T05:38:10.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.384+0000 7f5559800700 1 -- start start 2024-01-22T05:38:10.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5559800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554157d80 0x7f5554158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5559800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55540c1a40 con 0x7f5554154260 2024-01-22T05:38:10.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5559800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55540cbd30 con 0x7f55541586f0 2024-01-22T05:38:10.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5559800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5554158b80 con 0x7f5554157d80 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5552a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5554154260 0x7f55540cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41248/0 (socket says 172.21.15.100:41248) 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5552a00700 1 -- 172.21.15.100:0/2073843388 learned_addr learned my addr 172.21.15.100:0/2073843388 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5552000700 1 --2- 172.21.15.100:0/2073843388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554157d80 0x7f5554158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228162341 0 0) 0x7f55540c1a40 con 0x7f5554154260 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55340033f0 con 0x7f5554154260 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359284436 0 0) 0x7f55540cbd30 con 0x7f55541586f0 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55540c1a40 con 0x7f55541586f0 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.386+0000 7f5552000700 1 -- 172.21.15.100:0/2073843388 >> v1:172.21.15.169:6789/0 conn(0x7f55541586f0 legacy=0x7f55540c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254094757 0 0) 0x7f55340033f0 con 0x7f5554154260 2024-01-22T05:38:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5552000700 1 -- 172.21.15.100:0/2073843388 >> v1:172.21.15.100:6789/0 conn(0x7f5554154260 legacy=0x7f55540cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5552000700 1 -- 172.21.15.100:0/2073843388 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540c1110 con 0x7f5554157d80 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5552000700 1 --2- 172.21.15.100:0/2073843388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554157d80 0x7f5554158200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f553c0097c0 tx=0x7f553c009060).ready entity=mon.2 client_cookie=2210688c3e3e82b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440015f0 con 0x7f5554157d80 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c011400 con 0x7f5554157d80 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5551600700 1 -- 172.21.15.100:0/2073843388 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c011780 con 0x7f5554157d80 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5559800700 1 -- 172.21.15.100:0/2073843388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554157d80 msgr2=0x7f5554158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.387+0000 7f5559800700 1 --2- 172.21.15.100:0/2073843388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554157d80 0x7f5554158200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f553c0097c0 tx=0x7f553c009060).stop 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.388+0000 7f5559800700 1 -- 172.21.15.100:0/2073843388 shutdown_connections 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.388+0000 7f5559800700 1 --2- 172.21.15.100:0/2073843388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554157d80 0x7f5554158200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.388+0000 7f5559800700 1 -- 172.21.15.100:0/2073843388 >> 172.21.15.100:0/2073843388 conn(0x7f555405e9d0 msgr2=0x7f55540cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.388+0000 7f5559800700 1 -- 172.21.15.100:0/2073843388 shutdown_connections 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.388+0000 7f5559800700 1 -- 172.21.15.100:0/2073843388 wait complete. 2024-01-22T05:38:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.389+0000 7f5559800700 1 Processor -- start 2024-01-22T05:38:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.389+0000 7f5559800700 1 -- start start 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5559800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554154260 0x7f55540afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5559800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5554157d80 0x7f5554156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5559800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55541586f0 0x7f5554063500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5559800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540af6c0 con 0x7f5554157d80 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5559800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540aedd0 con 0x7f55541586f0 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5559800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55540af070 con 0x7f5554154260 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5552000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5554157d80 0x7f5554156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5552000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5554157d80 0x7f5554156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55326/0 (socket says 172.21.15.100:55326) 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.390+0000 7f5552000700 1 -- 172.21.15.100:0/1751758434 learned_addr learned my addr 172.21.15.100:0/1751758434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5552a00700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554154260 0x7f55540afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5553400700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55541586f0 0x7f5554063500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5552000700 1 -- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554154260 msgr2=0x7f55540afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5552000700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554154260 0x7f55540afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5552000700 1 -- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55541586f0 msgr2=0x7f5554063500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5552000700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55541586f0 0x7f5554063500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5552000700 1 -- 172.21.15.100:0/1751758434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0092a0 con 0x7f5554157d80 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5553400700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55541586f0 0x7f5554063500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5552000700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5554157d80 0x7f5554156fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5554083620 tx=0x7f553c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f554a000700 1 -- 172.21.15.100:0/1751758434 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c021070 con 0x7f5554157d80 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f554a000700 1 -- 172.21.15.100:0/1751758434 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0108b0 con 0x7f5554157d80 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55540af350 con 0x7f5554157d80 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f554a000700 1 -- 172.21.15.100:0/1751758434 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c010c50 con 0x7f5554157d80 2024-01-22T05:38:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.391+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55541574c0 con 0x7f5554157d80 2024-01-22T05:38:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.393+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555405fdb0 con 0x7f5554157d80 2024-01-22T05:38:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.393+0000 7f554a000700 1 -- 172.21.15.100:0/1751758434 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f553c01d640 con 0x7f5554157d80 2024-01-22T05:38:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.394+0000 7f554a000700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f552c05f150 0x7f552c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.394+0000 7f554a000700 1 -- 172.21.15.100:0/1751758434 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f553c07b210 con 0x7f5554157d80 2024-01-22T05:38:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.394+0000 7f5552a00700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f552c05f150 0x7f552c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.395+0000 7f5552a00700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f552c05f150 0x7f552c061610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5544000ef0 tx=0x7f5544009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.398+0000 7f554a000700 1 -- 172.21.15.100:0/1751758434 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f553c04c4e0 con 0x7f5554157d80 2024-01-22T05:38:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.569+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5554084940 con 0x7f5554157d80 2024-01-22T05:38:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.570+0000 7f554a000700 1 -- 172.21.15.100:0/1751758434 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f553c010db0 con 0x7f5554157d80 2024-01-22T05:38:10.570 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-01-22T05:38:10.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f552c05f150 msgr2=0x7f552c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f552c05f150 0x7f552c061610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5544000ef0 tx=0x7f5544009040).stop 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5554157d80 msgr2=0x7f5554156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5554157d80 0x7f5554156fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5554083620 tx=0x7f553c016000).stop 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 shutdown_connections 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f552c05f150 0x7f552c061610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55541586f0 0x7f5554063500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5554154260 0x7f55540afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 --2- 172.21.15.100:0/1751758434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5554157d80 0x7f5554156fd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 >> 172.21.15.100:0/1751758434 conn(0x7f555405e9d0 msgr2=0x7f55540c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 shutdown_connections 2024-01-22T05:38:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.572+0000 7f5559800700 1 -- 172.21.15.100:0/1751758434 wait complete. 2024-01-22T05:38:10.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-01-22T05:38:10.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-22T05:38:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.772+0000 7fa2fbc00700 1 Processor -- start 2024-01-22T05:38:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.772+0000 7fa2fbc00700 1 -- start start 2024-01-22T05:38:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2fbc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f40c0cc0 0x7fa2f40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2fbc00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa2f40ca630 0x7fa2f40c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2fbc00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40c9cb0 con 0x7fa2f4154190 2024-01-22T05:38:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2fbc00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f40a8230 con 0x7fa2f40ca630 2024-01-22T05:38:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2fbc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40851f0 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f9c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa2f40ca630 0x7fa2f40c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f9c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa2f40ca630 0x7fa2f40c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55328/0 (socket says 172.21.15.100:55328) 2024-01-22T05:38:10.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f9c00700 1 -- 172.21.15.100:0/1011933659 learned_addr learned my addr 172.21.15.100:0/1011933659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:10.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f3e00700 1 --2- 172.21.15.100:0/1011933659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f40c0cc0 0x7fa2f40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f9c00700 1 -- 172.21.15.100:0/1011933659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f40c0cc0 msgr2=0x7fa2f40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:10.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f9c00700 1 --2- 172.21.15.100:0/1011933659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f40c0cc0 0x7fa2f40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f9c00700 1 -- 172.21.15.100:0/1011933659 >> v1:172.21.15.169:6789/0 conn(0x7fa2f4154190 legacy=0x7fa2f40a7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.774+0000 7fa2f9c00700 1 -- 172.21.15.100:0/1011933659 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40c6cf0 con 0x7fa2f40ca630 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2f9c00700 1 --2- 172.21.15.100:0/1011933659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40ca630 0x7fa2f40c5d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa2ec009f20 tx=0x7fa2ec009840).ready entity=mon.0 client_cookie=617ffbdc2ce20dd9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2f3400700 1 -- 172.21.15.100:0/1011933659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00e070 con 0x7fa2f40ca630 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2f3400700 1 -- 172.21.15.100:0/1011933659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec00ba80 con 0x7fa2f40ca630 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2f3400700 1 -- 172.21.15.100:0/1011933659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00be00 con 0x7fa2f40ca630 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 -- 172.21.15.100:0/1011933659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40ca630 msgr2=0x7fa2f40c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/1011933659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40ca630 0x7fa2f40c5d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa2ec009f20 tx=0x7fa2ec009840).stop 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 -- 172.21.15.100:0/1011933659 shutdown_connections 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/1011933659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40ca630 0x7fa2f40c5d40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/1011933659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f40c0cc0 0x7fa2f40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 -- 172.21.15.100:0/1011933659 >> 172.21.15.100:0/1011933659 conn(0x7fa2f405e9d0 msgr2=0x7fa2f40cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 -- 172.21.15.100:0/1011933659 shutdown_connections 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.775+0000 7fa2fbc00700 1 -- 172.21.15.100:0/1011933659 wait complete. 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.777+0000 7fa2fbc00700 1 Processor -- start 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.777+0000 7fa2fbc00700 1 -- start start 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2fbc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40c0cc0 0x7fa2f4149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2fbc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ca630 0x7fa2f40ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2fbc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4154190 0x7fa2f40aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2fbc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40af720 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2fbc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40af160 con 0x7fa2f40ca630 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2fbc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40af440 con 0x7fa2f4154190 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2f9200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40c0cc0 0x7fa2f4149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2f9200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40c0cc0 0x7fa2f4149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55340/0 (socket says 172.21.15.100:55340) 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2f9200700 1 -- 172.21.15.100:0/2473320308 learned_addr learned my addr 172.21.15.100:0/2473320308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2f3e00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ca630 0x7fa2f40ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2f9c00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4154190 0x7fa2f40aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.778+0000 7fa2f9200700 1 -- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4154190 msgr2=0x7fa2f40aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2f9200700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4154190 0x7fa2f40aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2f9200700 1 -- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ca630 msgr2=0x7fa2f40ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2f9200700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ca630 0x7fa2f40ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2f9200700 1 -- 172.21.15.100:0/2473320308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec009ae0 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2f9200700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40c0cc0 0x7fa2f4149660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa2e400c440 tx=0x7fa2e4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2ebe00700 1 -- 172.21.15.100:0/2473320308 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4007020 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2ebe00700 1 -- 172.21.15.100:0/2473320308 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e4007180 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f4094d60 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2ebe00700 1 -- 172.21.15.100:0/2473320308 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4007520 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.779+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f40afae0 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.780+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f4094bc0 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.781+0000 7fa2ebe00700 1 -- 172.21.15.100:0/2473320308 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa2e4006900 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.782+0000 7fa2ebe00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa2cc05f150 0x7fa2cc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.782+0000 7fa2ebe00700 1 -- 172.21.15.100:0/2473320308 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa2e40794a0 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.782+0000 7fa2f3e00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa2cc05f150 0x7fa2cc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.782+0000 7fa2f3e00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa2cc05f150 0x7fa2cc061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa2f4151030 tx=0x7fa2dc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.786+0000 7fa2ebe00700 1 -- 172.21.15.100:0/2473320308 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa2e4047b00 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.956+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa2f405fdb0 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.956+0000 7fa2ebe00700 1 -- 172.21.15.100:0/2473320308 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2f4094bc0 con 0x7fa2f40c0cc0 2024-01-22T05:38:10.956 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-01-22T05:38:10.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa2cc05f150 msgr2=0x7fa2cc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa2cc05f150 0x7fa2cc061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa2f4151030 tx=0x7fa2dc008040).stop 2024-01-22T05:38:10.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40c0cc0 msgr2=0x7fa2f4149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40c0cc0 0x7fa2f4149660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa2e400c440 tx=0x7fa2e4007e50).stop 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 shutdown_connections 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa2cc05f150 0x7fa2cc061610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4154190 0x7fa2f40aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f40c0cc0 0x7fa2f4149660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 --2- 172.21.15.100:0/2473320308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ca630 0x7fa2f40ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 >> 172.21.15.100:0/2473320308 conn(0x7fa2f405e9d0 msgr2=0x7fa2f40c6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 shutdown_connections 2024-01-22T05:38:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:10.958+0000 7fa2fbc00700 1 -- 172.21.15.100:0/2473320308 wait complete. 2024-01-22T05:38:10.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-01-22T05:38:10.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-22T05:38:10.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:38:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.160+0000 7f1f42c00700 1 Processor -- start 2024-01-22T05:38:11.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.160+0000 7f1f42c00700 1 -- start start 2024-01-22T05:38:11.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f42c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c154060 0x7f1f3c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f42c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f3c0aa3f0 0x7f1f3c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f42c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c0cb880 con 0x7f1f3c0a9ec0 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f42c00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cbb60 con 0x7f1f3c0aa3f0 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f42c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c17d0 con 0x7f1f3c154060 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f3be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c154060 0x7f1f3c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f3be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c154060 0x7f1f3c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:53684/0 (socket says 172.21.15.100:53684) 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f3b400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f3c0aa3f0 0x7f1f3c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f3be00700 1 -- 172.21.15.100:0/88162707 learned_addr learned my addr 172.21.15.100:0/88162707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f3aa00700 1 -- 172.21.15.100:0/88162707 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395853831 0 0) 0x7f1f3c0cb880 con 0x7f1f3c0a9ec0 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.162+0000 7f1f3aa00700 1 -- 172.21.15.100:0/88162707 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f1c0033f0 con 0x7f1f3c0a9ec0 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3b400700 1 -- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c154060 msgr2=0x7f1f3c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:11.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3b400700 1 --2- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c154060 0x7f1f3c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3b400700 1 -- 172.21.15.100:0/88162707 >> v1:172.21.15.169:6789/0 conn(0x7f1f3c0a9ec0 legacy=0x7f1f3c0c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3b400700 1 -- 172.21.15.100:0/88162707 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0c1ab0 con 0x7f1f3c0aa3f0 2024-01-22T05:38:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3be00700 1 --2- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c154060 0x7f1f3c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3b400700 1 --2- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 0x7f1f3c0c5da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1f24009760 tx=0x7f1f24009060).ready entity=mon.1 client_cookie=6139b32ca15fbfb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3aa00700 1 -- 172.21.15.100:0/88162707 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f240090d0 con 0x7f1f3c0aa3f0 2024-01-22T05:38:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3aa00700 1 -- 172.21.15.100:0/88162707 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400d4a0 con 0x7f1f3c0aa3f0 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f3aa00700 1 -- 172.21.15.100:0/88162707 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400d820 con 0x7f1f3c0aa3f0 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f42c00700 1 -- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 msgr2=0x7f1f3c0c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.163+0000 7f1f42c00700 1 --2- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 0x7f1f3c0c5da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1f24009760 tx=0x7f1f24009060).stop 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.164+0000 7f1f42c00700 1 -- 172.21.15.100:0/88162707 shutdown_connections 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.164+0000 7f1f42c00700 1 --2- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c154060 0x7f1f3c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.164+0000 7f1f42c00700 1 --2- 172.21.15.100:0/88162707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 0x7f1f3c0c5da0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.164+0000 7f1f42c00700 1 -- 172.21.15.100:0/88162707 >> 172.21.15.100:0/88162707 conn(0x7f1f3c05e9d0 msgr2=0x7f1f3c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.164+0000 7f1f42c00700 1 -- 172.21.15.100:0/88162707 shutdown_connections 2024-01-22T05:38:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.164+0000 7f1f42c00700 1 -- 172.21.15.100:0/88162707 wait complete. 2024-01-22T05:38:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.165+0000 7f1f42c00700 1 Processor -- start 2024-01-22T05:38:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.165+0000 7f1f42c00700 1 -- start start 2024-01-22T05:38:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f42c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c0a9ec0 0x7f1f3c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f42c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 0x7f1f3c143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f42c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f3c154060 0x7f1f3c0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f42c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c143f90 con 0x7f1f3c154060 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f42c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c167630 con 0x7f1f3c0aa3f0 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f42c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c167ed0 con 0x7f1f3c0a9ec0 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f40c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f3c154060 0x7f1f3c0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f40c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f3c154060 0x7f1f3c0b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55356/0 (socket says 172.21.15.100:55356) 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f40c00700 1 -- 172.21.15.100:0/107045194 learned_addr learned my addr 172.21.15.100:0/107045194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.166+0000 7f1f3b400700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 0x7f1f3c143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f3be00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c0a9ec0 0x7f1f3c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f40c00700 1 -- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c0a9ec0 msgr2=0x7f1f3c0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f40c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c0a9ec0 0x7f1f3c0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f40c00700 1 -- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 msgr2=0x7f1f3c143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f40c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 0x7f1f3c143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f40c00700 1 -- 172.21.15.100:0/107045194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c009370 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f40c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f3c154060 0x7f1f3c0b05f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1f3400c740 tx=0x7f1f3400ca50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f33400700 1 -- 172.21.15.100:0/107045194 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400e4a0 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f33400700 1 -- 172.21.15.100:0/107045194 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400e600 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f33400700 1 -- 172.21.15.100:0/107045194 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400e980 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.167+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f240092a0 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.168+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c167880 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.169+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c05fdb0 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.169+0000 7f1f33400700 1 -- 172.21.15.100:0/107045194 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1f34012400 con 0x7f1f3c154060 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.170+0000 7f1f33400700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f1405f1a0 0x7f1f14061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.170+0000 7f1f33400700 1 -- 172.21.15.100:0/107045194 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1f340798e0 con 0x7f1f3c154060 2024-01-22T05:38:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.170+0000 7f1f3be00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f1405f1a0 0x7f1f14061660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.171+0000 7f1f3be00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f1405f1a0 0x7f1f14061660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1f3c167590 tx=0x7f1f2c0090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.174+0000 7f1f33400700 1 -- 172.21.15.100:0/107045194 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1f34048b00 con 0x7f1f3c154060 2024-01-22T05:38:11.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.341+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f3c083e20 con 0x7f1f1405f1a0 2024-01-22T05:38:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.351+0000 7f1f33400700 1 -- 172.21.15.100:0/107045194 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336280 (secure 0 0 0) 0x7f1f3c083e20 con 0x7f1f1405f1a0 2024-01-22T05:38:11.356 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:11.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f1405f1a0 msgr2=0x7f1f14061660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f1405f1a0 0x7f1f14061660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1f3c167590 tx=0x7f1f2c0090f0).stop 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f3c154060 msgr2=0x7f1f3c0b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f3c154060 0x7f1f3c0b05f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1f3400c740 tx=0x7f1f3400ca50).stop 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 shutdown_connections 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f1405f1a0 0x7f1f14061660 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f3c154060 0x7f1f3c0b05f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f3c0a9ec0 0x7f1f3c0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 --2- 172.21.15.100:0/107045194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f3c0aa3f0 0x7f1f3c143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 >> 172.21.15.100:0/107045194 conn(0x7f1f3c05e9d0 msgr2=0x7f1f3c0c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 shutdown_connections 2024-01-22T05:38:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.356+0000 7f1f42c00700 1 -- 172.21.15.100:0/107045194 wait complete. 2024-01-22T05:38:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:38:11.375 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-22T05:38:11.132417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":669868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002149"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729846+0000","last_change":"2024-01-22T05:37:58.727081+0000","last_active":"2024-01-22T05:37:58.729846+0000","last_peered":"2024-01-22T05:37:58.729846+0000","last_clean":"2024-01-22T05:37:58.729846+0000","last_became_active":"2024-01-22T05:37:58.725736+0000","last_became_peered":"2024-01-22T05:37:58.725736+0000","last_unstale":"2024-01-22T05:37:58.729846+0000","last_undegraded":"2024-01-22T05:37:58.729846+0000","last_fullsized":"2024-01-22T05:37:58.729846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689450+0000","last_change":"2024-01-22T05:37:58.259700+0000","last_active":"2024-01-22T05:37:58.689450+0000","last_peered":"2024-01-22T05:37:58.689450+0000","last_clean":"2024-01-22T05:37:58.689450+0000","last_became_active":"2024-01-22T05:37:58.259421+0000","last_became_peered":"2024-01-22T05:37:58.259421+0000","last_unstale":"2024-01-22T05:37:58.689450+0000","last_undegraded":"2024-01-22T05:37:58.689450+0000","last_fullsized":"2024-01-22T05:37:58.689450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727312+0000","last_change":"2024-01-22T05:37:58.720751+0000","last_active":"2024-01-22T05:37:58.727312+0000","last_peered":"2024-01-22T05:37:58.727312+0000","last_clean":"2024-01-22T05:37:58.727312+0000","last_became_active":"2024-01-22T05:37:58.720447+0000","last_became_peered":"2024-01-22T05:37:58.720447+0000","last_unstale":"2024-01-22T05:37:58.727312+0000","last_undegraded":"2024-01-22T05:37:58.727312+0000","last_fullsized":"2024-01-22T05:37:58.727312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696152+0000","last_change":"2024-01-22T05:37:58.248478+0000","last_active":"2024-01-22T05:37:58.696152+0000","last_peered":"2024-01-22T05:37:58.696152+0000","last_clean":"2024-01-22T05:37:58.696152+0000","last_became_active":"2024-01-22T05:37:58.248115+0000","last_became_peered":"2024-01-22T05:37:58.248115+0000","last_unstale":"2024-01-22T05:37:58.696152+0000","last_undegraded":"2024-01-22T05:37:58.696152+0000","last_fullsized":"2024-01-22T05:37:58.696152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730986+0000","last_change":"2024-01-22T05:37:58.728642+0000","last_active":"2024-01-22T05:37:58.730986+0000","last_peered":"2024-01-22T05:37:58.730986+0000","last_clean":"2024-01-22T05:37:58.730986+0000","last_became_active":"2024-01-22T05:37:58.728277+0000","last_became_peered":"2024-01-22T05:37:58.728277+0000","last_unstale":"2024-01-22T05:37:58.730986+0000","last_undegraded":"2024-01-22T05:37:58.730986+0000","last_fullsized":"2024-01-22T05:37:58.730986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702519+0000","last_change":"2024-01-22T05:37:58.248744+0000","last_active":"2024-01-22T05:37:58.702519+0000","last_peered":"2024-01-22T05:37:58.702519+0000","last_clean":"2024-01-22T05:37:58.702519+0000","last_became_active":"2024-01-22T05:37:58.248261+0000","last_became_peered":"2024-01-22T05:37:58.248261+0000","last_unstale":"2024-01-22T05:37:58.702519+0000","last_undegraded":"2024-01-22T05:37:58.702519+0000","last_fullsized":"2024-01-22T05:37:58.702519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707363+0000","last_change":"2024-01-22T05:37:58.705253+0000","last_active":"2024-01-22T05:37:58.707363+0000","last_peered":"2024-01-22T05:37:58.707363+0000","last_clean":"2024-01-22T05:37:58.707363+0000","last_became_active":"2024-01-22T05:37:58.704907+0000","last_became_peered":"2024-01-22T05:37:58.704907+0000","last_unstale":"2024-01-22T05:37:58.707363+0000","last_undegraded":"2024-01-22T05:37:58.707363+0000","last_fullsized":"2024-01-22T05:37:58.707363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702127+0000","last_change":"2024-01-22T05:37:58.263344+0000","last_active":"2024-01-22T05:37:58.702127+0000","last_peered":"2024-01-22T05:37:58.702127+0000","last_clean":"2024-01-22T05:37:58.702127+0000","last_became_active":"2024-01-22T05:37:58.263056+0000","last_became_peered":"2024-01-22T05:37:58.263056+0000","last_unstale":"2024-01-22T05:37:58.702127+0000","last_undegraded":"2024-01-22T05:37:58.702127+0000","last_fullsized":"2024-01-22T05:37:58.702127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726308+0000","last_change":"2024-01-22T05:37:58.720495+0000","last_active":"2024-01-22T05:37:58.726308+0000","last_peered":"2024-01-22T05:37:58.726308+0000","last_clean":"2024-01-22T05:37:58.726308+0000","last_became_active":"2024-01-22T05:37:58.713824+0000","last_became_peered":"2024-01-22T05:37:58.713824+0000","last_unstale":"2024-01-22T05:37:58.726308+0000","last_undegraded":"2024-01-22T05:37:58.726308+0000","last_fullsized":"2024-01-22T05:37:58.726308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700930+0000","last_change":"2024-01-22T05:37:58.264631+0000","last_active":"2024-01-22T05:37:58.700930+0000","last_peered":"2024-01-22T05:37:58.700930+0000","last_clean":"2024-01-22T05:37:58.700930+0000","last_became_active":"2024-01-22T05:37:58.264164+0000","last_became_peered":"2024-01-22T05:37:58.264164+0000","last_unstale":"2024-01-22T05:37:58.700930+0000","last_undegraded":"2024-01-22T05:37:58.700930+0000","last_fullsized":"2024-01-22T05:37:58.700930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716320+0000","last_change":"2024-01-22T05:37:58.712852+0000","last_active":"2024-01-22T05:37:58.716320+0000","last_peered":"2024-01-22T05:37:58.716320+0000","last_clean":"2024-01-22T05:37:58.716320+0000","last_became_active":"2024-01-22T05:37:58.712580+0000","last_became_peered":"2024-01-22T05:37:58.712580+0000","last_unstale":"2024-01-22T05:37:58.716320+0000","last_undegraded":"2024-01-22T05:37:58.716320+0000","last_fullsized":"2024-01-22T05:37:58.716320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718571+0000","last_change":"2024-01-22T05:37:58.250312+0000","last_active":"2024-01-22T05:37:58.718571+0000","last_peered":"2024-01-22T05:37:58.718571+0000","last_clean":"2024-01-22T05:37:58.718571+0000","last_became_active":"2024-01-22T05:37:58.250058+0000","last_became_peered":"2024-01-22T05:37:58.250058+0000","last_unstale":"2024-01-22T05:37:58.718571+0000","last_undegraded":"2024-01-22T05:37:58.718571+0000","last_fullsized":"2024-01-22T05:37:58.718571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723610+0000","last_change":"2024-01-22T05:37:58.720917+0000","last_active":"2024-01-22T05:37:58.723610+0000","last_peered":"2024-01-22T05:37:58.723610+0000","last_clean":"2024-01-22T05:37:58.723610+0000","last_became_active":"2024-01-22T05:37:58.720566+0000","last_became_peered":"2024-01-22T05:37:58.720566+0000","last_unstale":"2024-01-22T05:37:58.723610+0000","last_undegraded":"2024-01-22T05:37:58.723610+0000","last_fullsized":"2024-01-22T05:37:58.723610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727860+0000","last_change":"2024-01-22T05:37:58.262225+0000","last_active":"2024-01-22T05:37:58.727860+0000","last_peered":"2024-01-22T05:37:58.727860+0000","last_clean":"2024-01-22T05:37:58.727860+0000","last_became_active":"2024-01-22T05:37:58.261931+0000","last_became_peered":"2024-01-22T05:37:58.261931+0000","last_unstale":"2024-01-22T05:37:58.727860+0000","last_undegraded":"2024-01-22T05:37:58.727860+0000","last_fullsized":"2024-01-22T05:37:58.727860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716463+0000","last_change":"2024-01-22T05:37:58.713713+0000","last_active":"2024-01-22T05:37:58.716463+0000","last_peered":"2024-01-22T05:37:58.716463+0000","last_clean":"2024-01-22T05:37:58.716463+0000","last_became_active":"2024-01-22T05:37:58.713222+0000","last_became_peered":"2024-01-22T05:37:58.713222+0000","last_unstale":"2024-01-22T05:37:58.716463+0000","last_undegraded":"2024-01-22T05:37:58.716463+0000","last_fullsized":"2024-01-22T05:37:58.716463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.725718+0000","last_change":"2024-01-22T05:37:58.263422+0000","last_active":"2024-01-22T05:37:58.725718+0000","last_peered":"2024-01-22T05:37:58.725718+0000","last_clean":"2024-01-22T05:37:58.725718+0000","last_became_active":"2024-01-22T05:37:58.263038+0000","last_became_peered":"2024-01-22T05:37:58.263038+0000","last_unstale":"2024-01-22T05:37:58.725718+0000","last_undegraded":"2024-01-22T05:37:58.725718+0000","last_fullsized":"2024-01-22T05:37:58.725718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724388+0000","last_change":"2024-01-22T05:37:58.720659+0000","last_active":"2024-01-22T05:37:58.724388+0000","last_peered":"2024-01-22T05:37:58.724388+0000","last_clean":"2024-01-22T05:37:58.724388+0000","last_became_active":"2024-01-22T05:37:58.720356+0000","last_became_peered":"2024-01-22T05:37:58.720356+0000","last_unstale":"2024-01-22T05:37:58.724388+0000","last_undegraded":"2024-01-22T05:37:58.724388+0000","last_fullsized":"2024-01-22T05:37:58.724388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700696+0000","last_change":"2024-01-22T05:37:58.266202+0000","last_active":"2024-01-22T05:37:58.700696+0000","last_peered":"2024-01-22T05:37:58.700696+0000","last_clean":"2024-01-22T05:37:58.700696+0000","last_became_active":"2024-01-22T05:37:58.265864+0000","last_became_peered":"2024-01-22T05:37:58.265864+0000","last_unstale":"2024-01-22T05:37:58.700696+0000","last_undegraded":"2024-01-22T05:37:58.700696+0000","last_fullsized":"2024-01-22T05:37:58.700696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729642+0000","last_change":"2024-01-22T05:37:58.724022+0000","last_active":"2024-01-22T05:37:58.729642+0000","last_peered":"2024-01-22T05:37:58.729642+0000","last_clean":"2024-01-22T05:37:58.729642+0000","last_became_active":"2024-01-22T05:37:58.723620+0000","last_became_peered":"2024-01-22T05:37:58.723620+0000","last_unstale":"2024-01-22T05:37:58.729642+0000","last_undegraded":"2024-01-22T05:37:58.729642+0000","last_fullsized":"2024-01-22T05:37:58.729642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705714+0000","last_change":"2024-01-22T05:37:58.256227+0000","last_active":"2024-01-22T05:37:58.705714+0000","last_peered":"2024-01-22T05:37:58.705714+0000","last_clean":"2024-01-22T05:37:58.705714+0000","last_became_active":"2024-01-22T05:37:58.255884+0000","last_became_peered":"2024-01-22T05:37:58.255884+0000","last_unstale":"2024-01-22T05:37:58.705714+0000","last_undegraded":"2024-01-22T05:37:58.705714+0000","last_fullsized":"2024-01-22T05:37:58.705714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729732+0000","last_change":"2024-01-22T05:37:58.723121+0000","last_active":"2024-01-22T05:37:58.729732+0000","last_peered":"2024-01-22T05:37:58.729732+0000","last_clean":"2024-01-22T05:37:58.729732+0000","last_became_active":"2024-01-22T05:37:58.722807+0000","last_became_peered":"2024-01-22T05:37:58.722807+0000","last_unstale":"2024-01-22T05:37:58.729732+0000","last_undegraded":"2024-01-22T05:37:58.729732+0000","last_fullsized":"2024-01-22T05:37:58.729732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728450+0000","last_change":"2024-01-22T05:37:58.258876+0000","last_active":"2024-01-22T05:37:58.728450+0000","last_peered":"2024-01-22T05:37:58.728450+0000","last_clean":"2024-01-22T05:37:58.728450+0000","last_became_active":"2024-01-22T05:37:58.258599+0000","last_became_peered":"2024-01-22T05:37:58.258599+0000","last_unstale":"2024-01-22T05:37:58.728450+0000","last_undegraded":"2024-01-22T05:37:58.728450+0000","last_fullsized":"2024-01-22T05:37:58.728450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723711+0000","last_change":"2024-01-22T05:37:58.715284+0000","last_active":"2024-01-22T05:37:58.723711+0000","last_peered":"2024-01-22T05:37:58.723711+0000","last_clean":"2024-01-22T05:37:58.723711+0000","last_became_active":"2024-01-22T05:37:58.715003+0000","last_became_peered":"2024-01-22T05:37:58.715003+0000","last_unstale":"2024-01-22T05:37:58.723711+0000","last_undegraded":"2024-01-22T05:37:58.723711+0000","last_fullsized":"2024-01-22T05:37:58.723711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718376+0000","last_change":"2024-01-22T05:37:58.253681+0000","last_active":"2024-01-22T05:37:58.718376+0000","last_peered":"2024-01-22T05:37:58.718376+0000","last_clean":"2024-01-22T05:37:58.718376+0000","last_became_active":"2024-01-22T05:37:58.252995+0000","last_became_peered":"2024-01-22T05:37:58.252995+0000","last_unstale":"2024-01-22T05:37:58.718376+0000","last_undegraded":"2024-01-22T05:37:58.718376+0000","last_fullsized":"2024-01-22T05:37:58.718376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722299+0000","last_change":"2024-01-22T05:37:58.718097+0000","last_active":"2024-01-22T05:37:58.722299+0000","last_peered":"2024-01-22T05:37:58.722299+0000","last_clean":"2024-01-22T05:37:58.722299+0000","last_became_active":"2024-01-22T05:37:58.717375+0000","last_became_peered":"2024-01-22T05:37:58.717375+0000","last_unstale":"2024-01-22T05:37:58.722299+0000","last_undegraded":"2024-01-22T05:37:58.722299+0000","last_fullsized":"2024-01-22T05:37:58.722299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719556+0000","last_change":"2024-01-22T05:37:58.257304+0000","last_active":"2024-01-22T05:37:58.719556+0000","last_peered":"2024-01-22T05:37:58.719556+0000","last_clean":"2024-01-22T05:37:58.719556+0000","last_became_active":"2024-01-22T05:37:58.257020+0000","last_became_peered":"2024-01-22T05:37:58.257020+0000","last_unstale":"2024-01-22T05:37:58.719556+0000","last_undegraded":"2024-01-22T05:37:58.719556+0000","last_fullsized":"2024-01-22T05:37:58.719556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717620+0000","last_change":"2024-01-22T05:37:58.713314+0000","last_active":"2024-01-22T05:37:58.717620+0000","last_peered":"2024-01-22T05:37:58.717620+0000","last_clean":"2024-01-22T05:37:58.717620+0000","last_became_active":"2024-01-22T05:37:58.713006+0000","last_became_peered":"2024-01-22T05:37:58.713006+0000","last_unstale":"2024-01-22T05:37:58.717620+0000","last_undegraded":"2024-01-22T05:37:58.717620+0000","last_fullsized":"2024-01-22T05:37:58.717620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714189+0000","last_change":"2024-01-22T05:37:58.262212+0000","last_active":"2024-01-22T05:37:58.714189+0000","last_peered":"2024-01-22T05:37:58.714189+0000","last_clean":"2024-01-22T05:37:58.714189+0000","last_became_active":"2024-01-22T05:37:58.261871+0000","last_became_peered":"2024-01-22T05:37:58.261871+0000","last_unstale":"2024-01-22T05:37:58.714189+0000","last_undegraded":"2024-01-22T05:37:58.714189+0000","last_fullsized":"2024-01-22T05:37:58.714189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724071+0000","last_change":"2024-01-22T05:37:58.716253+0000","last_active":"2024-01-22T05:37:58.724071+0000","last_peered":"2024-01-22T05:37:58.724071+0000","last_clean":"2024-01-22T05:37:58.724071+0000","last_became_active":"2024-01-22T05:37:58.715943+0000","last_became_peered":"2024-01-22T05:37:58.715943+0000","last_unstale":"2024-01-22T05:37:58.724071+0000","last_undegraded":"2024-01-22T05:37:58.724071+0000","last_fullsized":"2024-01-22T05:37:58.724071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697258+0000","last_change":"2024-01-22T05:37:58.260069+0000","last_active":"2024-01-22T05:37:58.697258+0000","last_peered":"2024-01-22T05:37:58.697258+0000","last_clean":"2024-01-22T05:37:58.697258+0000","last_became_active":"2024-01-22T05:37:58.257371+0000","last_became_peered":"2024-01-22T05:37:58.257371+0000","last_unstale":"2024-01-22T05:37:58.697258+0000","last_undegraded":"2024-01-22T05:37:58.697258+0000","last_fullsized":"2024-01-22T05:37:58.697258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723329+0000","last_change":"2024-01-22T05:37:58.713209+0000","last_active":"2024-01-22T05:37:58.723329+0000","last_peered":"2024-01-22T05:37:58.723329+0000","last_clean":"2024-01-22T05:37:58.723329+0000","last_became_active":"2024-01-22T05:37:58.712865+0000","last_became_peered":"2024-01-22T05:37:58.712865+0000","last_unstale":"2024-01-22T05:37:58.723329+0000","last_undegraded":"2024-01-22T05:37:58.723329+0000","last_fullsized":"2024-01-22T05:37:58.723329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715117+0000","last_change":"2024-01-22T05:37:58.261836+0000","last_active":"2024-01-22T05:37:58.715117+0000","last_peered":"2024-01-22T05:37:58.715117+0000","last_clean":"2024-01-22T05:37:58.715117+0000","last_became_active":"2024-01-22T05:37:58.261533+0000","last_became_peered":"2024-01-22T05:37:58.261533+0000","last_unstale":"2024-01-22T05:37:58.715117+0000","last_undegraded":"2024-01-22T05:37:58.715117+0000","last_fullsized":"2024-01-22T05:37:58.715117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730485+0000","last_change":"2024-01-22T05:37:58.724748+0000","last_active":"2024-01-22T05:37:58.730485+0000","last_peered":"2024-01-22T05:37:58.730485+0000","last_clean":"2024-01-22T05:37:58.730485+0000","last_became_active":"2024-01-22T05:37:58.724181+0000","last_became_peered":"2024-01-22T05:37:58.724181+0000","last_unstale":"2024-01-22T05:37:58.730485+0000","last_undegraded":"2024-01-22T05:37:58.730485+0000","last_fullsized":"2024-01-22T05:37:58.730485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709832+0000","last_change":"2024-01-22T05:37:58.257196+0000","last_active":"2024-01-22T05:37:58.709832+0000","last_peered":"2024-01-22T05:37:58.709832+0000","last_clean":"2024-01-22T05:37:58.709832+0000","last_became_active":"2024-01-22T05:37:58.256932+0000","last_became_peered":"2024-01-22T05:37:58.256932+0000","last_unstale":"2024-01-22T05:37:58.709832+0000","last_undegraded":"2024-01-22T05:37:58.709832+0000","last_fullsized":"2024-01-22T05:37:58.709832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724590+0000","last_change":"2024-01-22T05:37:58.720229+0000","last_active":"2024-01-22T05:37:58.724590+0000","last_peered":"2024-01-22T05:37:58.724590+0000","last_clean":"2024-01-22T05:37:58.724590+0000","last_became_active":"2024-01-22T05:37:58.719862+0000","last_became_peered":"2024-01-22T05:37:58.719862+0000","last_unstale":"2024-01-22T05:37:58.724590+0000","last_undegraded":"2024-01-22T05:37:58.724590+0000","last_fullsized":"2024-01-22T05:37:58.724590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709188+0000","last_change":"2024-01-22T05:37:58.263404+0000","last_active":"2024-01-22T05:37:58.709188+0000","last_peered":"2024-01-22T05:37:58.709188+0000","last_clean":"2024-01-22T05:37:58.709188+0000","last_became_active":"2024-01-22T05:37:58.263016+0000","last_became_peered":"2024-01-22T05:37:58.263016+0000","last_unstale":"2024-01-22T05:37:58.709188+0000","last_undegraded":"2024-01-22T05:37:58.709188+0000","last_fullsized":"2024-01-22T05:37:58.709188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719869+0000","last_change":"2024-01-22T05:37:58.717161+0000","last_active":"2024-01-22T05:37:58.719869+0000","last_peered":"2024-01-22T05:37:58.719869+0000","last_clean":"2024-01-22T05:37:58.719869+0000","last_became_active":"2024-01-22T05:37:58.716723+0000","last_became_peered":"2024-01-22T05:37:58.716723+0000","last_unstale":"2024-01-22T05:37:58.719869+0000","last_undegraded":"2024-01-22T05:37:58.719869+0000","last_fullsized":"2024-01-22T05:37:58.719869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703194+0000","last_change":"2024-01-22T05:37:58.247858+0000","last_active":"2024-01-22T05:37:58.703194+0000","last_peered":"2024-01-22T05:37:58.703194+0000","last_clean":"2024-01-22T05:37:58.703194+0000","last_became_active":"2024-01-22T05:37:58.247562+0000","last_became_peered":"2024-01-22T05:37:58.247562+0000","last_unstale":"2024-01-22T05:37:58.703194+0000","last_undegraded":"2024-01-22T05:37:58.703194+0000","last_fullsized":"2024-01-22T05:37:58.703194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701497+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:37:58.701497+0000","last_peered":"2024-01-22T05:37:58.701497+0000","last_clean":"2024-01-22T05:37:58.701497+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:37:58.701497+0000","last_undegraded":"2024-01-22T05:37:58.701497+0000","last_fullsized":"2024-01-22T05:37:58.701497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700257+0000","last_change":"2024-01-22T05:37:58.252358+0000","last_active":"2024-01-22T05:37:58.700257+0000","last_peered":"2024-01-22T05:37:58.700257+0000","last_clean":"2024-01-22T05:37:58.700257+0000","last_became_active":"2024-01-22T05:37:58.248516+0000","last_became_peered":"2024-01-22T05:37:58.248516+0000","last_unstale":"2024-01-22T05:37:58.700257+0000","last_undegraded":"2024-01-22T05:37:58.700257+0000","last_fullsized":"2024-01-22T05:37:58.700257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726815+0000","last_change":"2024-01-22T05:37:58.721521+0000","last_active":"2024-01-22T05:37:58.726815+0000","last_peered":"2024-01-22T05:37:58.726815+0000","last_clean":"2024-01-22T05:37:58.726815+0000","last_became_active":"2024-01-22T05:37:58.721152+0000","last_became_peered":"2024-01-22T05:37:58.721152+0000","last_unstale":"2024-01-22T05:37:58.726815+0000","last_undegraded":"2024-01-22T05:37:58.726815+0000","last_fullsized":"2024-01-22T05:37:58.726815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.708232+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:37:58.708232+0000","last_peered":"2024-01-22T05:37:58.708232+0000","last_clean":"2024-01-22T05:37:58.708232+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:37:58.708232+0000","last_undegraded":"2024-01-22T05:37:58.708232+0000","last_fullsized":"2024-01-22T05:37:58.708232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696621+0000","last_change":"2024-01-22T05:37:58.252041+0000","last_active":"2024-01-22T05:37:58.696621+0000","last_peered":"2024-01-22T05:37:58.696621+0000","last_clean":"2024-01-22T05:37:58.696621+0000","last_became_active":"2024-01-22T05:37:58.251676+0000","last_became_peered":"2024-01-22T05:37:58.251676+0000","last_unstale":"2024-01-22T05:37:58.696621+0000","last_undegraded":"2024-01-22T05:37:58.696621+0000","last_fullsized":"2024-01-22T05:37:58.696621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715221+0000","last_change":"2024-01-22T05:37:58.707436+0000","last_active":"2024-01-22T05:37:58.715221+0000","last_peered":"2024-01-22T05:37:58.715221+0000","last_clean":"2024-01-22T05:37:58.715221+0000","last_became_active":"2024-01-22T05:37:58.707144+0000","last_became_peered":"2024-01-22T05:37:58.707144+0000","last_unstale":"2024-01-22T05:37:58.715221+0000","last_undegraded":"2024-01-22T05:37:58.715221+0000","last_fullsized":"2024-01-22T05:37:58.715221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718108+0000","last_change":"2024-01-22T05:37:58.716084+0000","last_active":"2024-01-22T05:37:58.718108+0000","last_peered":"2024-01-22T05:37:58.718108+0000","last_clean":"2024-01-22T05:37:58.718108+0000","last_became_active":"2024-01-22T05:37:58.715755+0000","last_became_peered":"2024-01-22T05:37:58.715755+0000","last_unstale":"2024-01-22T05:37:58.718108+0000","last_undegraded":"2024-01-22T05:37:58.718108+0000","last_fullsized":"2024-01-22T05:37:58.718108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.695763+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:37:58.695763+0000","last_peered":"2024-01-22T05:37:58.695763+0000","last_clean":"2024-01-22T05:37:58.695763+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:37:58.695763+0000","last_undegraded":"2024-01-22T05:37:58.695763+0000","last_fullsized":"2024-01-22T05:37:58.695763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702299+0000","last_change":"2024-01-22T05:37:58.255676+0000","last_active":"2024-01-22T05:37:58.702299+0000","last_peered":"2024-01-22T05:37:58.702299+0000","last_clean":"2024-01-22T05:37:58.702299+0000","last_became_active":"2024-01-22T05:37:58.253263+0000","last_became_peered":"2024-01-22T05:37:58.253263+0000","last_unstale":"2024-01-22T05:37:58.702299+0000","last_undegraded":"2024-01-22T05:37:58.702299+0000","last_fullsized":"2024-01-22T05:37:58.702299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724371+0000","last_change":"2024-01-22T05:37:58.720166+0000","last_active":"2024-01-22T05:37:58.724371+0000","last_peered":"2024-01-22T05:37:58.724371+0000","last_clean":"2024-01-22T05:37:58.724371+0000","last_became_active":"2024-01-22T05:37:58.719849+0000","last_became_peered":"2024-01-22T05:37:58.719849+0000","last_unstale":"2024-01-22T05:37:58.724371+0000","last_undegraded":"2024-01-22T05:37:58.724371+0000","last_fullsized":"2024-01-22T05:37:58.724371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705514+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:37:58.705514+0000","last_peered":"2024-01-22T05:37:58.705514+0000","last_clean":"2024-01-22T05:37:58.705514+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:37:58.705514+0000","last_undegraded":"2024-01-22T05:37:58.705514+0000","last_fullsized":"2024-01-22T05:37:58.705514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.688444+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:37:58.688444+0000","last_peered":"2024-01-22T05:37:58.688444+0000","last_clean":"2024-01-22T05:37:58.688444+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:37:58.688444+0000","last_undegraded":"2024-01-22T05:37:58.688444+0000","last_fullsized":"2024-01-22T05:37:58.688444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.694912+0000","last_change":"2024-01-22T05:37:58.248432+0000","last_active":"2024-01-22T05:37:58.694912+0000","last_peered":"2024-01-22T05:37:58.694912+0000","last_clean":"2024-01-22T05:37:58.694912+0000","last_became_active":"2024-01-22T05:37:58.248051+0000","last_became_peered":"2024-01-22T05:37:58.248051+0000","last_unstale":"2024-01-22T05:37:58.694912+0000","last_undegraded":"2024-01-22T05:37:58.694912+0000","last_fullsized":"2024-01-22T05:37:58.694912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732489+0000","last_change":"2024-01-22T05:37:58.726657+0000","last_active":"2024-01-22T05:37:58.732489+0000","last_peered":"2024-01-22T05:37:58.732489+0000","last_clean":"2024-01-22T05:37:58.732489+0000","last_became_active":"2024-01-22T05:37:58.724582+0000","last_became_peered":"2024-01-22T05:37:58.724582+0000","last_unstale":"2024-01-22T05:37:58.732489+0000","last_undegraded":"2024-01-22T05:37:58.732489+0000","last_fullsized":"2024-01-22T05:37:58.732489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704038+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:37:58.704038+0000","last_peered":"2024-01-22T05:37:58.704038+0000","last_clean":"2024-01-22T05:37:58.704038+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:37:58.704038+0000","last_undegraded":"2024-01-22T05:37:58.704038+0000","last_fullsized":"2024-01-22T05:37:58.704038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699091+0000","last_change":"2024-01-22T05:37:58.244890+0000","last_active":"2024-01-22T05:37:58.699091+0000","last_peered":"2024-01-22T05:37:58.699091+0000","last_clean":"2024-01-22T05:37:58.699091+0000","last_became_active":"2024-01-22T05:37:58.244624+0000","last_became_peered":"2024-01-22T05:37:58.244624+0000","last_unstale":"2024-01-22T05:37:58.699091+0000","last_undegraded":"2024-01-22T05:37:58.699091+0000","last_fullsized":"2024-01-22T05:37:58.699091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714275+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:37:58.714275+0000","last_peered":"2024-01-22T05:37:58.714275+0000","last_clean":"2024-01-22T05:37:58.714275+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:37:58.714275+0000","last_undegraded":"2024-01-22T05:37:58.714275+0000","last_fullsized":"2024-01-22T05:37:58.714275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704938+0000","last_change":"2024-01-22T05:37:58.256019+0000","last_active":"2024-01-22T05:37:58.704938+0000","last_peered":"2024-01-22T05:37:58.704938+0000","last_clean":"2024-01-22T05:37:58.704938+0000","last_became_active":"2024-01-22T05:37:58.255206+0000","last_became_peered":"2024-01-22T05:37:58.255206+0000","last_unstale":"2024-01-22T05:37:58.704938+0000","last_undegraded":"2024-01-22T05:37:58.704938+0000","last_fullsized":"2024-01-22T05:37:58.704938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716866+0000","last_change":"2024-01-22T05:37:58.715826+0000","last_active":"2024-01-22T05:37:58.716866+0000","last_peered":"2024-01-22T05:37:58.716866+0000","last_clean":"2024-01-22T05:37:58.716866+0000","last_became_active":"2024-01-22T05:37:58.715462+0000","last_became_peered":"2024-01-22T05:37:58.715462+0000","last_unstale":"2024-01-22T05:37:58.716866+0000","last_undegraded":"2024-01-22T05:37:58.716866+0000","last_fullsized":"2024-01-22T05:37:58.716866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718886+0000","last_change":"2024-01-22T05:37:58.248570+0000","last_active":"2024-01-22T05:37:58.718886+0000","last_peered":"2024-01-22T05:37:58.718886+0000","last_clean":"2024-01-22T05:37:58.718886+0000","last_became_active":"2024-01-22T05:37:58.248217+0000","last_became_peered":"2024-01-22T05:37:58.248217+0000","last_unstale":"2024-01-22T05:37:58.718886+0000","last_undegraded":"2024-01-22T05:37:58.718886+0000","last_fullsized":"2024-01-22T05:37:58.718886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703823+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:37:58.703823+0000","last_peered":"2024-01-22T05:37:58.703823+0000","last_clean":"2024-01-22T05:37:58.703823+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:37:58.703823+0000","last_undegraded":"2024-01-22T05:37:58.703823+0000","last_fullsized":"2024-01-22T05:37:58.703823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.721675+0000","last_change":"2024-01-22T05:37:58.714917+0000","last_active":"2024-01-22T05:37:58.721675+0000","last_peered":"2024-01-22T05:37:58.721675+0000","last_clean":"2024-01-22T05:37:58.721675+0000","last_became_active":"2024-01-22T05:37:58.714575+0000","last_became_peered":"2024-01-22T05:37:58.714575+0000","last_unstale":"2024-01-22T05:37:58.721675+0000","last_undegraded":"2024-01-22T05:37:58.721675+0000","last_fullsized":"2024-01-22T05:37:58.721675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707640+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:37:58.707640+0000","last_peered":"2024-01-22T05:37:58.707640+0000","last_clean":"2024-01-22T05:37:58.707640+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:37:58.707640+0000","last_undegraded":"2024-01-22T05:37:58.707640+0000","last_fullsized":"2024-01-22T05:37:58.707640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705408+0000","last_change":"2024-01-22T05:37:58.253114+0000","last_active":"2024-01-22T05:37:58.705408+0000","last_peered":"2024-01-22T05:37:58.705408+0000","last_clean":"2024-01-22T05:37:58.705408+0000","last_became_active":"2024-01-22T05:37:58.252823+0000","last_became_peered":"2024-01-22T05:37:58.252823+0000","last_unstale":"2024-01-22T05:37:58.705408+0000","last_undegraded":"2024-01-22T05:37:58.705408+0000","last_fullsized":"2024-01-22T05:37:58.705408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715774+0000","last_change":"2024-01-22T05:37:58.707388+0000","last_active":"2024-01-22T05:37:58.715774+0000","last_peered":"2024-01-22T05:37:58.715774+0000","last_clean":"2024-01-22T05:37:58.715774+0000","last_became_active":"2024-01-22T05:37:58.707099+0000","last_became_peered":"2024-01-22T05:37:58.707099+0000","last_unstale":"2024-01-22T05:37:58.715774+0000","last_undegraded":"2024-01-22T05:37:58.715774+0000","last_fullsized":"2024-01-22T05:37:58.715774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727511+0000","last_change":"2024-01-22T05:37:58.721226+0000","last_active":"2024-01-22T05:37:58.727511+0000","last_peered":"2024-01-22T05:37:58.727511+0000","last_clean":"2024-01-22T05:37:58.727511+0000","last_became_active":"2024-01-22T05:37:58.714690+0000","last_became_peered":"2024-01-22T05:37:58.714690+0000","last_unstale":"2024-01-22T05:37:58.727511+0000","last_undegraded":"2024-01-22T05:37:58.727511+0000","last_fullsized":"2024-01-22T05:37:58.727511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701838+0000","last_change":"2024-01-22T05:37:58.253254+0000","last_active":"2024-01-22T05:37:58.701838+0000","last_peered":"2024-01-22T05:37:58.701838+0000","last_clean":"2024-01-22T05:37:58.701838+0000","last_became_active":"2024-01-22T05:37:58.252839+0000","last_became_peered":"2024-01-22T05:37:58.252839+0000","last_unstale":"2024-01-22T05:37:58.701838+0000","last_undegraded":"2024-01-22T05:37:58.701838+0000","last_fullsized":"2024-01-22T05:37:58.701838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728419+0000","last_change":"2024-01-22T05:37:58.724996+0000","last_active":"2024-01-22T05:37:58.728419+0000","last_peered":"2024-01-22T05:37:58.728419+0000","last_clean":"2024-01-22T05:37:58.728419+0000","last_became_active":"2024-01-22T05:37:58.724730+0000","last_became_peered":"2024-01-22T05:37:58.724730+0000","last_unstale":"2024-01-22T05:37:58.728419+0000","last_undegraded":"2024-01-22T05:37:58.728419+0000","last_fullsized":"2024-01-22T05:37:58.728419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689345+0000","last_change":"2024-01-22T05:37:58.261431+0000","last_active":"2024-01-22T05:37:58.689345+0000","last_peered":"2024-01-22T05:37:58.689345+0000","last_clean":"2024-01-22T05:37:58.689345+0000","last_became_active":"2024-01-22T05:37:58.261120+0000","last_became_peered":"2024-01-22T05:37:58.261120+0000","last_unstale":"2024-01-22T05:37:58.689345+0000","last_undegraded":"2024-01-22T05:37:58.689345+0000","last_fullsized":"2024-01-22T05:37:58.689345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717402+0000","last_change":"2024-01-22T05:37:58.709933+0000","last_active":"2024-01-22T05:37:58.717402+0000","last_peered":"2024-01-22T05:37:58.717402+0000","last_clean":"2024-01-22T05:37:58.717402+0000","last_became_active":"2024-01-22T05:37:58.707398+0000","last_became_peered":"2024-01-22T05:37:58.707398+0000","last_unstale":"2024-01-22T05:37:58.717402+0000","last_undegraded":"2024-01-22T05:37:58.717402+0000","last_fullsized":"2024-01-22T05:37:58.717402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726249+0000","last_change":"2024-01-22T05:37:58.265006+0000","last_active":"2024-01-22T05:37:58.726249+0000","last_peered":"2024-01-22T05:37:58.726249+0000","last_clean":"2024-01-22T05:37:58.726249+0000","last_became_active":"2024-01-22T05:37:58.264513+0000","last_became_peered":"2024-01-22T05:37:58.264513+0000","last_unstale":"2024-01-22T05:37:58.726249+0000","last_undegraded":"2024-01-22T05:37:58.726249+0000","last_fullsized":"2024-01-22T05:37:58.726249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712679+0000","last_change":"2024-01-22T05:37:58.710477+0000","last_active":"2024-01-22T05:37:58.712679+0000","last_peered":"2024-01-22T05:37:58.712679+0000","last_clean":"2024-01-22T05:37:58.712679+0000","last_became_active":"2024-01-22T05:37:58.710170+0000","last_became_peered":"2024-01-22T05:37:58.710170+0000","last_unstale":"2024-01-22T05:37:58.712679+0000","last_undegraded":"2024-01-22T05:37:58.712679+0000","last_fullsized":"2024-01-22T05:37:58.712679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732630+0000","last_change":"2024-01-22T05:37:58.249092+0000","last_active":"2024-01-22T05:37:58.732630+0000","last_peered":"2024-01-22T05:37:58.732630+0000","last_clean":"2024-01-22T05:37:58.732630+0000","last_became_active":"2024-01-22T05:37:58.248749+0000","last_became_peered":"2024-01-22T05:37:58.248749+0000","last_unstale":"2024-01-22T05:37:58.732630+0000","last_undegraded":"2024-01-22T05:37:58.732630+0000","last_fullsized":"2024-01-22T05:37:58.732630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724703+0000","last_change":"2024-01-22T05:37:58.721462+0000","last_active":"2024-01-22T05:37:58.724703+0000","last_peered":"2024-01-22T05:37:58.724703+0000","last_clean":"2024-01-22T05:37:58.724703+0000","last_became_active":"2024-01-22T05:37:58.721192+0000","last_became_peered":"2024-01-22T05:37:58.721192+0000","last_unstale":"2024-01-22T05:37:58.724703+0000","last_undegraded":"2024-01-22T05:37:58.724703+0000","last_fullsized":"2024-01-22T05:37:58.724703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732649+0000","last_change":"2024-01-22T05:37:58.256074+0000","last_active":"2024-01-22T05:37:58.732649+0000","last_peered":"2024-01-22T05:37:58.732649+0000","last_clean":"2024-01-22T05:37:58.732649+0000","last_became_active":"2024-01-22T05:37:58.253919+0000","last_became_peered":"2024-01-22T05:37:58.253919+0000","last_unstale":"2024-01-22T05:37:58.732649+0000","last_undegraded":"2024-01-22T05:37:58.732649+0000","last_fullsized":"2024-01-22T05:37:58.732649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732648+0000","last_change":"2024-01-22T05:37:58.730288+0000","last_active":"2024-01-22T05:37:58.732648+0000","last_peered":"2024-01-22T05:37:58.732648+0000","last_clean":"2024-01-22T05:37:58.732648+0000","last_became_active":"2024-01-22T05:37:58.729963+0000","last_became_peered":"2024-01-22T05:37:58.729963+0000","last_unstale":"2024-01-22T05:37:58.732648+0000","last_undegraded":"2024-01-22T05:37:58.732648+0000","last_fullsized":"2024-01-22T05:37:58.732648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699383+0000","last_change":"2024-01-22T05:37:58.249681+0000","last_active":"2024-01-22T05:37:58.699383+0000","last_peered":"2024-01-22T05:37:58.699383+0000","last_clean":"2024-01-22T05:37:58.699383+0000","last_became_active":"2024-01-22T05:37:58.249359+0000","last_became_peered":"2024-01-22T05:37:58.249359+0000","last_unstale":"2024-01-22T05:37:58.699383+0000","last_undegraded":"2024-01-22T05:37:58.699383+0000","last_fullsized":"2024-01-22T05:37:58.699383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726458+0000","last_change":"2024-01-22T05:37:58.719997+0000","last_active":"2024-01-22T05:37:58.726458+0000","last_peered":"2024-01-22T05:37:58.726458+0000","last_clean":"2024-01-22T05:37:58.726458+0000","last_became_active":"2024-01-22T05:37:58.717231+0000","last_became_peered":"2024-01-22T05:37:58.717231+0000","last_unstale":"2024-01-22T05:37:58.726458+0000","last_undegraded":"2024-01-22T05:37:58.726458+0000","last_fullsized":"2024-01-22T05:37:58.726458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.695952+0000","last_change":"2024-01-22T05:37:58.257047+0000","last_active":"2024-01-22T05:37:58.695952+0000","last_peered":"2024-01-22T05:37:58.695952+0000","last_clean":"2024-01-22T05:37:58.695952+0000","last_became_active":"2024-01-22T05:37:58.256649+0000","last_became_peered":"2024-01-22T05:37:58.256649+0000","last_unstale":"2024-01-22T05:37:58.695952+0000","last_undegraded":"2024-01-22T05:37:58.695952+0000","last_fullsized":"2024-01-22T05:37:58.695952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730507+0000","last_change":"2024-01-22T05:37:58.726471+0000","last_active":"2024-01-22T05:37:58.730507+0000","last_peered":"2024-01-22T05:37:58.730507+0000","last_clean":"2024-01-22T05:37:58.730507+0000","last_became_active":"2024-01-22T05:37:58.725949+0000","last_became_peered":"2024-01-22T05:37:58.725949+0000","last_unstale":"2024-01-22T05:37:58.730507+0000","last_undegraded":"2024-01-22T05:37:58.730507+0000","last_fullsized":"2024-01-22T05:37:58.730507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.708157+0000","last_change":"2024-01-22T05:37:58.263577+0000","last_active":"2024-01-22T05:37:58.708157+0000","last_peered":"2024-01-22T05:37:58.708157+0000","last_clean":"2024-01-22T05:37:58.708157+0000","last_became_active":"2024-01-22T05:37:58.263204+0000","last_became_peered":"2024-01-22T05:37:58.263204+0000","last_unstale":"2024-01-22T05:37:58.708157+0000","last_undegraded":"2024-01-22T05:37:58.708157+0000","last_fullsized":"2024-01-22T05:37:58.708157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724177+0000","last_change":"2024-01-22T05:37:58.717817+0000","last_active":"2024-01-22T05:37:58.724177+0000","last_peered":"2024-01-22T05:37:58.724177+0000","last_clean":"2024-01-22T05:37:58.724177+0000","last_became_active":"2024-01-22T05:37:58.717540+0000","last_became_peered":"2024-01-22T05:37:58.717540+0000","last_unstale":"2024-01-22T05:37:58.724177+0000","last_undegraded":"2024-01-22T05:37:58.724177+0000","last_fullsized":"2024-01-22T05:37:58.724177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699042+0000","last_change":"2024-01-22T05:37:58.253690+0000","last_active":"2024-01-22T05:37:58.699042+0000","last_peered":"2024-01-22T05:37:58.699042+0000","last_clean":"2024-01-22T05:37:58.699042+0000","last_became_active":"2024-01-22T05:37:58.253367+0000","last_became_peered":"2024-01-22T05:37:58.253367+0000","last_unstale":"2024-01-22T05:37:58.699042+0000","last_undegraded":"2024-01-22T05:37:58.699042+0000","last_fullsized":"2024-01-22T05:37:58.699042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723711+0000","last_change":"2024-01-22T05:37:58.709446+0000","last_active":"2024-01-22T05:37:58.723711+0000","last_peered":"2024-01-22T05:37:58.723711+0000","last_clean":"2024-01-22T05:37:58.723711+0000","last_became_active":"2024-01-22T05:37:58.709099+0000","last_became_peered":"2024-01-22T05:37:58.709099+0000","last_unstale":"2024-01-22T05:37:58.723711+0000","last_undegraded":"2024-01-22T05:37:58.723711+0000","last_fullsized":"2024-01-22T05:37:58.723711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704828+0000","last_change":"2024-01-22T05:37:58.260823+0000","last_active":"2024-01-22T05:37:58.704828+0000","last_peered":"2024-01-22T05:37:58.704828+0000","last_clean":"2024-01-22T05:37:58.704828+0000","last_became_active":"2024-01-22T05:37:58.260527+0000","last_became_peered":"2024-01-22T05:37:58.260527+0000","last_unstale":"2024-01-22T05:37:58.704828+0000","last_undegraded":"2024-01-22T05:37:58.704828+0000","last_fullsized":"2024-01-22T05:37:58.704828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712095+0000","last_change":"2024-01-22T05:37:58.706792+0000","last_active":"2024-01-22T05:37:58.712095+0000","last_peered":"2024-01-22T05:37:58.712095+0000","last_clean":"2024-01-22T05:37:58.712095+0000","last_became_active":"2024-01-22T05:37:58.706496+0000","last_became_peered":"2024-01-22T05:37:58.706496+0000","last_unstale":"2024-01-22T05:37:58.712095+0000","last_undegraded":"2024-01-22T05:37:58.712095+0000","last_fullsized":"2024-01-22T05:37:58.712095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704962+0000","last_change":"2024-01-22T05:37:58.258446+0000","last_active":"2024-01-22T05:37:58.704962+0000","last_peered":"2024-01-22T05:37:58.704962+0000","last_clean":"2024-01-22T05:37:58.704962+0000","last_became_active":"2024-01-22T05:37:58.258012+0000","last_became_peered":"2024-01-22T05:37:58.258012+0000","last_unstale":"2024-01-22T05:37:58.704962+0000","last_undegraded":"2024-01-22T05:37:58.704962+0000","last_fullsized":"2024-01-22T05:37:58.704962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732126+0000","last_change":"2024-01-22T05:37:58.726698+0000","last_active":"2024-01-22T05:37:58.732126+0000","last_peered":"2024-01-22T05:37:58.732126+0000","last_clean":"2024-01-22T05:37:58.732126+0000","last_became_active":"2024-01-22T05:37:58.725892+0000","last_became_peered":"2024-01-22T05:37:58.725892+0000","last_unstale":"2024-01-22T05:37:58.732126+0000","last_undegraded":"2024-01-22T05:37:58.732126+0000","last_fullsized":"2024-01-22T05:37:58.732126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-22T05:37:59.701436+0000","last_change":"2024-01-22T05:37:58.264437+0000","last_active":"2024-01-22T05:37:59.701436+0000","last_peered":"2024-01-22T05:37:59.701436+0000","last_clean":"2024-01-22T05:37:59.701436+0000","last_became_active":"2024-01-22T05:37:58.263796+0000","last_became_peered":"2024-01-22T05:37:58.263796+0000","last_unstale":"2024-01-22T05:37:59.701436+0000","last_undegraded":"2024-01-22T05:37:59.701436+0000","last_fullsized":"2024-01-22T05:37:59.701436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.720620+0000","last_change":"2024-01-22T05:37:58.714745+0000","last_active":"2024-01-22T05:37:58.720620+0000","last_peered":"2024-01-22T05:37:58.720620+0000","last_clean":"2024-01-22T05:37:58.720620+0000","last_became_active":"2024-01-22T05:37:58.714462+0000","last_became_peered":"2024-01-22T05:37:58.714462+0000","last_unstale":"2024-01-22T05:37:58.720620+0000","last_undegraded":"2024-01-22T05:37:58.720620+0000","last_fullsized":"2024-01-22T05:37:58.720620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702263+0000","last_change":"2024-01-22T05:37:58.255003+0000","last_active":"2024-01-22T05:37:58.702263+0000","last_peered":"2024-01-22T05:37:58.702263+0000","last_clean":"2024-01-22T05:37:58.702263+0000","last_became_active":"2024-01-22T05:37:58.253856+0000","last_became_peered":"2024-01-22T05:37:58.253856+0000","last_unstale":"2024-01-22T05:37:58.702263+0000","last_undegraded":"2024-01-22T05:37:58.702263+0000","last_fullsized":"2024-01-22T05:37:58.702263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722299+0000","last_change":"2024-01-22T05:37:58.718905+0000","last_active":"2024-01-22T05:37:58.722299+0000","last_peered":"2024-01-22T05:37:58.722299+0000","last_clean":"2024-01-22T05:37:58.722299+0000","last_became_active":"2024-01-22T05:37:58.717276+0000","last_became_peered":"2024-01-22T05:37:58.717276+0000","last_unstale":"2024-01-22T05:37:58.722299+0000","last_undegraded":"2024-01-22T05:37:58.722299+0000","last_fullsized":"2024-01-22T05:37:58.722299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.706505+0000","last_change":"2024-01-22T05:37:58.265209+0000","last_active":"2024-01-22T05:37:58.706505+0000","last_peered":"2024-01-22T05:37:58.706505+0000","last_clean":"2024-01-22T05:37:58.706505+0000","last_became_active":"2024-01-22T05:37:58.264930+0000","last_became_peered":"2024-01-22T05:37:58.264930+0000","last_unstale":"2024-01-22T05:37:58.706505+0000","last_undegraded":"2024-01-22T05:37:58.706505+0000","last_fullsized":"2024-01-22T05:37:58.706505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712277+0000","last_change":"2024-01-22T05:37:58.706093+0000","last_active":"2024-01-22T05:37:58.712277+0000","last_peered":"2024-01-22T05:37:58.712277+0000","last_clean":"2024-01-22T05:37:58.712277+0000","last_became_active":"2024-01-22T05:37:58.705804+0000","last_became_peered":"2024-01-22T05:37:58.705804+0000","last_unstale":"2024-01-22T05:37:58.712277+0000","last_undegraded":"2024-01-22T05:37:58.712277+0000","last_fullsized":"2024-01-22T05:37:58.712277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696681+0000","last_change":"2024-01-22T05:37:58.249283+0000","last_active":"2024-01-22T05:37:58.696681+0000","last_peered":"2024-01-22T05:37:58.696681+0000","last_clean":"2024-01-22T05:37:58.696681+0000","last_became_active":"2024-01-22T05:37:58.248923+0000","last_became_peered":"2024-01-22T05:37:58.248923+0000","last_unstale":"2024-01-22T05:37:58.696681+0000","last_undegraded":"2024-01-22T05:37:58.696681+0000","last_fullsized":"2024-01-22T05:37:58.696681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729793+0000","last_change":"2024-01-22T05:37:58.724869+0000","last_active":"2024-01-22T05:37:58.729793+0000","last_peered":"2024-01-22T05:37:58.729793+0000","last_clean":"2024-01-22T05:37:58.729793+0000","last_became_active":"2024-01-22T05:37:58.724551+0000","last_became_peered":"2024-01-22T05:37:58.724551+0000","last_unstale":"2024-01-22T05:37:58.729793+0000","last_undegraded":"2024-01-22T05:37:58.729793+0000","last_fullsized":"2024-01-22T05:37:58.729793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689553+0000","last_change":"2024-01-22T05:37:58.256442+0000","last_active":"2024-01-22T05:37:58.689553+0000","last_peered":"2024-01-22T05:37:58.689553+0000","last_clean":"2024-01-22T05:37:58.689553+0000","last_became_active":"2024-01-22T05:37:58.256136+0000","last_became_peered":"2024-01-22T05:37:58.256136+0000","last_unstale":"2024-01-22T05:37:58.689553+0000","last_undegraded":"2024-01-22T05:37:58.689553+0000","last_fullsized":"2024-01-22T05:37:58.689553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717228+0000","last_change":"2024-01-22T05:37:58.711074+0000","last_active":"2024-01-22T05:37:58.717228+0000","last_peered":"2024-01-22T05:37:58.717228+0000","last_clean":"2024-01-22T05:37:58.717228+0000","last_became_active":"2024-01-22T05:37:58.710803+0000","last_became_peered":"2024-01-22T05:37:58.710803+0000","last_unstale":"2024-01-22T05:37:58.717228+0000","last_undegraded":"2024-01-22T05:37:58.717228+0000","last_fullsized":"2024-01-22T05:37:58.717228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.720058+0000","last_change":"2024-01-22T05:37:58.252113+0000","last_active":"2024-01-22T05:37:58.720058+0000","last_peered":"2024-01-22T05:37:58.720058+0000","last_clean":"2024-01-22T05:37:58.720058+0000","last_became_active":"2024-01-22T05:37:58.251258+0000","last_became_peered":"2024-01-22T05:37:58.251258+0000","last_unstale":"2024-01-22T05:37:58.720058+0000","last_undegraded":"2024-01-22T05:37:58.720058+0000","last_fullsized":"2024-01-22T05:37:58.720058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.721993+0000","last_change":"2024-01-22T05:37:58.716869+0000","last_active":"2024-01-22T05:37:58.721993+0000","last_peered":"2024-01-22T05:37:58.721993+0000","last_clean":"2024-01-22T05:37:58.721993+0000","last_became_active":"2024-01-22T05:37:58.716086+0000","last_became_peered":"2024-01-22T05:37:58.716086+0000","last_unstale":"2024-01-22T05:37:58.721993+0000","last_undegraded":"2024-01-22T05:37:58.721993+0000","last_fullsized":"2024-01-22T05:37:58.721993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697140+0000","last_change":"2024-01-22T05:37:58.254343+0000","last_active":"2024-01-22T05:37:58.697140+0000","last_peered":"2024-01-22T05:37:58.697140+0000","last_clean":"2024-01-22T05:37:58.697140+0000","last_became_active":"2024-01-22T05:37:58.247951+0000","last_became_peered":"2024-01-22T05:37:58.247951+0000","last_unstale":"2024-01-22T05:37:58.697140+0000","last_undegraded":"2024-01-22T05:37:58.697140+0000","last_fullsized":"2024-01-22T05:37:58.697140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712952+0000","last_change":"2024-01-22T05:37:58.711776+0000","last_active":"2024-01-22T05:37:58.712952+0000","last_peered":"2024-01-22T05:37:58.712952+0000","last_clean":"2024-01-22T05:37:58.712952+0000","last_became_active":"2024-01-22T05:37:58.711428+0000","last_became_peered":"2024-01-22T05:37:58.711428+0000","last_unstale":"2024-01-22T05:37:58.712952+0000","last_undegraded":"2024-01-22T05:37:58.712952+0000","last_fullsized":"2024-01-22T05:37:58.712952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729786+0000","last_change":"2024-01-22T05:37:58.264800+0000","last_active":"2024-01-22T05:37:58.729786+0000","last_peered":"2024-01-22T05:37:58.729786+0000","last_clean":"2024-01-22T05:37:58.729786+0000","last_became_active":"2024-01-22T05:37:58.264190+0000","last_became_peered":"2024-01-22T05:37:58.264190+0000","last_unstale":"2024-01-22T05:37:58.729786+0000","last_undegraded":"2024-01-22T05:37:58.729786+0000","last_fullsized":"2024-01-22T05:37:58.729786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732096+0000","last_change":"2024-01-22T05:37:58.724990+0000","last_active":"2024-01-22T05:37:58.732096+0000","last_peered":"2024-01-22T05:37:58.732096+0000","last_clean":"2024-01-22T05:37:58.732096+0000","last_became_active":"2024-01-22T05:37:58.724687+0000","last_became_peered":"2024-01-22T05:37:58.724687+0000","last_unstale":"2024-01-22T05:37:58.732096+0000","last_undegraded":"2024-01-22T05:37:58.732096+0000","last_fullsized":"2024-01-22T05:37:58.732096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696561+0000","last_change":"2024-01-22T05:37:58.257083+0000","last_active":"2024-01-22T05:37:58.696561+0000","last_peered":"2024-01-22T05:37:58.696561+0000","last_clean":"2024-01-22T05:37:58.696561+0000","last_became_active":"2024-01-22T05:37:58.256792+0000","last_became_peered":"2024-01-22T05:37:58.256792+0000","last_unstale":"2024-01-22T05:37:58.696561+0000","last_undegraded":"2024-01-22T05:37:58.696561+0000","last_fullsized":"2024-01-22T05:37:58.696561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727963+0000","last_change":"2024-01-22T05:37:58.724961+0000","last_active":"2024-01-22T05:37:58.727963+0000","last_peered":"2024-01-22T05:37:58.727963+0000","last_clean":"2024-01-22T05:37:58.727963+0000","last_became_active":"2024-01-22T05:37:58.724672+0000","last_became_peered":"2024-01-22T05:37:58.724672+0000","last_unstale":"2024-01-22T05:37:58.727963+0000","last_undegraded":"2024-01-22T05:37:58.727963+0000","last_fullsized":"2024-01-22T05:37:58.727963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707872+0000","last_change":"2024-01-22T05:37:58.263297+0000","last_active":"2024-01-22T05:37:58.707872+0000","last_peered":"2024-01-22T05:37:58.707872+0000","last_clean":"2024-01-22T05:37:58.707872+0000","last_became_active":"2024-01-22T05:37:58.262968+0000","last_became_peered":"2024-01-22T05:37:58.262968+0000","last_unstale":"2024-01-22T05:37:58.707872+0000","last_undegraded":"2024-01-22T05:37:58.707872+0000","last_fullsized":"2024-01-22T05:37:58.707872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732629+0000","last_change":"2024-01-22T05:37:58.729257+0000","last_active":"2024-01-22T05:37:58.732629+0000","last_peered":"2024-01-22T05:37:58.732629+0000","last_clean":"2024-01-22T05:37:58.732629+0000","last_became_active":"2024-01-22T05:37:58.728921+0000","last_became_peered":"2024-01-22T05:37:58.728921+0000","last_unstale":"2024-01-22T05:37:58.732629+0000","last_undegraded":"2024-01-22T05:37:58.732629+0000","last_fullsized":"2024-01-22T05:37:58.732629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729477+0000","last_change":"2024-01-22T05:37:58.251278+0000","last_active":"2024-01-22T05:37:58.729477+0000","last_peered":"2024-01-22T05:37:58.729477+0000","last_clean":"2024-01-22T05:37:58.729477+0000","last_became_active":"2024-01-22T05:37:58.251091+0000","last_became_peered":"2024-01-22T05:37:58.251091+0000","last_unstale":"2024-01-22T05:37:58.729477+0000","last_undegraded":"2024-01-22T05:37:58.729477+0000","last_fullsized":"2024-01-22T05:37:58.729477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709214+0000","last_change":"2024-01-22T05:37:58.705340+0000","last_active":"2024-01-22T05:37:58.709214+0000","last_peered":"2024-01-22T05:37:58.709214+0000","last_clean":"2024-01-22T05:37:58.709214+0000","last_became_active":"2024-01-22T05:37:58.703766+0000","last_became_peered":"2024-01-22T05:37:58.703766+0000","last_unstale":"2024-01-22T05:37:58.709214+0000","last_undegraded":"2024-01-22T05:37:58.709214+0000","last_fullsized":"2024-01-22T05:37:58.709214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696495+0000","last_change":"2024-01-22T05:37:58.254002+0000","last_active":"2024-01-22T05:37:58.696495+0000","last_peered":"2024-01-22T05:37:58.696495+0000","last_clean":"2024-01-22T05:37:58.696495+0000","last_became_active":"2024-01-22T05:37:58.253662+0000","last_became_peered":"2024-01-22T05:37:58.253662+0000","last_unstale":"2024-01-22T05:37:58.696495+0000","last_undegraded":"2024-01-22T05:37:58.696495+0000","last_fullsized":"2024-01-22T05:37:58.696495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709220+0000","last_change":"2024-01-22T05:37:58.704985+0000","last_active":"2024-01-22T05:37:58.709220+0000","last_peered":"2024-01-22T05:37:58.709220+0000","last_clean":"2024-01-22T05:37:58.709220+0000","last_became_active":"2024-01-22T05:37:58.704622+0000","last_became_peered":"2024-01-22T05:37:58.704622+0000","last_unstale":"2024-01-22T05:37:58.709220+0000","last_undegraded":"2024-01-22T05:37:58.709220+0000","last_fullsized":"2024-01-22T05:37:58.709220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700540+0000","last_change":"2024-01-22T05:37:58.255249+0000","last_active":"2024-01-22T05:37:58.700540+0000","last_peered":"2024-01-22T05:37:58.700540+0000","last_clean":"2024-01-22T05:37:58.700540+0000","last_became_active":"2024-01-22T05:37:58.254043+0000","last_became_peered":"2024-01-22T05:37:58.254043+0000","last_unstale":"2024-01-22T05:37:58.700540+0000","last_undegraded":"2024-01-22T05:37:58.700540+0000","last_fullsized":"2024-01-22T05:37:58.700540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727550+0000","last_change":"2024-01-22T05:37:58.721667+0000","last_active":"2024-01-22T05:37:58.727550+0000","last_peered":"2024-01-22T05:37:58.727550+0000","last_clean":"2024-01-22T05:37:58.727550+0000","last_became_active":"2024-01-22T05:37:58.720955+0000","last_became_peered":"2024-01-22T05:37:58.720955+0000","last_unstale":"2024-01-22T05:37:58.727550+0000","last_undegraded":"2024-01-22T05:37:58.727550+0000","last_fullsized":"2024-01-22T05:37:58.727550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719022+0000","last_change":"2024-01-22T05:37:58.257358+0000","last_active":"2024-01-22T05:37:58.719022+0000","last_peered":"2024-01-22T05:37:58.719022+0000","last_clean":"2024-01-22T05:37:58.719022+0000","last_became_active":"2024-01-22T05:37:58.256833+0000","last_became_peered":"2024-01-22T05:37:58.256833+0000","last_unstale":"2024-01-22T05:37:58.719022+0000","last_undegraded":"2024-01-22T05:37:58.719022+0000","last_fullsized":"2024-01-22T05:37:58.719022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729529+0000","last_change":"2024-01-22T05:37:58.724890+0000","last_active":"2024-01-22T05:37:58.729529+0000","last_peered":"2024-01-22T05:37:58.729529+0000","last_clean":"2024-01-22T05:37:58.729529+0000","last_became_active":"2024-01-22T05:37:58.724468+0000","last_became_peered":"2024-01-22T05:37:58.724468+0000","last_unstale":"2024-01-22T05:37:58.729529+0000","last_undegraded":"2024-01-22T05:37:58.729529+0000","last_fullsized":"2024-01-22T05:37:58.729529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729961+0000","last_change":"2024-01-22T05:37:58.260261+0000","last_active":"2024-01-22T05:37:58.729961+0000","last_peered":"2024-01-22T05:37:58.729961+0000","last_clean":"2024-01-22T05:37:58.729961+0000","last_became_active":"2024-01-22T05:37:58.259704+0000","last_became_peered":"2024-01-22T05:37:58.259704+0000","last_unstale":"2024-01-22T05:37:58.729961+0000","last_undegraded":"2024-01-22T05:37:58.729961+0000","last_fullsized":"2024-01-22T05:37:58.729961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728107+0000","last_change":"2024-01-22T05:37:58.726130+0000","last_active":"2024-01-22T05:37:58.728107+0000","last_peered":"2024-01-22T05:37:58.728107+0000","last_clean":"2024-01-22T05:37:58.728107+0000","last_became_active":"2024-01-22T05:37:58.725859+0000","last_became_peered":"2024-01-22T05:37:58.725859+0000","last_unstale":"2024-01-22T05:37:58.728107+0000","last_undegraded":"2024-01-22T05:37:58.728107+0000","last_fullsized":"2024-01-22T05:37:58.728107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697755+0000","last_change":"2024-01-22T05:37:58.264803+0000","last_active":"2024-01-22T05:37:58.697755+0000","last_peered":"2024-01-22T05:37:58.697755+0000","last_clean":"2024-01-22T05:37:58.697755+0000","last_became_active":"2024-01-22T05:37:58.264462+0000","last_became_peered":"2024-01-22T05:37:58.264462+0000","last_unstale":"2024-01-22T05:37:58.697755+0000","last_undegraded":"2024-01-22T05:37:58.697755+0000","last_fullsized":"2024-01-22T05:37:58.697755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724696+0000","last_change":"2024-01-22T05:37:58.712538+0000","last_active":"2024-01-22T05:37:58.724696+0000","last_peered":"2024-01-22T05:37:58.724696+0000","last_clean":"2024-01-22T05:37:58.724696+0000","last_became_active":"2024-01-22T05:37:58.712227+0000","last_became_peered":"2024-01-22T05:37:58.712227+0000","last_unstale":"2024-01-22T05:37:58.724696+0000","last_undegraded":"2024-01-22T05:37:58.724696+0000","last_fullsized":"2024-01-22T05:37:58.724696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700878+0000","last_change":"2024-01-22T05:37:58.250185+0000","last_active":"2024-01-22T05:37:58.700878+0000","last_peered":"2024-01-22T05:37:58.700878+0000","last_clean":"2024-01-22T05:37:58.700878+0000","last_became_active":"2024-01-22T05:37:58.249870+0000","last_became_peered":"2024-01-22T05:37:58.249870+0000","last_unstale":"2024-01-22T05:37:58.700878+0000","last_undegraded":"2024-01-22T05:37:58.700878+0000","last_fullsized":"2024-01-22T05:37:58.700878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719474+0000","last_change":"2024-01-22T05:37:58.708704+0000","last_active":"2024-01-22T05:37:58.719474+0000","last_peered":"2024-01-22T05:37:58.719474+0000","last_clean":"2024-01-22T05:37:58.719474+0000","last_became_active":"2024-01-22T05:37:58.708449+0000","last_became_peered":"2024-01-22T05:37:58.708449+0000","last_unstale":"2024-01-22T05:37:58.719474+0000","last_undegraded":"2024-01-22T05:37:58.719474+0000","last_fullsized":"2024-01-22T05:37:58.719474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.690119+0000","last_change":"2024-01-22T05:37:58.246767+0000","last_active":"2024-01-22T05:37:58.690119+0000","last_peered":"2024-01-22T05:37:58.690119+0000","last_clean":"2024-01-22T05:37:58.690119+0000","last_became_active":"2024-01-22T05:37:58.245978+0000","last_became_peered":"2024-01-22T05:37:58.245978+0000","last_unstale":"2024-01-22T05:37:58.690119+0000","last_undegraded":"2024-01-22T05:37:58.690119+0000","last_fullsized":"2024-01-22T05:37:58.690119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727646+0000","last_change":"2024-01-22T05:37:58.721568+0000","last_active":"2024-01-22T05:37:58.727646+0000","last_peered":"2024-01-22T05:37:58.727646+0000","last_clean":"2024-01-22T05:37:58.727646+0000","last_became_active":"2024-01-22T05:37:58.720320+0000","last_became_peered":"2024-01-22T05:37:58.720320+0000","last_unstale":"2024-01-22T05:37:58.727646+0000","last_undegraded":"2024-01-22T05:37:58.727646+0000","last_fullsized":"2024-01-22T05:37:58.727646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702410+0000","last_change":"2024-01-22T05:37:58.254018+0000","last_active":"2024-01-22T05:37:58.702410+0000","last_peered":"2024-01-22T05:37:58.702410+0000","last_clean":"2024-01-22T05:37:58.702410+0000","last_became_active":"2024-01-22T05:37:58.253663+0000","last_became_peered":"2024-01-22T05:37:58.253663+0000","last_unstale":"2024-01-22T05:37:58.702410+0000","last_undegraded":"2024-01-22T05:37:58.702410+0000","last_fullsized":"2024-01-22T05:37:58.702410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727129+0000","last_change":"2024-01-22T05:37:58.722202+0000","last_active":"2024-01-22T05:37:58.727129+0000","last_peered":"2024-01-22T05:37:58.727129+0000","last_clean":"2024-01-22T05:37:58.727129+0000","last_became_active":"2024-01-22T05:37:58.721929+0000","last_became_peered":"2024-01-22T05:37:58.721929+0000","last_unstale":"2024-01-22T05:37:58.727129+0000","last_undegraded":"2024-01-22T05:37:58.727129+0000","last_fullsized":"2024-01-22T05:37:58.727129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696216+0000","last_change":"2024-01-22T05:37:58.249353+0000","last_active":"2024-01-22T05:37:58.696216+0000","last_peered":"2024-01-22T05:37:58.696216+0000","last_clean":"2024-01-22T05:37:58.696216+0000","last_became_active":"2024-01-22T05:37:58.247936+0000","last_became_peered":"2024-01-22T05:37:58.247936+0000","last_unstale":"2024-01-22T05:37:58.696216+0000","last_undegraded":"2024-01-22T05:37:58.696216+0000","last_fullsized":"2024-01-22T05:37:58.696216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729390+0000","last_change":"2024-01-22T05:37:58.725363+0000","last_active":"2024-01-22T05:37:58.729390+0000","last_peered":"2024-01-22T05:37:58.729390+0000","last_clean":"2024-01-22T05:37:58.729390+0000","last_became_active":"2024-01-22T05:37:58.725165+0000","last_became_peered":"2024-01-22T05:37:58.725165+0000","last_unstale":"2024-01-22T05:37:58.729390+0000","last_undegraded":"2024-01-22T05:37:58.729390+0000","last_fullsized":"2024-01-22T05:37:58.729390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714350+0000","last_change":"2024-01-22T05:37:58.259249+0000","last_active":"2024-01-22T05:37:58.714350+0000","last_peered":"2024-01-22T05:37:58.714350+0000","last_clean":"2024-01-22T05:37:58.714350+0000","last_became_active":"2024-01-22T05:37:58.258966+0000","last_became_peered":"2024-01-22T05:37:58.258966+0000","last_unstale":"2024-01-22T05:37:58.714350+0000","last_undegraded":"2024-01-22T05:37:58.714350+0000","last_fullsized":"2024-01-22T05:37:58.714350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718454+0000","last_change":"2024-01-22T05:37:58.706730+0000","last_active":"2024-01-22T05:37:58.718454+0000","last_peered":"2024-01-22T05:37:58.718454+0000","last_clean":"2024-01-22T05:37:58.718454+0000","last_became_active":"2024-01-22T05:37:58.706540+0000","last_became_peered":"2024-01-22T05:37:58.706540+0000","last_unstale":"2024-01-22T05:37:58.718454+0000","last_undegraded":"2024-01-22T05:37:58.718454+0000","last_fullsized":"2024-01-22T05:37:58.718454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723490+0000","last_change":"2024-01-22T05:37:58.260703+0000","last_active":"2024-01-22T05:37:58.723490+0000","last_peered":"2024-01-22T05:37:58.723490+0000","last_clean":"2024-01-22T05:37:58.723490+0000","last_became_active":"2024-01-22T05:37:58.255191+0000","last_became_peered":"2024-01-22T05:37:58.255191+0000","last_unstale":"2024-01-22T05:37:58.723490+0000","last_undegraded":"2024-01-22T05:37:58.723490+0000","last_fullsized":"2024-01-22T05:37:58.723490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727300+0000","last_change":"2024-01-22T05:37:58.720676+0000","last_active":"2024-01-22T05:37:58.727300+0000","last_peered":"2024-01-22T05:37:58.727300+0000","last_clean":"2024-01-22T05:37:58.727300+0000","last_became_active":"2024-01-22T05:37:58.720340+0000","last_became_peered":"2024-01-22T05:37:58.720340+0000","last_unstale":"2024-01-22T05:37:58.727300+0000","last_undegraded":"2024-01-22T05:37:58.727300+0000","last_fullsized":"2024-01-22T05:37:58.727300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724060+0000","last_change":"2024-01-22T05:37:58.252332+0000","last_active":"2024-01-22T05:37:58.724060+0000","last_peered":"2024-01-22T05:37:58.724060+0000","last_clean":"2024-01-22T05:37:58.724060+0000","last_became_active":"2024-01-22T05:37:58.251974+0000","last_became_peered":"2024-01-22T05:37:58.251974+0000","last_unstale":"2024-01-22T05:37:58.724060+0000","last_undegraded":"2024-01-22T05:37:58.724060+0000","last_fullsized":"2024-01-22T05:37:58.724060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722376+0000","last_change":"2024-01-22T05:37:58.710217+0000","last_active":"2024-01-22T05:37:58.722376+0000","last_peered":"2024-01-22T05:37:58.722376+0000","last_clean":"2024-01-22T05:37:58.722376+0000","last_became_active":"2024-01-22T05:37:58.708965+0000","last_became_peered":"2024-01-22T05:37:58.708965+0000","last_unstale":"2024-01-22T05:37:58.722376+0000","last_undegraded":"2024-01-22T05:37:58.722376+0000","last_fullsized":"2024-01-22T05:37:58.722376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.710339+0000","last_change":"2024-01-22T05:37:58.251023+0000","last_active":"2024-01-22T05:37:58.710339+0000","last_peered":"2024-01-22T05:37:58.710339+0000","last_clean":"2024-01-22T05:37:58.710339+0000","last_became_active":"2024-01-22T05:37:58.250678+0000","last_became_peered":"2024-01-22T05:37:58.250678+0000","last_unstale":"2024-01-22T05:37:58.710339+0000","last_undegraded":"2024-01-22T05:37:58.710339+0000","last_fullsized":"2024-01-22T05:37:58.710339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723126+0000","last_change":"2024-01-22T05:37:58.710302+0000","last_active":"2024-01-22T05:37:58.723126+0000","last_peered":"2024-01-22T05:37:58.723126+0000","last_clean":"2024-01-22T05:37:58.723126+0000","last_became_active":"2024-01-22T05:37:58.709580+0000","last_became_peered":"2024-01-22T05:37:58.709580+0000","last_unstale":"2024-01-22T05:37:58.723126+0000","last_undegraded":"2024-01-22T05:37:58.723126+0000","last_fullsized":"2024-01-22T05:37:58.723126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709432+0000","last_change":"2024-01-22T05:37:58.251159+0000","last_active":"2024-01-22T05:37:58.709432+0000","last_peered":"2024-01-22T05:37:58.709432+0000","last_clean":"2024-01-22T05:37:58.709432+0000","last_became_active":"2024-01-22T05:37:58.250824+0000","last_became_peered":"2024-01-22T05:37:58.250824+0000","last_unstale":"2024-01-22T05:37:58.709432+0000","last_undegraded":"2024-01-22T05:37:58.709432+0000","last_fullsized":"2024-01-22T05:37:58.709432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705513+0000","last_change":"2024-01-22T05:37:58.698080+0000","last_active":"2024-01-22T05:37:58.705513+0000","last_peered":"2024-01-22T05:37:58.705513+0000","last_clean":"2024-01-22T05:37:58.705513+0000","last_became_active":"2024-01-22T05:37:58.697818+0000","last_became_peered":"2024-01-22T05:37:58.697818+0000","last_unstale":"2024-01-22T05:37:58.705513+0000","last_undegraded":"2024-01-22T05:37:58.705513+0000","last_fullsized":"2024-01-22T05:37:58.705513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724005+0000","last_change":"2024-01-22T05:37:58.264651+0000","last_active":"2024-01-22T05:37:58.724005+0000","last_peered":"2024-01-22T05:37:58.724005+0000","last_clean":"2024-01-22T05:37:58.724005+0000","last_became_active":"2024-01-22T05:37:58.264021+0000","last_became_peered":"2024-01-22T05:37:58.264021+0000","last_unstale":"2024-01-22T05:37:58.724005+0000","last_undegraded":"2024-01-22T05:37:58.724005+0000","last_fullsized":"2024-01-22T05:37:58.724005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":84071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":83801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:38:11.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:38:11.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.597+0000 7f0124a00700 1 Processor -- start 2024-01-22T05:38:11.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.597+0000 7f0124a00700 1 -- start start 2024-01-22T05:38:11.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.598+0000 7f0124a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c0c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.598+0000 7f0124a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f011c0a7c90 0x7f011c0639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.598+0000 7f0124a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011c0c5d20 con 0x7f011c098920 2024-01-22T05:38:11.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.598+0000 7f0124a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011c0c57a0 con 0x7f011c0a7c90 2024-01-22T05:38:11.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.598+0000 7f0124a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c0c16c0 con 0x7f011c153fb0 2024-01-22T05:38:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0121600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f011c0a7c90 0x7f011c0639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0122000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c0c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0121600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f011c0a7c90 0x7f011c0639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:38140/0 (socket says 172.21.15.100:38140) 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0122a00700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f011c098920 0x7f011c0c61b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:53670/0 (socket says 172.21.15.100:53670) 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0121600700 1 -- 172.21.15.100:0/1548996915 learned_addr learned my addr 172.21.15.100:0/1548996915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0120c00700 1 -- 172.21.15.100:0/1548996915 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193114740 0 0) 0x7f011c0c5d20 con 0x7f011c098920 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0120c00700 1 -- 172.21.15.100:0/1548996915 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00fc0033f0 con 0x7f011c098920 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0122000700 1 -- 172.21.15.100:0/1548996915 >> v2:172.21.15.169:3300/0 conn(0x7f011c0a7c90 msgr2=0x7f011c0639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0122000700 1 --2- 172.21.15.100:0/1548996915 >> v2:172.21.15.169:3300/0 conn(0x7f011c0a7c90 0x7f011c0639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0122000700 1 -- 172.21.15.100:0/1548996915 >> v1:172.21.15.169:6789/0 conn(0x7f011c098920 legacy=0x7f011c0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0122000700 1 -- 172.21.15.100:0/1548996915 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0c19a0 con 0x7f011c153fb0 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.599+0000 7f0121600700 1 --2- 172.21.15.100:0/1548996915 >> v2:172.21.15.169:3300/0 conn(0x7f011c0a7c90 0x7f011c0639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0122000700 1 --2- 172.21.15.100:0/1548996915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c0c0e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f010c009760 tx=0x7f010c009060).ready entity=mon.2 client_cookie=244434086257cacf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0120c00700 1 -- 172.21.15.100:0/1548996915 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00d4a0 con 0x7f011c153fb0 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0120c00700 1 -- 172.21.15.100:0/1548996915 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c00d600 con 0x7f011c153fb0 2024-01-22T05:38:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0120c00700 1 -- 172.21.15.100:0/1548996915 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00d980 con 0x7f011c153fb0 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 -- 172.21.15.100:0/1548996915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 msgr2=0x7f011c0c0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 --2- 172.21.15.100:0/1548996915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c0c0e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f010c009760 tx=0x7f010c009060).stop 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 -- 172.21.15.100:0/1548996915 shutdown_connections 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 --2- 172.21.15.100:0/1548996915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c0c0e30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 --2- 172.21.15.100:0/1548996915 >> v2:172.21.15.169:3300/0 conn(0x7f011c0a7c90 0x7f011c0639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 -- 172.21.15.100:0/1548996915 >> 172.21.15.100:0/1548996915 conn(0x7f011c0c78a0 msgr2=0x7f011c0c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 -- 172.21.15.100:0/1548996915 shutdown_connections 2024-01-22T05:38:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.600+0000 7f0124a00700 1 -- 172.21.15.100:0/1548996915 wait complete. 2024-01-22T05:38:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.602+0000 7f0124a00700 1 Processor -- start 2024-01-22T05:38:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.602+0000 7f0124a00700 1 -- start start 2024-01-22T05:38:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0124a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c098920 0x7f011c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0124a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c0a7c90 0x7f011c154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0124a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0124a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c155300 con 0x7f011c098920 2024-01-22T05:38:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0124a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1561f0 con 0x7f011c0a7c90 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0124a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1564d0 con 0x7f011c153fb0 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0122000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c098920 0x7f011c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0122000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c098920 0x7f011c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55366/0 (socket says 172.21.15.100:55366) 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0122000700 1 -- 172.21.15.100:0/605766867 learned_addr learned my addr 172.21.15.100:0/605766867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0121600700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c0a7c90 0x7f011c154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.603+0000 7f0122a00700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0122000700 1 -- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 msgr2=0x7f011c14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0122000700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0122000700 1 -- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c0a7c90 msgr2=0x7f011c154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0122000700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c0a7c90 0x7f011c154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0122000700 1 -- 172.21.15.100:0/605766867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104009370 con 0x7f011c098920 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0122000700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c098920 0x7f011c155b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f010c009d50 tx=0x7f010c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0119600700 1 -- 172.21.15.100:0/605766867 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00dd40 con 0x7f011c098920 2024-01-22T05:38:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0119600700 1 -- 172.21.15.100:0/605766867 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c00d770 con 0x7f011c098920 2024-01-22T05:38:11.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c0092a0 con 0x7f011c098920 2024-01-22T05:38:11.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0119600700 1 -- 172.21.15.100:0/605766867 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00dea0 con 0x7f011c098920 2024-01-22T05:38:11.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.604+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c156a90 con 0x7f011c098920 2024-01-22T05:38:11.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.605+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c05fdb0 con 0x7f011c098920 2024-01-22T05:38:11.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.606+0000 7f0119600700 1 -- 172.21.15.100:0/605766867 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f010c018070 con 0x7f011c098920 2024-01-22T05:38:11.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.607+0000 7f0119600700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f00f405f150 0x7f00f4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:11.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.607+0000 7f0119600700 1 -- 172.21.15.100:0/605766867 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f010c07ba00 con 0x7f011c098920 2024-01-22T05:38:11.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.607+0000 7f0121600700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f00f405f150 0x7f00f4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:11.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.607+0000 7f0121600700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f00f405f150 0x7f00f4061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f011c0b0890 tx=0x7f01040090f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.611+0000 7f0119600700 1 -- 172.21.15.100:0/605766867 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f010c04cc10 con 0x7f011c098920 2024-01-22T05:38:11.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.779+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f011c06abb0 con 0x7f00f405f150 2024-01-22T05:38:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.789+0000 7f0119600700 1 -- 172.21.15.100:0/605766867 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336280 (secure 0 0 0) 0x7f011c06abb0 con 0x7f00f405f150 2024-01-22T05:38:11.793 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:11.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f00f405f150 msgr2=0x7f00f4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f00f405f150 0x7f00f4061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f011c0b0890 tx=0x7f01040090f0).stop 2024-01-22T05:38:11.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c098920 msgr2=0x7f011c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:11.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c098920 0x7f011c155b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f010c009d50 tx=0x7f010c016000).stop 2024-01-22T05:38:11.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 shutdown_connections 2024-01-22T05:38:11.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f00f405f150 0x7f00f4061610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f011c153fb0 0x7f011c14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c098920 0x7f011c155b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 --2- 172.21.15.100:0/605766867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c0a7c90 0x7f011c154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 >> 172.21.15.100:0/605766867 conn(0x7f011c0c78a0 msgr2=0x7f011c0c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 shutdown_connections 2024-01-22T05:38:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:11.793+0000 7f0124a00700 1 -- 172.21.15.100:0/605766867 wait complete. 2024-01-22T05:38:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:38:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-22T05:38:11.132417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":669868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002149"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729846+0000","last_change":"2024-01-22T05:37:58.727081+0000","last_active":"2024-01-22T05:37:58.729846+0000","last_peered":"2024-01-22T05:37:58.729846+0000","last_clean":"2024-01-22T05:37:58.729846+0000","last_became_active":"2024-01-22T05:37:58.725736+0000","last_became_peered":"2024-01-22T05:37:58.725736+0000","last_unstale":"2024-01-22T05:37:58.729846+0000","last_undegraded":"2024-01-22T05:37:58.729846+0000","last_fullsized":"2024-01-22T05:37:58.729846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689450+0000","last_change":"2024-01-22T05:37:58.259700+0000","last_active":"2024-01-22T05:37:58.689450+0000","last_peered":"2024-01-22T05:37:58.689450+0000","last_clean":"2024-01-22T05:37:58.689450+0000","last_became_active":"2024-01-22T05:37:58.259421+0000","last_became_peered":"2024-01-22T05:37:58.259421+0000","last_unstale":"2024-01-22T05:37:58.689450+0000","last_undegraded":"2024-01-22T05:37:58.689450+0000","last_fullsized":"2024-01-22T05:37:58.689450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727312+0000","last_change":"2024-01-22T05:37:58.720751+0000","last_active":"2024-01-22T05:37:58.727312+0000","last_peered":"2024-01-22T05:37:58.727312+0000","last_clean":"2024-01-22T05:37:58.727312+0000","last_became_active":"2024-01-22T05:37:58.720447+0000","last_became_peered":"2024-01-22T05:37:58.720447+0000","last_unstale":"2024-01-22T05:37:58.727312+0000","last_undegraded":"2024-01-22T05:37:58.727312+0000","last_fullsized":"2024-01-22T05:37:58.727312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696152+0000","last_change":"2024-01-22T05:37:58.248478+0000","last_active":"2024-01-22T05:37:58.696152+0000","last_peered":"2024-01-22T05:37:58.696152+0000","last_clean":"2024-01-22T05:37:58.696152+0000","last_became_active":"2024-01-22T05:37:58.248115+0000","last_became_peered":"2024-01-22T05:37:58.248115+0000","last_unstale":"2024-01-22T05:37:58.696152+0000","last_undegraded":"2024-01-22T05:37:58.696152+0000","last_fullsized":"2024-01-22T05:37:58.696152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730986+0000","last_change":"2024-01-22T05:37:58.728642+0000","last_active":"2024-01-22T05:37:58.730986+0000","last_peered":"2024-01-22T05:37:58.730986+0000","last_clean":"2024-01-22T05:37:58.730986+0000","last_became_active":"2024-01-22T05:37:58.728277+0000","last_became_peered":"2024-01-22T05:37:58.728277+0000","last_unstale":"2024-01-22T05:37:58.730986+0000","last_undegraded":"2024-01-22T05:37:58.730986+0000","last_fullsized":"2024-01-22T05:37:58.730986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702519+0000","last_change":"2024-01-22T05:37:58.248744+0000","last_active":"2024-01-22T05:37:58.702519+0000","last_peered":"2024-01-22T05:37:58.702519+0000","last_clean":"2024-01-22T05:37:58.702519+0000","last_became_active":"2024-01-22T05:37:58.248261+0000","last_became_peered":"2024-01-22T05:37:58.248261+0000","last_unstale":"2024-01-22T05:37:58.702519+0000","last_undegraded":"2024-01-22T05:37:58.702519+0000","last_fullsized":"2024-01-22T05:37:58.702519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707363+0000","last_change":"2024-01-22T05:37:58.705253+0000","last_active":"2024-01-22T05:37:58.707363+0000","last_peered":"2024-01-22T05:37:58.707363+0000","last_clean":"2024-01-22T05:37:58.707363+0000","last_became_active":"2024-01-22T05:37:58.704907+0000","last_became_peered":"2024-01-22T05:37:58.704907+0000","last_unstale":"2024-01-22T05:37:58.707363+0000","last_undegraded":"2024-01-22T05:37:58.707363+0000","last_fullsized":"2024-01-22T05:37:58.707363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702127+0000","last_change":"2024-01-22T05:37:58.263344+0000","last_active":"2024-01-22T05:37:58.702127+0000","last_peered":"2024-01-22T05:37:58.702127+0000","last_clean":"2024-01-22T05:37:58.702127+0000","last_became_active":"2024-01-22T05:37:58.263056+0000","last_became_peered":"2024-01-22T05:37:58.263056+0000","last_unstale":"2024-01-22T05:37:58.702127+0000","last_undegraded":"2024-01-22T05:37:58.702127+0000","last_fullsized":"2024-01-22T05:37:58.702127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726308+0000","last_change":"2024-01-22T05:37:58.720495+0000","last_active":"2024-01-22T05:37:58.726308+0000","last_peered":"2024-01-22T05:37:58.726308+0000","last_clean":"2024-01-22T05:37:58.726308+0000","last_became_active":"2024-01-22T05:37:58.713824+0000","last_became_peered":"2024-01-22T05:37:58.713824+0000","last_unstale":"2024-01-22T05:37:58.726308+0000","last_undegraded":"2024-01-22T05:37:58.726308+0000","last_fullsized":"2024-01-22T05:37:58.726308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700930+0000","last_change":"2024-01-22T05:37:58.264631+0000","last_active":"2024-01-22T05:37:58.700930+0000","last_peered":"2024-01-22T05:37:58.700930+0000","last_clean":"2024-01-22T05:37:58.700930+0000","last_became_active":"2024-01-22T05:37:58.264164+0000","last_became_peered":"2024-01-22T05:37:58.264164+0000","last_unstale":"2024-01-22T05:37:58.700930+0000","last_undegraded":"2024-01-22T05:37:58.700930+0000","last_fullsized":"2024-01-22T05:37:58.700930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716320+0000","last_change":"2024-01-22T05:37:58.712852+0000","last_active":"2024-01-22T05:37:58.716320+0000","last_peered":"2024-01-22T05:37:58.716320+0000","last_clean":"2024-01-22T05:37:58.716320+0000","last_became_active":"2024-01-22T05:37:58.712580+0000","last_became_peered":"2024-01-22T05:37:58.712580+0000","last_unstale":"2024-01-22T05:37:58.716320+0000","last_undegraded":"2024-01-22T05:37:58.716320+0000","last_fullsized":"2024-01-22T05:37:58.716320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718571+0000","last_change":"2024-01-22T05:37:58.250312+0000","last_active":"2024-01-22T05:37:58.718571+0000","last_peered":"2024-01-22T05:37:58.718571+0000","last_clean":"2024-01-22T05:37:58.718571+0000","last_became_active":"2024-01-22T05:37:58.250058+0000","last_became_peered":"2024-01-22T05:37:58.250058+0000","last_unstale":"2024-01-22T05:37:58.718571+0000","last_undegraded":"2024-01-22T05:37:58.718571+0000","last_fullsized":"2024-01-22T05:37:58.718571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723610+0000","last_change":"2024-01-22T05:37:58.720917+0000","last_active":"2024-01-22T05:37:58.723610+0000","last_peered":"2024-01-22T05:37:58.723610+0000","last_clean":"2024-01-22T05:37:58.723610+0000","last_became_active":"2024-01-22T05:37:58.720566+0000","last_became_peered":"2024-01-22T05:37:58.720566+0000","last_unstale":"2024-01-22T05:37:58.723610+0000","last_undegraded":"2024-01-22T05:37:58.723610+0000","last_fullsized":"2024-01-22T05:37:58.723610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727860+0000","last_change":"2024-01-22T05:37:58.262225+0000","last_active":"2024-01-22T05:37:58.727860+0000","last_peered":"2024-01-22T05:37:58.727860+0000","last_clean":"2024-01-22T05:37:58.727860+0000","last_became_active":"2024-01-22T05:37:58.261931+0000","last_became_peered":"2024-01-22T05:37:58.261931+0000","last_unstale":"2024-01-22T05:37:58.727860+0000","last_undegraded":"2024-01-22T05:37:58.727860+0000","last_fullsized":"2024-01-22T05:37:58.727860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716463+0000","last_change":"2024-01-22T05:37:58.713713+0000","last_active":"2024-01-22T05:37:58.716463+0000","last_peered":"2024-01-22T05:37:58.716463+0000","last_clean":"2024-01-22T05:37:58.716463+0000","last_became_active":"2024-01-22T05:37:58.713222+0000","last_became_peered":"2024-01-22T05:37:58.713222+0000","last_unstale":"2024-01-22T05:37:58.716463+0000","last_undegraded":"2024-01-22T05:37:58.716463+0000","last_fullsized":"2024-01-22T05:37:58.716463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.725718+0000","last_change":"2024-01-22T05:37:58.263422+0000","last_active":"2024-01-22T05:37:58.725718+0000","last_peered":"2024-01-22T05:37:58.725718+0000","last_clean":"2024-01-22T05:37:58.725718+0000","last_became_active":"2024-01-22T05:37:58.263038+0000","last_became_peered":"2024-01-22T05:37:58.263038+0000","last_unstale":"2024-01-22T05:37:58.725718+0000","last_undegraded":"2024-01-22T05:37:58.725718+0000","last_fullsized":"2024-01-22T05:37:58.725718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724388+0000","last_change":"2024-01-22T05:37:58.720659+0000","last_active":"2024-01-22T05:37:58.724388+0000","last_peered":"2024-01-22T05:37:58.724388+0000","last_clean":"2024-01-22T05:37:58.724388+0000","last_became_active":"2024-01-22T05:37:58.720356+0000","last_became_peered":"2024-01-22T05:37:58.720356+0000","last_unstale":"2024-01-22T05:37:58.724388+0000","last_undegraded":"2024-01-22T05:37:58.724388+0000","last_fullsized":"2024-01-22T05:37:58.724388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700696+0000","last_change":"2024-01-22T05:37:58.266202+0000","last_active":"2024-01-22T05:37:58.700696+0000","last_peered":"2024-01-22T05:37:58.700696+0000","last_clean":"2024-01-22T05:37:58.700696+0000","last_became_active":"2024-01-22T05:37:58.265864+0000","last_became_peered":"2024-01-22T05:37:58.265864+0000","last_unstale":"2024-01-22T05:37:58.700696+0000","last_undegraded":"2024-01-22T05:37:58.700696+0000","last_fullsized":"2024-01-22T05:37:58.700696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729642+0000","last_change":"2024-01-22T05:37:58.724022+0000","last_active":"2024-01-22T05:37:58.729642+0000","last_peered":"2024-01-22T05:37:58.729642+0000","last_clean":"2024-01-22T05:37:58.729642+0000","last_became_active":"2024-01-22T05:37:58.723620+0000","last_became_peered":"2024-01-22T05:37:58.723620+0000","last_unstale":"2024-01-22T05:37:58.729642+0000","last_undegraded":"2024-01-22T05:37:58.729642+0000","last_fullsized":"2024-01-22T05:37:58.729642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705714+0000","last_change":"2024-01-22T05:37:58.256227+0000","last_active":"2024-01-22T05:37:58.705714+0000","last_peered":"2024-01-22T05:37:58.705714+0000","last_clean":"2024-01-22T05:37:58.705714+0000","last_became_active":"2024-01-22T05:37:58.255884+0000","last_became_peered":"2024-01-22T05:37:58.255884+0000","last_unstale":"2024-01-22T05:37:58.705714+0000","last_undegraded":"2024-01-22T05:37:58.705714+0000","last_fullsized":"2024-01-22T05:37:58.705714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729732+0000","last_change":"2024-01-22T05:37:58.723121+0000","last_active":"2024-01-22T05:37:58.729732+0000","last_peered":"2024-01-22T05:37:58.729732+0000","last_clean":"2024-01-22T05:37:58.729732+0000","last_became_active":"2024-01-22T05:37:58.722807+0000","last_became_peered":"2024-01-22T05:37:58.722807+0000","last_unstale":"2024-01-22T05:37:58.729732+0000","last_undegraded":"2024-01-22T05:37:58.729732+0000","last_fullsized":"2024-01-22T05:37:58.729732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728450+0000","last_change":"2024-01-22T05:37:58.258876+0000","last_active":"2024-01-22T05:37:58.728450+0000","last_peered":"2024-01-22T05:37:58.728450+0000","last_clean":"2024-01-22T05:37:58.728450+0000","last_became_active":"2024-01-22T05:37:58.258599+0000","last_became_peered":"2024-01-22T05:37:58.258599+0000","last_unstale":"2024-01-22T05:37:58.728450+0000","last_undegraded":"2024-01-22T05:37:58.728450+0000","last_fullsized":"2024-01-22T05:37:58.728450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723711+0000","last_change":"2024-01-22T05:37:58.715284+0000","last_active":"2024-01-22T05:37:58.723711+0000","last_peered":"2024-01-22T05:37:58.723711+0000","last_clean":"2024-01-22T05:37:58.723711+0000","last_became_active":"2024-01-22T05:37:58.715003+0000","last_became_peered":"2024-01-22T05:37:58.715003+0000","last_unstale":"2024-01-22T05:37:58.723711+0000","last_undegraded":"2024-01-22T05:37:58.723711+0000","last_fullsized":"2024-01-22T05:37:58.723711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718376+0000","last_change":"2024-01-22T05:37:58.253681+0000","last_active":"2024-01-22T05:37:58.718376+0000","last_peered":"2024-01-22T05:37:58.718376+0000","last_clean":"2024-01-22T05:37:58.718376+0000","last_became_active":"2024-01-22T05:37:58.252995+0000","last_became_peered":"2024-01-22T05:37:58.252995+0000","last_unstale":"2024-01-22T05:37:58.718376+0000","last_undegraded":"2024-01-22T05:37:58.718376+0000","last_fullsized":"2024-01-22T05:37:58.718376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722299+0000","last_change":"2024-01-22T05:37:58.718097+0000","last_active":"2024-01-22T05:37:58.722299+0000","last_peered":"2024-01-22T05:37:58.722299+0000","last_clean":"2024-01-22T05:37:58.722299+0000","last_became_active":"2024-01-22T05:37:58.717375+0000","last_became_peered":"2024-01-22T05:37:58.717375+0000","last_unstale":"2024-01-22T05:37:58.722299+0000","last_undegraded":"2024-01-22T05:37:58.722299+0000","last_fullsized":"2024-01-22T05:37:58.722299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719556+0000","last_change":"2024-01-22T05:37:58.257304+0000","last_active":"2024-01-22T05:37:58.719556+0000","last_peered":"2024-01-22T05:37:58.719556+0000","last_clean":"2024-01-22T05:37:58.719556+0000","last_became_active":"2024-01-22T05:37:58.257020+0000","last_became_peered":"2024-01-22T05:37:58.257020+0000","last_unstale":"2024-01-22T05:37:58.719556+0000","last_undegraded":"2024-01-22T05:37:58.719556+0000","last_fullsized":"2024-01-22T05:37:58.719556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717620+0000","last_change":"2024-01-22T05:37:58.713314+0000","last_active":"2024-01-22T05:37:58.717620+0000","last_peered":"2024-01-22T05:37:58.717620+0000","last_clean":"2024-01-22T05:37:58.717620+0000","last_became_active":"2024-01-22T05:37:58.713006+0000","last_became_peered":"2024-01-22T05:37:58.713006+0000","last_unstale":"2024-01-22T05:37:58.717620+0000","last_undegraded":"2024-01-22T05:37:58.717620+0000","last_fullsized":"2024-01-22T05:37:58.717620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714189+0000","last_change":"2024-01-22T05:37:58.262212+0000","last_active":"2024-01-22T05:37:58.714189+0000","last_peered":"2024-01-22T05:37:58.714189+0000","last_clean":"2024-01-22T05:37:58.714189+0000","last_became_active":"2024-01-22T05:37:58.261871+0000","last_became_peered":"2024-01-22T05:37:58.261871+0000","last_unstale":"2024-01-22T05:37:58.714189+0000","last_undegraded":"2024-01-22T05:37:58.714189+0000","last_fullsized":"2024-01-22T05:37:58.714189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724071+0000","last_change":"2024-01-22T05:37:58.716253+0000","last_active":"2024-01-22T05:37:58.724071+0000","last_peered":"2024-01-22T05:37:58.724071+0000","last_clean":"2024-01-22T05:37:58.724071+0000","last_became_active":"2024-01-22T05:37:58.715943+0000","last_became_peered":"2024-01-22T05:37:58.715943+0000","last_unstale":"2024-01-22T05:37:58.724071+0000","last_undegraded":"2024-01-22T05:37:58.724071+0000","last_fullsized":"2024-01-22T05:37:58.724071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697258+0000","last_change":"2024-01-22T05:37:58.260069+0000","last_active":"2024-01-22T05:37:58.697258+0000","last_peered":"2024-01-22T05:37:58.697258+0000","last_clean":"2024-01-22T05:37:58.697258+0000","last_became_active":"2024-01-22T05:37:58.257371+0000","last_became_peered":"2024-01-22T05:37:58.257371+0000","last_unstale":"2024-01-22T05:37:58.697258+0000","last_undegraded":"2024-01-22T05:37:58.697258+0000","last_fullsized":"2024-01-22T05:37:58.697258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723329+0000","last_change":"2024-01-22T05:37:58.713209+0000","last_active":"2024-01-22T05:37:58.723329+0000","last_peered":"2024-01-22T05:37:58.723329+0000","last_clean":"2024-01-22T05:37:58.723329+0000","last_became_active":"2024-01-22T05:37:58.712865+0000","last_became_peered":"2024-01-22T05:37:58.712865+0000","last_unstale":"2024-01-22T05:37:58.723329+0000","last_undegraded":"2024-01-22T05:37:58.723329+0000","last_fullsized":"2024-01-22T05:37:58.723329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715117+0000","last_change":"2024-01-22T05:37:58.261836+0000","last_active":"2024-01-22T05:37:58.715117+0000","last_peered":"2024-01-22T05:37:58.715117+0000","last_clean":"2024-01-22T05:37:58.715117+0000","last_became_active":"2024-01-22T05:37:58.261533+0000","last_became_peered":"2024-01-22T05:37:58.261533+0000","last_unstale":"2024-01-22T05:37:58.715117+0000","last_undegraded":"2024-01-22T05:37:58.715117+0000","last_fullsized":"2024-01-22T05:37:58.715117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730485+0000","last_change":"2024-01-22T05:37:58.724748+0000","last_active":"2024-01-22T05:37:58.730485+0000","last_peered":"2024-01-22T05:37:58.730485+0000","last_clean":"2024-01-22T05:37:58.730485+0000","last_became_active":"2024-01-22T05:37:58.724181+0000","last_became_peered":"2024-01-22T05:37:58.724181+0000","last_unstale":"2024-01-22T05:37:58.730485+0000","last_undegraded":"2024-01-22T05:37:58.730485+0000","last_fullsized":"2024-01-22T05:37:58.730485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709832+0000","last_change":"2024-01-22T05:37:58.257196+0000","last_active":"2024-01-22T05:37:58.709832+0000","last_peered":"2024-01-22T05:37:58.709832+0000","last_clean":"2024-01-22T05:37:58.709832+0000","last_became_active":"2024-01-22T05:37:58.256932+0000","last_became_peered":"2024-01-22T05:37:58.256932+0000","last_unstale":"2024-01-22T05:37:58.709832+0000","last_undegraded":"2024-01-22T05:37:58.709832+0000","last_fullsized":"2024-01-22T05:37:58.709832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724590+0000","last_change":"2024-01-22T05:37:58.720229+0000","last_active":"2024-01-22T05:37:58.724590+0000","last_peered":"2024-01-22T05:37:58.724590+0000","last_clean":"2024-01-22T05:37:58.724590+0000","last_became_active":"2024-01-22T05:37:58.719862+0000","last_became_peered":"2024-01-22T05:37:58.719862+0000","last_unstale":"2024-01-22T05:37:58.724590+0000","last_undegraded":"2024-01-22T05:37:58.724590+0000","last_fullsized":"2024-01-22T05:37:58.724590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709188+0000","last_change":"2024-01-22T05:37:58.263404+0000","last_active":"2024-01-22T05:37:58.709188+0000","last_peered":"2024-01-22T05:37:58.709188+0000","last_clean":"2024-01-22T05:37:58.709188+0000","last_became_active":"2024-01-22T05:37:58.263016+0000","last_became_peered":"2024-01-22T05:37:58.263016+0000","last_unstale":"2024-01-22T05:37:58.709188+0000","last_undegraded":"2024-01-22T05:37:58.709188+0000","last_fullsized":"2024-01-22T05:37:58.709188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719869+0000","last_change":"2024-01-22T05:37:58.717161+0000","last_active":"2024-01-22T05:37:58.719869+0000","last_peered":"2024-01-22T05:37:58.719869+0000","last_clean":"2024-01-22T05:37:58.719869+0000","last_became_active":"2024-01-22T05:37:58.716723+0000","last_became_peered":"2024-01-22T05:37:58.716723+0000","last_unstale":"2024-01-22T05:37:58.719869+0000","last_undegraded":"2024-01-22T05:37:58.719869+0000","last_fullsized":"2024-01-22T05:37:58.719869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703194+0000","last_change":"2024-01-22T05:37:58.247858+0000","last_active":"2024-01-22T05:37:58.703194+0000","last_peered":"2024-01-22T05:37:58.703194+0000","last_clean":"2024-01-22T05:37:58.703194+0000","last_became_active":"2024-01-22T05:37:58.247562+0000","last_became_peered":"2024-01-22T05:37:58.247562+0000","last_unstale":"2024-01-22T05:37:58.703194+0000","last_undegraded":"2024-01-22T05:37:58.703194+0000","last_fullsized":"2024-01-22T05:37:58.703194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701497+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:37:58.701497+0000","last_peered":"2024-01-22T05:37:58.701497+0000","last_clean":"2024-01-22T05:37:58.701497+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:37:58.701497+0000","last_undegraded":"2024-01-22T05:37:58.701497+0000","last_fullsized":"2024-01-22T05:37:58.701497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700257+0000","last_change":"2024-01-22T05:37:58.252358+0000","last_active":"2024-01-22T05:37:58.700257+0000","last_peered":"2024-01-22T05:37:58.700257+0000","last_clean":"2024-01-22T05:37:58.700257+0000","last_became_active":"2024-01-22T05:37:58.248516+0000","last_became_peered":"2024-01-22T05:37:58.248516+0000","last_unstale":"2024-01-22T05:37:58.700257+0000","last_undegraded":"2024-01-22T05:37:58.700257+0000","last_fullsized":"2024-01-22T05:37:58.700257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726815+0000","last_change":"2024-01-22T05:37:58.721521+0000","last_active":"2024-01-22T05:37:58.726815+0000","last_peered":"2024-01-22T05:37:58.726815+0000","last_clean":"2024-01-22T05:37:58.726815+0000","last_became_active":"2024-01-22T05:37:58.721152+0000","last_became_peered":"2024-01-22T05:37:58.721152+0000","last_unstale":"2024-01-22T05:37:58.726815+0000","last_undegraded":"2024-01-22T05:37:58.726815+0000","last_fullsized":"2024-01-22T05:37:58.726815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.708232+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:37:58.708232+0000","last_peered":"2024-01-22T05:37:58.708232+0000","last_clean":"2024-01-22T05:37:58.708232+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:37:58.708232+0000","last_undegraded":"2024-01-22T05:37:58.708232+0000","last_fullsized":"2024-01-22T05:37:58.708232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696621+0000","last_change":"2024-01-22T05:37:58.252041+0000","last_active":"2024-01-22T05:37:58.696621+0000","last_peered":"2024-01-22T05:37:58.696621+0000","last_clean":"2024-01-22T05:37:58.696621+0000","last_became_active":"2024-01-22T05:37:58.251676+0000","last_became_peered":"2024-01-22T05:37:58.251676+0000","last_unstale":"2024-01-22T05:37:58.696621+0000","last_undegraded":"2024-01-22T05:37:58.696621+0000","last_fullsized":"2024-01-22T05:37:58.696621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715221+0000","last_change":"2024-01-22T05:37:58.707436+0000","last_active":"2024-01-22T05:37:58.715221+0000","last_peered":"2024-01-22T05:37:58.715221+0000","last_clean":"2024-01-22T05:37:58.715221+0000","last_became_active":"2024-01-22T05:37:58.707144+0000","last_became_peered":"2024-01-22T05:37:58.707144+0000","last_unstale":"2024-01-22T05:37:58.715221+0000","last_undegraded":"2024-01-22T05:37:58.715221+0000","last_fullsized":"2024-01-22T05:37:58.715221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718108+0000","last_change":"2024-01-22T05:37:58.716084+0000","last_active":"2024-01-22T05:37:58.718108+0000","last_peered":"2024-01-22T05:37:58.718108+0000","last_clean":"2024-01-22T05:37:58.718108+0000","last_became_active":"2024-01-22T05:37:58.715755+0000","last_became_peered":"2024-01-22T05:37:58.715755+0000","last_unstale":"2024-01-22T05:37:58.718108+0000","last_undegraded":"2024-01-22T05:37:58.718108+0000","last_fullsized":"2024-01-22T05:37:58.718108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.695763+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:37:58.695763+0000","last_peered":"2024-01-22T05:37:58.695763+0000","last_clean":"2024-01-22T05:37:58.695763+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:37:58.695763+0000","last_undegraded":"2024-01-22T05:37:58.695763+0000","last_fullsized":"2024-01-22T05:37:58.695763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702299+0000","last_change":"2024-01-22T05:37:58.255676+0000","last_active":"2024-01-22T05:37:58.702299+0000","last_peered":"2024-01-22T05:37:58.702299+0000","last_clean":"2024-01-22T05:37:58.702299+0000","last_became_active":"2024-01-22T05:37:58.253263+0000","last_became_peered":"2024-01-22T05:37:58.253263+0000","last_unstale":"2024-01-22T05:37:58.702299+0000","last_undegraded":"2024-01-22T05:37:58.702299+0000","last_fullsized":"2024-01-22T05:37:58.702299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724371+0000","last_change":"2024-01-22T05:37:58.720166+0000","last_active":"2024-01-22T05:37:58.724371+0000","last_peered":"2024-01-22T05:37:58.724371+0000","last_clean":"2024-01-22T05:37:58.724371+0000","last_became_active":"2024-01-22T05:37:58.719849+0000","last_became_peered":"2024-01-22T05:37:58.719849+0000","last_unstale":"2024-01-22T05:37:58.724371+0000","last_undegraded":"2024-01-22T05:37:58.724371+0000","last_fullsized":"2024-01-22T05:37:58.724371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705514+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:37:58.705514+0000","last_peered":"2024-01-22T05:37:58.705514+0000","last_clean":"2024-01-22T05:37:58.705514+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:37:58.705514+0000","last_undegraded":"2024-01-22T05:37:58.705514+0000","last_fullsized":"2024-01-22T05:37:58.705514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.688444+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:37:58.688444+0000","last_peered":"2024-01-22T05:37:58.688444+0000","last_clean":"2024-01-22T05:37:58.688444+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:37:58.688444+0000","last_undegraded":"2024-01-22T05:37:58.688444+0000","last_fullsized":"2024-01-22T05:37:58.688444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.694912+0000","last_change":"2024-01-22T05:37:58.248432+0000","last_active":"2024-01-22T05:37:58.694912+0000","last_peered":"2024-01-22T05:37:58.694912+0000","last_clean":"2024-01-22T05:37:58.694912+0000","last_became_active":"2024-01-22T05:37:58.248051+0000","last_became_peered":"2024-01-22T05:37:58.248051+0000","last_unstale":"2024-01-22T05:37:58.694912+0000","last_undegraded":"2024-01-22T05:37:58.694912+0000","last_fullsized":"2024-01-22T05:37:58.694912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732489+0000","last_change":"2024-01-22T05:37:58.726657+0000","last_active":"2024-01-22T05:37:58.732489+0000","last_peered":"2024-01-22T05:37:58.732489+0000","last_clean":"2024-01-22T05:37:58.732489+0000","last_became_active":"2024-01-22T05:37:58.724582+0000","last_became_peered":"2024-01-22T05:37:58.724582+0000","last_unstale":"2024-01-22T05:37:58.732489+0000","last_undegraded":"2024-01-22T05:37:58.732489+0000","last_fullsized":"2024-01-22T05:37:58.732489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704038+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:37:58.704038+0000","last_peered":"2024-01-22T05:37:58.704038+0000","last_clean":"2024-01-22T05:37:58.704038+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:37:58.704038+0000","last_undegraded":"2024-01-22T05:37:58.704038+0000","last_fullsized":"2024-01-22T05:37:58.704038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699091+0000","last_change":"2024-01-22T05:37:58.244890+0000","last_active":"2024-01-22T05:37:58.699091+0000","last_peered":"2024-01-22T05:37:58.699091+0000","last_clean":"2024-01-22T05:37:58.699091+0000","last_became_active":"2024-01-22T05:37:58.244624+0000","last_became_peered":"2024-01-22T05:37:58.244624+0000","last_unstale":"2024-01-22T05:37:58.699091+0000","last_undegraded":"2024-01-22T05:37:58.699091+0000","last_fullsized":"2024-01-22T05:37:58.699091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714275+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:37:58.714275+0000","last_peered":"2024-01-22T05:37:58.714275+0000","last_clean":"2024-01-22T05:37:58.714275+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:37:58.714275+0000","last_undegraded":"2024-01-22T05:37:58.714275+0000","last_fullsized":"2024-01-22T05:37:58.714275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704938+0000","last_change":"2024-01-22T05:37:58.256019+0000","last_active":"2024-01-22T05:37:58.704938+0000","last_peered":"2024-01-22T05:37:58.704938+0000","last_clean":"2024-01-22T05:37:58.704938+0000","last_became_active":"2024-01-22T05:37:58.255206+0000","last_became_peered":"2024-01-22T05:37:58.255206+0000","last_unstale":"2024-01-22T05:37:58.704938+0000","last_undegraded":"2024-01-22T05:37:58.704938+0000","last_fullsized":"2024-01-22T05:37:58.704938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.716866+0000","last_change":"2024-01-22T05:37:58.715826+0000","last_active":"2024-01-22T05:37:58.716866+0000","last_peered":"2024-01-22T05:37:58.716866+0000","last_clean":"2024-01-22T05:37:58.716866+0000","last_became_active":"2024-01-22T05:37:58.715462+0000","last_became_peered":"2024-01-22T05:37:58.715462+0000","last_unstale":"2024-01-22T05:37:58.716866+0000","last_undegraded":"2024-01-22T05:37:58.716866+0000","last_fullsized":"2024-01-22T05:37:58.716866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718886+0000","last_change":"2024-01-22T05:37:58.248570+0000","last_active":"2024-01-22T05:37:58.718886+0000","last_peered":"2024-01-22T05:37:58.718886+0000","last_clean":"2024-01-22T05:37:58.718886+0000","last_became_active":"2024-01-22T05:37:58.248217+0000","last_became_peered":"2024-01-22T05:37:58.248217+0000","last_unstale":"2024-01-22T05:37:58.718886+0000","last_undegraded":"2024-01-22T05:37:58.718886+0000","last_fullsized":"2024-01-22T05:37:58.718886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.703823+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:37:58.703823+0000","last_peered":"2024-01-22T05:37:58.703823+0000","last_clean":"2024-01-22T05:37:58.703823+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:37:58.703823+0000","last_undegraded":"2024-01-22T05:37:58.703823+0000","last_fullsized":"2024-01-22T05:37:58.703823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.721675+0000","last_change":"2024-01-22T05:37:58.714917+0000","last_active":"2024-01-22T05:37:58.721675+0000","last_peered":"2024-01-22T05:37:58.721675+0000","last_clean":"2024-01-22T05:37:58.721675+0000","last_became_active":"2024-01-22T05:37:58.714575+0000","last_became_peered":"2024-01-22T05:37:58.714575+0000","last_unstale":"2024-01-22T05:37:58.721675+0000","last_undegraded":"2024-01-22T05:37:58.721675+0000","last_fullsized":"2024-01-22T05:37:58.721675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707640+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:37:58.707640+0000","last_peered":"2024-01-22T05:37:58.707640+0000","last_clean":"2024-01-22T05:37:58.707640+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:37:58.707640+0000","last_undegraded":"2024-01-22T05:37:58.707640+0000","last_fullsized":"2024-01-22T05:37:58.707640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705408+0000","last_change":"2024-01-22T05:37:58.253114+0000","last_active":"2024-01-22T05:37:58.705408+0000","last_peered":"2024-01-22T05:37:58.705408+0000","last_clean":"2024-01-22T05:37:58.705408+0000","last_became_active":"2024-01-22T05:37:58.252823+0000","last_became_peered":"2024-01-22T05:37:58.252823+0000","last_unstale":"2024-01-22T05:37:58.705408+0000","last_undegraded":"2024-01-22T05:37:58.705408+0000","last_fullsized":"2024-01-22T05:37:58.705408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.715774+0000","last_change":"2024-01-22T05:37:58.707388+0000","last_active":"2024-01-22T05:37:58.715774+0000","last_peered":"2024-01-22T05:37:58.715774+0000","last_clean":"2024-01-22T05:37:58.715774+0000","last_became_active":"2024-01-22T05:37:58.707099+0000","last_became_peered":"2024-01-22T05:37:58.707099+0000","last_unstale":"2024-01-22T05:37:58.715774+0000","last_undegraded":"2024-01-22T05:37:58.715774+0000","last_fullsized":"2024-01-22T05:37:58.715774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727511+0000","last_change":"2024-01-22T05:37:58.721226+0000","last_active":"2024-01-22T05:37:58.727511+0000","last_peered":"2024-01-22T05:37:58.727511+0000","last_clean":"2024-01-22T05:37:58.727511+0000","last_became_active":"2024-01-22T05:37:58.714690+0000","last_became_peered":"2024-01-22T05:37:58.714690+0000","last_unstale":"2024-01-22T05:37:58.727511+0000","last_undegraded":"2024-01-22T05:37:58.727511+0000","last_fullsized":"2024-01-22T05:37:58.727511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.701838+0000","last_change":"2024-01-22T05:37:58.253254+0000","last_active":"2024-01-22T05:37:58.701838+0000","last_peered":"2024-01-22T05:37:58.701838+0000","last_clean":"2024-01-22T05:37:58.701838+0000","last_became_active":"2024-01-22T05:37:58.252839+0000","last_became_peered":"2024-01-22T05:37:58.252839+0000","last_unstale":"2024-01-22T05:37:58.701838+0000","last_undegraded":"2024-01-22T05:37:58.701838+0000","last_fullsized":"2024-01-22T05:37:58.701838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728419+0000","last_change":"2024-01-22T05:37:58.724996+0000","last_active":"2024-01-22T05:37:58.728419+0000","last_peered":"2024-01-22T05:37:58.728419+0000","last_clean":"2024-01-22T05:37:58.728419+0000","last_became_active":"2024-01-22T05:37:58.724730+0000","last_became_peered":"2024-01-22T05:37:58.724730+0000","last_unstale":"2024-01-22T05:37:58.728419+0000","last_undegraded":"2024-01-22T05:37:58.728419+0000","last_fullsized":"2024-01-22T05:37:58.728419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689345+0000","last_change":"2024-01-22T05:37:58.261431+0000","last_active":"2024-01-22T05:37:58.689345+0000","last_peered":"2024-01-22T05:37:58.689345+0000","last_clean":"2024-01-22T05:37:58.689345+0000","last_became_active":"2024-01-22T05:37:58.261120+0000","last_became_peered":"2024-01-22T05:37:58.261120+0000","last_unstale":"2024-01-22T05:37:58.689345+0000","last_undegraded":"2024-01-22T05:37:58.689345+0000","last_fullsized":"2024-01-22T05:37:58.689345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717402+0000","last_change":"2024-01-22T05:37:58.709933+0000","last_active":"2024-01-22T05:37:58.717402+0000","last_peered":"2024-01-22T05:37:58.717402+0000","last_clean":"2024-01-22T05:37:58.717402+0000","last_became_active":"2024-01-22T05:37:58.707398+0000","last_became_peered":"2024-01-22T05:37:58.707398+0000","last_unstale":"2024-01-22T05:37:58.717402+0000","last_undegraded":"2024-01-22T05:37:58.717402+0000","last_fullsized":"2024-01-22T05:37:58.717402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726249+0000","last_change":"2024-01-22T05:37:58.265006+0000","last_active":"2024-01-22T05:37:58.726249+0000","last_peered":"2024-01-22T05:37:58.726249+0000","last_clean":"2024-01-22T05:37:58.726249+0000","last_became_active":"2024-01-22T05:37:58.264513+0000","last_became_peered":"2024-01-22T05:37:58.264513+0000","last_unstale":"2024-01-22T05:37:58.726249+0000","last_undegraded":"2024-01-22T05:37:58.726249+0000","last_fullsized":"2024-01-22T05:37:58.726249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712679+0000","last_change":"2024-01-22T05:37:58.710477+0000","last_active":"2024-01-22T05:37:58.712679+0000","last_peered":"2024-01-22T05:37:58.712679+0000","last_clean":"2024-01-22T05:37:58.712679+0000","last_became_active":"2024-01-22T05:37:58.710170+0000","last_became_peered":"2024-01-22T05:37:58.710170+0000","last_unstale":"2024-01-22T05:37:58.712679+0000","last_undegraded":"2024-01-22T05:37:58.712679+0000","last_fullsized":"2024-01-22T05:37:58.712679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732630+0000","last_change":"2024-01-22T05:37:58.249092+0000","last_active":"2024-01-22T05:37:58.732630+0000","last_peered":"2024-01-22T05:37:58.732630+0000","last_clean":"2024-01-22T05:37:58.732630+0000","last_became_active":"2024-01-22T05:37:58.248749+0000","last_became_peered":"2024-01-22T05:37:58.248749+0000","last_unstale":"2024-01-22T05:37:58.732630+0000","last_undegraded":"2024-01-22T05:37:58.732630+0000","last_fullsized":"2024-01-22T05:37:58.732630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724703+0000","last_change":"2024-01-22T05:37:58.721462+0000","last_active":"2024-01-22T05:37:58.724703+0000","last_peered":"2024-01-22T05:37:58.724703+0000","last_clean":"2024-01-22T05:37:58.724703+0000","last_became_active":"2024-01-22T05:37:58.721192+0000","last_became_peered":"2024-01-22T05:37:58.721192+0000","last_unstale":"2024-01-22T05:37:58.724703+0000","last_undegraded":"2024-01-22T05:37:58.724703+0000","last_fullsized":"2024-01-22T05:37:58.724703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732649+0000","last_change":"2024-01-22T05:37:58.256074+0000","last_active":"2024-01-22T05:37:58.732649+0000","last_peered":"2024-01-22T05:37:58.732649+0000","last_clean":"2024-01-22T05:37:58.732649+0000","last_became_active":"2024-01-22T05:37:58.253919+0000","last_became_peered":"2024-01-22T05:37:58.253919+0000","last_unstale":"2024-01-22T05:37:58.732649+0000","last_undegraded":"2024-01-22T05:37:58.732649+0000","last_fullsized":"2024-01-22T05:37:58.732649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732648+0000","last_change":"2024-01-22T05:37:58.730288+0000","last_active":"2024-01-22T05:37:58.732648+0000","last_peered":"2024-01-22T05:37:58.732648+0000","last_clean":"2024-01-22T05:37:58.732648+0000","last_became_active":"2024-01-22T05:37:58.729963+0000","last_became_peered":"2024-01-22T05:37:58.729963+0000","last_unstale":"2024-01-22T05:37:58.732648+0000","last_undegraded":"2024-01-22T05:37:58.732648+0000","last_fullsized":"2024-01-22T05:37:58.732648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699383+0000","last_change":"2024-01-22T05:37:58.249681+0000","last_active":"2024-01-22T05:37:58.699383+0000","last_peered":"2024-01-22T05:37:58.699383+0000","last_clean":"2024-01-22T05:37:58.699383+0000","last_became_active":"2024-01-22T05:37:58.249359+0000","last_became_peered":"2024-01-22T05:37:58.249359+0000","last_unstale":"2024-01-22T05:37:58.699383+0000","last_undegraded":"2024-01-22T05:37:58.699383+0000","last_fullsized":"2024-01-22T05:37:58.699383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.726458+0000","last_change":"2024-01-22T05:37:58.719997+0000","last_active":"2024-01-22T05:37:58.726458+0000","last_peered":"2024-01-22T05:37:58.726458+0000","last_clean":"2024-01-22T05:37:58.726458+0000","last_became_active":"2024-01-22T05:37:58.717231+0000","last_became_peered":"2024-01-22T05:37:58.717231+0000","last_unstale":"2024-01-22T05:37:58.726458+0000","last_undegraded":"2024-01-22T05:37:58.726458+0000","last_fullsized":"2024-01-22T05:37:58.726458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.695952+0000","last_change":"2024-01-22T05:37:58.257047+0000","last_active":"2024-01-22T05:37:58.695952+0000","last_peered":"2024-01-22T05:37:58.695952+0000","last_clean":"2024-01-22T05:37:58.695952+0000","last_became_active":"2024-01-22T05:37:58.256649+0000","last_became_peered":"2024-01-22T05:37:58.256649+0000","last_unstale":"2024-01-22T05:37:58.695952+0000","last_undegraded":"2024-01-22T05:37:58.695952+0000","last_fullsized":"2024-01-22T05:37:58.695952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.730507+0000","last_change":"2024-01-22T05:37:58.726471+0000","last_active":"2024-01-22T05:37:58.730507+0000","last_peered":"2024-01-22T05:37:58.730507+0000","last_clean":"2024-01-22T05:37:58.730507+0000","last_became_active":"2024-01-22T05:37:58.725949+0000","last_became_peered":"2024-01-22T05:37:58.725949+0000","last_unstale":"2024-01-22T05:37:58.730507+0000","last_undegraded":"2024-01-22T05:37:58.730507+0000","last_fullsized":"2024-01-22T05:37:58.730507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.708157+0000","last_change":"2024-01-22T05:37:58.263577+0000","last_active":"2024-01-22T05:37:58.708157+0000","last_peered":"2024-01-22T05:37:58.708157+0000","last_clean":"2024-01-22T05:37:58.708157+0000","last_became_active":"2024-01-22T05:37:58.263204+0000","last_became_peered":"2024-01-22T05:37:58.263204+0000","last_unstale":"2024-01-22T05:37:58.708157+0000","last_undegraded":"2024-01-22T05:37:58.708157+0000","last_fullsized":"2024-01-22T05:37:58.708157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724177+0000","last_change":"2024-01-22T05:37:58.717817+0000","last_active":"2024-01-22T05:37:58.724177+0000","last_peered":"2024-01-22T05:37:58.724177+0000","last_clean":"2024-01-22T05:37:58.724177+0000","last_became_active":"2024-01-22T05:37:58.717540+0000","last_became_peered":"2024-01-22T05:37:58.717540+0000","last_unstale":"2024-01-22T05:37:58.724177+0000","last_undegraded":"2024-01-22T05:37:58.724177+0000","last_fullsized":"2024-01-22T05:37:58.724177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.699042+0000","last_change":"2024-01-22T05:37:58.253690+0000","last_active":"2024-01-22T05:37:58.699042+0000","last_peered":"2024-01-22T05:37:58.699042+0000","last_clean":"2024-01-22T05:37:58.699042+0000","last_became_active":"2024-01-22T05:37:58.253367+0000","last_became_peered":"2024-01-22T05:37:58.253367+0000","last_unstale":"2024-01-22T05:37:58.699042+0000","last_undegraded":"2024-01-22T05:37:58.699042+0000","last_fullsized":"2024-01-22T05:37:58.699042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723711+0000","last_change":"2024-01-22T05:37:58.709446+0000","last_active":"2024-01-22T05:37:58.723711+0000","last_peered":"2024-01-22T05:37:58.723711+0000","last_clean":"2024-01-22T05:37:58.723711+0000","last_became_active":"2024-01-22T05:37:58.709099+0000","last_became_peered":"2024-01-22T05:37:58.709099+0000","last_unstale":"2024-01-22T05:37:58.723711+0000","last_undegraded":"2024-01-22T05:37:58.723711+0000","last_fullsized":"2024-01-22T05:37:58.723711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704828+0000","last_change":"2024-01-22T05:37:58.260823+0000","last_active":"2024-01-22T05:37:58.704828+0000","last_peered":"2024-01-22T05:37:58.704828+0000","last_clean":"2024-01-22T05:37:58.704828+0000","last_became_active":"2024-01-22T05:37:58.260527+0000","last_became_peered":"2024-01-22T05:37:58.260527+0000","last_unstale":"2024-01-22T05:37:58.704828+0000","last_undegraded":"2024-01-22T05:37:58.704828+0000","last_fullsized":"2024-01-22T05:37:58.704828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712095+0000","last_change":"2024-01-22T05:37:58.706792+0000","last_active":"2024-01-22T05:37:58.712095+0000","last_peered":"2024-01-22T05:37:58.712095+0000","last_clean":"2024-01-22T05:37:58.712095+0000","last_became_active":"2024-01-22T05:37:58.706496+0000","last_became_peered":"2024-01-22T05:37:58.706496+0000","last_unstale":"2024-01-22T05:37:58.712095+0000","last_undegraded":"2024-01-22T05:37:58.712095+0000","last_fullsized":"2024-01-22T05:37:58.712095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.704962+0000","last_change":"2024-01-22T05:37:58.258446+0000","last_active":"2024-01-22T05:37:58.704962+0000","last_peered":"2024-01-22T05:37:58.704962+0000","last_clean":"2024-01-22T05:37:58.704962+0000","last_became_active":"2024-01-22T05:37:58.258012+0000","last_became_peered":"2024-01-22T05:37:58.258012+0000","last_unstale":"2024-01-22T05:37:58.704962+0000","last_undegraded":"2024-01-22T05:37:58.704962+0000","last_fullsized":"2024-01-22T05:37:58.704962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732126+0000","last_change":"2024-01-22T05:37:58.726698+0000","last_active":"2024-01-22T05:37:58.732126+0000","last_peered":"2024-01-22T05:37:58.732126+0000","last_clean":"2024-01-22T05:37:58.732126+0000","last_became_active":"2024-01-22T05:37:58.725892+0000","last_became_peered":"2024-01-22T05:37:58.725892+0000","last_unstale":"2024-01-22T05:37:58.732126+0000","last_undegraded":"2024-01-22T05:37:58.732126+0000","last_fullsized":"2024-01-22T05:37:58.732126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-22T05:37:59.701436+0000","last_change":"2024-01-22T05:37:58.264437+0000","last_active":"2024-01-22T05:37:59.701436+0000","last_peered":"2024-01-22T05:37:59.701436+0000","last_clean":"2024-01-22T05:37:59.701436+0000","last_became_active":"2024-01-22T05:37:58.263796+0000","last_became_peered":"2024-01-22T05:37:58.263796+0000","last_unstale":"2024-01-22T05:37:59.701436+0000","last_undegraded":"2024-01-22T05:37:59.701436+0000","last_fullsized":"2024-01-22T05:37:59.701436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.720620+0000","last_change":"2024-01-22T05:37:58.714745+0000","last_active":"2024-01-22T05:37:58.720620+0000","last_peered":"2024-01-22T05:37:58.720620+0000","last_clean":"2024-01-22T05:37:58.720620+0000","last_became_active":"2024-01-22T05:37:58.714462+0000","last_became_peered":"2024-01-22T05:37:58.714462+0000","last_unstale":"2024-01-22T05:37:58.720620+0000","last_undegraded":"2024-01-22T05:37:58.720620+0000","last_fullsized":"2024-01-22T05:37:58.720620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702263+0000","last_change":"2024-01-22T05:37:58.255003+0000","last_active":"2024-01-22T05:37:58.702263+0000","last_peered":"2024-01-22T05:37:58.702263+0000","last_clean":"2024-01-22T05:37:58.702263+0000","last_became_active":"2024-01-22T05:37:58.253856+0000","last_became_peered":"2024-01-22T05:37:58.253856+0000","last_unstale":"2024-01-22T05:37:58.702263+0000","last_undegraded":"2024-01-22T05:37:58.702263+0000","last_fullsized":"2024-01-22T05:37:58.702263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722299+0000","last_change":"2024-01-22T05:37:58.718905+0000","last_active":"2024-01-22T05:37:58.722299+0000","last_peered":"2024-01-22T05:37:58.722299+0000","last_clean":"2024-01-22T05:37:58.722299+0000","last_became_active":"2024-01-22T05:37:58.717276+0000","last_became_peered":"2024-01-22T05:37:58.717276+0000","last_unstale":"2024-01-22T05:37:58.722299+0000","last_undegraded":"2024-01-22T05:37:58.722299+0000","last_fullsized":"2024-01-22T05:37:58.722299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.706505+0000","last_change":"2024-01-22T05:37:58.265209+0000","last_active":"2024-01-22T05:37:58.706505+0000","last_peered":"2024-01-22T05:37:58.706505+0000","last_clean":"2024-01-22T05:37:58.706505+0000","last_became_active":"2024-01-22T05:37:58.264930+0000","last_became_peered":"2024-01-22T05:37:58.264930+0000","last_unstale":"2024-01-22T05:37:58.706505+0000","last_undegraded":"2024-01-22T05:37:58.706505+0000","last_fullsized":"2024-01-22T05:37:58.706505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712277+0000","last_change":"2024-01-22T05:37:58.706093+0000","last_active":"2024-01-22T05:37:58.712277+0000","last_peered":"2024-01-22T05:37:58.712277+0000","last_clean":"2024-01-22T05:37:58.712277+0000","last_became_active":"2024-01-22T05:37:58.705804+0000","last_became_peered":"2024-01-22T05:37:58.705804+0000","last_unstale":"2024-01-22T05:37:58.712277+0000","last_undegraded":"2024-01-22T05:37:58.712277+0000","last_fullsized":"2024-01-22T05:37:58.712277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696681+0000","last_change":"2024-01-22T05:37:58.249283+0000","last_active":"2024-01-22T05:37:58.696681+0000","last_peered":"2024-01-22T05:37:58.696681+0000","last_clean":"2024-01-22T05:37:58.696681+0000","last_became_active":"2024-01-22T05:37:58.248923+0000","last_became_peered":"2024-01-22T05:37:58.248923+0000","last_unstale":"2024-01-22T05:37:58.696681+0000","last_undegraded":"2024-01-22T05:37:58.696681+0000","last_fullsized":"2024-01-22T05:37:58.696681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729793+0000","last_change":"2024-01-22T05:37:58.724869+0000","last_active":"2024-01-22T05:37:58.729793+0000","last_peered":"2024-01-22T05:37:58.729793+0000","last_clean":"2024-01-22T05:37:58.729793+0000","last_became_active":"2024-01-22T05:37:58.724551+0000","last_became_peered":"2024-01-22T05:37:58.724551+0000","last_unstale":"2024-01-22T05:37:58.729793+0000","last_undegraded":"2024-01-22T05:37:58.729793+0000","last_fullsized":"2024-01-22T05:37:58.729793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.689553+0000","last_change":"2024-01-22T05:37:58.256442+0000","last_active":"2024-01-22T05:37:58.689553+0000","last_peered":"2024-01-22T05:37:58.689553+0000","last_clean":"2024-01-22T05:37:58.689553+0000","last_became_active":"2024-01-22T05:37:58.256136+0000","last_became_peered":"2024-01-22T05:37:58.256136+0000","last_unstale":"2024-01-22T05:37:58.689553+0000","last_undegraded":"2024-01-22T05:37:58.689553+0000","last_fullsized":"2024-01-22T05:37:58.689553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.717228+0000","last_change":"2024-01-22T05:37:58.711074+0000","last_active":"2024-01-22T05:37:58.717228+0000","last_peered":"2024-01-22T05:37:58.717228+0000","last_clean":"2024-01-22T05:37:58.717228+0000","last_became_active":"2024-01-22T05:37:58.710803+0000","last_became_peered":"2024-01-22T05:37:58.710803+0000","last_unstale":"2024-01-22T05:37:58.717228+0000","last_undegraded":"2024-01-22T05:37:58.717228+0000","last_fullsized":"2024-01-22T05:37:58.717228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.720058+0000","last_change":"2024-01-22T05:37:58.252113+0000","last_active":"2024-01-22T05:37:58.720058+0000","last_peered":"2024-01-22T05:37:58.720058+0000","last_clean":"2024-01-22T05:37:58.720058+0000","last_became_active":"2024-01-22T05:37:58.251258+0000","last_became_peered":"2024-01-22T05:37:58.251258+0000","last_unstale":"2024-01-22T05:37:58.720058+0000","last_undegraded":"2024-01-22T05:37:58.720058+0000","last_fullsized":"2024-01-22T05:37:58.720058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.721993+0000","last_change":"2024-01-22T05:37:58.716869+0000","last_active":"2024-01-22T05:37:58.721993+0000","last_peered":"2024-01-22T05:37:58.721993+0000","last_clean":"2024-01-22T05:37:58.721993+0000","last_became_active":"2024-01-22T05:37:58.716086+0000","last_became_peered":"2024-01-22T05:37:58.716086+0000","last_unstale":"2024-01-22T05:37:58.721993+0000","last_undegraded":"2024-01-22T05:37:58.721993+0000","last_fullsized":"2024-01-22T05:37:58.721993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697140+0000","last_change":"2024-01-22T05:37:58.254343+0000","last_active":"2024-01-22T05:37:58.697140+0000","last_peered":"2024-01-22T05:37:58.697140+0000","last_clean":"2024-01-22T05:37:58.697140+0000","last_became_active":"2024-01-22T05:37:58.247951+0000","last_became_peered":"2024-01-22T05:37:58.247951+0000","last_unstale":"2024-01-22T05:37:58.697140+0000","last_undegraded":"2024-01-22T05:37:58.697140+0000","last_fullsized":"2024-01-22T05:37:58.697140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.712952+0000","last_change":"2024-01-22T05:37:58.711776+0000","last_active":"2024-01-22T05:37:58.712952+0000","last_peered":"2024-01-22T05:37:58.712952+0000","last_clean":"2024-01-22T05:37:58.712952+0000","last_became_active":"2024-01-22T05:37:58.711428+0000","last_became_peered":"2024-01-22T05:37:58.711428+0000","last_unstale":"2024-01-22T05:37:58.712952+0000","last_undegraded":"2024-01-22T05:37:58.712952+0000","last_fullsized":"2024-01-22T05:37:58.712952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729786+0000","last_change":"2024-01-22T05:37:58.264800+0000","last_active":"2024-01-22T05:37:58.729786+0000","last_peered":"2024-01-22T05:37:58.729786+0000","last_clean":"2024-01-22T05:37:58.729786+0000","last_became_active":"2024-01-22T05:37:58.264190+0000","last_became_peered":"2024-01-22T05:37:58.264190+0000","last_unstale":"2024-01-22T05:37:58.729786+0000","last_undegraded":"2024-01-22T05:37:58.729786+0000","last_fullsized":"2024-01-22T05:37:58.729786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732096+0000","last_change":"2024-01-22T05:37:58.724990+0000","last_active":"2024-01-22T05:37:58.732096+0000","last_peered":"2024-01-22T05:37:58.732096+0000","last_clean":"2024-01-22T05:37:58.732096+0000","last_became_active":"2024-01-22T05:37:58.724687+0000","last_became_peered":"2024-01-22T05:37:58.724687+0000","last_unstale":"2024-01-22T05:37:58.732096+0000","last_undegraded":"2024-01-22T05:37:58.732096+0000","last_fullsized":"2024-01-22T05:37:58.732096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696561+0000","last_change":"2024-01-22T05:37:58.257083+0000","last_active":"2024-01-22T05:37:58.696561+0000","last_peered":"2024-01-22T05:37:58.696561+0000","last_clean":"2024-01-22T05:37:58.696561+0000","last_became_active":"2024-01-22T05:37:58.256792+0000","last_became_peered":"2024-01-22T05:37:58.256792+0000","last_unstale":"2024-01-22T05:37:58.696561+0000","last_undegraded":"2024-01-22T05:37:58.696561+0000","last_fullsized":"2024-01-22T05:37:58.696561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727963+0000","last_change":"2024-01-22T05:37:58.724961+0000","last_active":"2024-01-22T05:37:58.727963+0000","last_peered":"2024-01-22T05:37:58.727963+0000","last_clean":"2024-01-22T05:37:58.727963+0000","last_became_active":"2024-01-22T05:37:58.724672+0000","last_became_peered":"2024-01-22T05:37:58.724672+0000","last_unstale":"2024-01-22T05:37:58.727963+0000","last_undegraded":"2024-01-22T05:37:58.727963+0000","last_fullsized":"2024-01-22T05:37:58.727963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.707872+0000","last_change":"2024-01-22T05:37:58.263297+0000","last_active":"2024-01-22T05:37:58.707872+0000","last_peered":"2024-01-22T05:37:58.707872+0000","last_clean":"2024-01-22T05:37:58.707872+0000","last_became_active":"2024-01-22T05:37:58.262968+0000","last_became_peered":"2024-01-22T05:37:58.262968+0000","last_unstale":"2024-01-22T05:37:58.707872+0000","last_undegraded":"2024-01-22T05:37:58.707872+0000","last_fullsized":"2024-01-22T05:37:58.707872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.732629+0000","last_change":"2024-01-22T05:37:58.729257+0000","last_active":"2024-01-22T05:37:58.732629+0000","last_peered":"2024-01-22T05:37:58.732629+0000","last_clean":"2024-01-22T05:37:58.732629+0000","last_became_active":"2024-01-22T05:37:58.728921+0000","last_became_peered":"2024-01-22T05:37:58.728921+0000","last_unstale":"2024-01-22T05:37:58.732629+0000","last_undegraded":"2024-01-22T05:37:58.732629+0000","last_fullsized":"2024-01-22T05:37:58.732629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729477+0000","last_change":"2024-01-22T05:37:58.251278+0000","last_active":"2024-01-22T05:37:58.729477+0000","last_peered":"2024-01-22T05:37:58.729477+0000","last_clean":"2024-01-22T05:37:58.729477+0000","last_became_active":"2024-01-22T05:37:58.251091+0000","last_became_peered":"2024-01-22T05:37:58.251091+0000","last_unstale":"2024-01-22T05:37:58.729477+0000","last_undegraded":"2024-01-22T05:37:58.729477+0000","last_fullsized":"2024-01-22T05:37:58.729477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709214+0000","last_change":"2024-01-22T05:37:58.705340+0000","last_active":"2024-01-22T05:37:58.709214+0000","last_peered":"2024-01-22T05:37:58.709214+0000","last_clean":"2024-01-22T05:37:58.709214+0000","last_became_active":"2024-01-22T05:37:58.703766+0000","last_became_peered":"2024-01-22T05:37:58.703766+0000","last_unstale":"2024-01-22T05:37:58.709214+0000","last_undegraded":"2024-01-22T05:37:58.709214+0000","last_fullsized":"2024-01-22T05:37:58.709214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696495+0000","last_change":"2024-01-22T05:37:58.254002+0000","last_active":"2024-01-22T05:37:58.696495+0000","last_peered":"2024-01-22T05:37:58.696495+0000","last_clean":"2024-01-22T05:37:58.696495+0000","last_became_active":"2024-01-22T05:37:58.253662+0000","last_became_peered":"2024-01-22T05:37:58.253662+0000","last_unstale":"2024-01-22T05:37:58.696495+0000","last_undegraded":"2024-01-22T05:37:58.696495+0000","last_fullsized":"2024-01-22T05:37:58.696495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709220+0000","last_change":"2024-01-22T05:37:58.704985+0000","last_active":"2024-01-22T05:37:58.709220+0000","last_peered":"2024-01-22T05:37:58.709220+0000","last_clean":"2024-01-22T05:37:58.709220+0000","last_became_active":"2024-01-22T05:37:58.704622+0000","last_became_peered":"2024-01-22T05:37:58.704622+0000","last_unstale":"2024-01-22T05:37:58.709220+0000","last_undegraded":"2024-01-22T05:37:58.709220+0000","last_fullsized":"2024-01-22T05:37:58.709220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700540+0000","last_change":"2024-01-22T05:37:58.255249+0000","last_active":"2024-01-22T05:37:58.700540+0000","last_peered":"2024-01-22T05:37:58.700540+0000","last_clean":"2024-01-22T05:37:58.700540+0000","last_became_active":"2024-01-22T05:37:58.254043+0000","last_became_peered":"2024-01-22T05:37:58.254043+0000","last_unstale":"2024-01-22T05:37:58.700540+0000","last_undegraded":"2024-01-22T05:37:58.700540+0000","last_fullsized":"2024-01-22T05:37:58.700540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727550+0000","last_change":"2024-01-22T05:37:58.721667+0000","last_active":"2024-01-22T05:37:58.727550+0000","last_peered":"2024-01-22T05:37:58.727550+0000","last_clean":"2024-01-22T05:37:58.727550+0000","last_became_active":"2024-01-22T05:37:58.720955+0000","last_became_peered":"2024-01-22T05:37:58.720955+0000","last_unstale":"2024-01-22T05:37:58.727550+0000","last_undegraded":"2024-01-22T05:37:58.727550+0000","last_fullsized":"2024-01-22T05:37:58.727550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719022+0000","last_change":"2024-01-22T05:37:58.257358+0000","last_active":"2024-01-22T05:37:58.719022+0000","last_peered":"2024-01-22T05:37:58.719022+0000","last_clean":"2024-01-22T05:37:58.719022+0000","last_became_active":"2024-01-22T05:37:58.256833+0000","last_became_peered":"2024-01-22T05:37:58.256833+0000","last_unstale":"2024-01-22T05:37:58.719022+0000","last_undegraded":"2024-01-22T05:37:58.719022+0000","last_fullsized":"2024-01-22T05:37:58.719022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729529+0000","last_change":"2024-01-22T05:37:58.724890+0000","last_active":"2024-01-22T05:37:58.729529+0000","last_peered":"2024-01-22T05:37:58.729529+0000","last_clean":"2024-01-22T05:37:58.729529+0000","last_became_active":"2024-01-22T05:37:58.724468+0000","last_became_peered":"2024-01-22T05:37:58.724468+0000","last_unstale":"2024-01-22T05:37:58.729529+0000","last_undegraded":"2024-01-22T05:37:58.729529+0000","last_fullsized":"2024-01-22T05:37:58.729529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729961+0000","last_change":"2024-01-22T05:37:58.260261+0000","last_active":"2024-01-22T05:37:58.729961+0000","last_peered":"2024-01-22T05:37:58.729961+0000","last_clean":"2024-01-22T05:37:58.729961+0000","last_became_active":"2024-01-22T05:37:58.259704+0000","last_became_peered":"2024-01-22T05:37:58.259704+0000","last_unstale":"2024-01-22T05:37:58.729961+0000","last_undegraded":"2024-01-22T05:37:58.729961+0000","last_fullsized":"2024-01-22T05:37:58.729961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.728107+0000","last_change":"2024-01-22T05:37:58.726130+0000","last_active":"2024-01-22T05:37:58.728107+0000","last_peered":"2024-01-22T05:37:58.728107+0000","last_clean":"2024-01-22T05:37:58.728107+0000","last_became_active":"2024-01-22T05:37:58.725859+0000","last_became_peered":"2024-01-22T05:37:58.725859+0000","last_unstale":"2024-01-22T05:37:58.728107+0000","last_undegraded":"2024-01-22T05:37:58.728107+0000","last_fullsized":"2024-01-22T05:37:58.728107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.697755+0000","last_change":"2024-01-22T05:37:58.264803+0000","last_active":"2024-01-22T05:37:58.697755+0000","last_peered":"2024-01-22T05:37:58.697755+0000","last_clean":"2024-01-22T05:37:58.697755+0000","last_became_active":"2024-01-22T05:37:58.264462+0000","last_became_peered":"2024-01-22T05:37:58.264462+0000","last_unstale":"2024-01-22T05:37:58.697755+0000","last_undegraded":"2024-01-22T05:37:58.697755+0000","last_fullsized":"2024-01-22T05:37:58.697755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724696+0000","last_change":"2024-01-22T05:37:58.712538+0000","last_active":"2024-01-22T05:37:58.724696+0000","last_peered":"2024-01-22T05:37:58.724696+0000","last_clean":"2024-01-22T05:37:58.724696+0000","last_became_active":"2024-01-22T05:37:58.712227+0000","last_became_peered":"2024-01-22T05:37:58.712227+0000","last_unstale":"2024-01-22T05:37:58.724696+0000","last_undegraded":"2024-01-22T05:37:58.724696+0000","last_fullsized":"2024-01-22T05:37:58.724696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.700878+0000","last_change":"2024-01-22T05:37:58.250185+0000","last_active":"2024-01-22T05:37:58.700878+0000","last_peered":"2024-01-22T05:37:58.700878+0000","last_clean":"2024-01-22T05:37:58.700878+0000","last_became_active":"2024-01-22T05:37:58.249870+0000","last_became_peered":"2024-01-22T05:37:58.249870+0000","last_unstale":"2024-01-22T05:37:58.700878+0000","last_undegraded":"2024-01-22T05:37:58.700878+0000","last_fullsized":"2024-01-22T05:37:58.700878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.719474+0000","last_change":"2024-01-22T05:37:58.708704+0000","last_active":"2024-01-22T05:37:58.719474+0000","last_peered":"2024-01-22T05:37:58.719474+0000","last_clean":"2024-01-22T05:37:58.719474+0000","last_became_active":"2024-01-22T05:37:58.708449+0000","last_became_peered":"2024-01-22T05:37:58.708449+0000","last_unstale":"2024-01-22T05:37:58.719474+0000","last_undegraded":"2024-01-22T05:37:58.719474+0000","last_fullsized":"2024-01-22T05:37:58.719474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.690119+0000","last_change":"2024-01-22T05:37:58.246767+0000","last_active":"2024-01-22T05:37:58.690119+0000","last_peered":"2024-01-22T05:37:58.690119+0000","last_clean":"2024-01-22T05:37:58.690119+0000","last_became_active":"2024-01-22T05:37:58.245978+0000","last_became_peered":"2024-01-22T05:37:58.245978+0000","last_unstale":"2024-01-22T05:37:58.690119+0000","last_undegraded":"2024-01-22T05:37:58.690119+0000","last_fullsized":"2024-01-22T05:37:58.690119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727646+0000","last_change":"2024-01-22T05:37:58.721568+0000","last_active":"2024-01-22T05:37:58.727646+0000","last_peered":"2024-01-22T05:37:58.727646+0000","last_clean":"2024-01-22T05:37:58.727646+0000","last_became_active":"2024-01-22T05:37:58.720320+0000","last_became_peered":"2024-01-22T05:37:58.720320+0000","last_unstale":"2024-01-22T05:37:58.727646+0000","last_undegraded":"2024-01-22T05:37:58.727646+0000","last_fullsized":"2024-01-22T05:37:58.727646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.702410+0000","last_change":"2024-01-22T05:37:58.254018+0000","last_active":"2024-01-22T05:37:58.702410+0000","last_peered":"2024-01-22T05:37:58.702410+0000","last_clean":"2024-01-22T05:37:58.702410+0000","last_became_active":"2024-01-22T05:37:58.253663+0000","last_became_peered":"2024-01-22T05:37:58.253663+0000","last_unstale":"2024-01-22T05:37:58.702410+0000","last_undegraded":"2024-01-22T05:37:58.702410+0000","last_fullsized":"2024-01-22T05:37:58.702410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727129+0000","last_change":"2024-01-22T05:37:58.722202+0000","last_active":"2024-01-22T05:37:58.727129+0000","last_peered":"2024-01-22T05:37:58.727129+0000","last_clean":"2024-01-22T05:37:58.727129+0000","last_became_active":"2024-01-22T05:37:58.721929+0000","last_became_peered":"2024-01-22T05:37:58.721929+0000","last_unstale":"2024-01-22T05:37:58.727129+0000","last_undegraded":"2024-01-22T05:37:58.727129+0000","last_fullsized":"2024-01-22T05:37:58.727129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.696216+0000","last_change":"2024-01-22T05:37:58.249353+0000","last_active":"2024-01-22T05:37:58.696216+0000","last_peered":"2024-01-22T05:37:58.696216+0000","last_clean":"2024-01-22T05:37:58.696216+0000","last_became_active":"2024-01-22T05:37:58.247936+0000","last_became_peered":"2024-01-22T05:37:58.247936+0000","last_unstale":"2024-01-22T05:37:58.696216+0000","last_undegraded":"2024-01-22T05:37:58.696216+0000","last_fullsized":"2024-01-22T05:37:58.696216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.729390+0000","last_change":"2024-01-22T05:37:58.725363+0000","last_active":"2024-01-22T05:37:58.729390+0000","last_peered":"2024-01-22T05:37:58.729390+0000","last_clean":"2024-01-22T05:37:58.729390+0000","last_became_active":"2024-01-22T05:37:58.725165+0000","last_became_peered":"2024-01-22T05:37:58.725165+0000","last_unstale":"2024-01-22T05:37:58.729390+0000","last_undegraded":"2024-01-22T05:37:58.729390+0000","last_fullsized":"2024-01-22T05:37:58.729390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.714350+0000","last_change":"2024-01-22T05:37:58.259249+0000","last_active":"2024-01-22T05:37:58.714350+0000","last_peered":"2024-01-22T05:37:58.714350+0000","last_clean":"2024-01-22T05:37:58.714350+0000","last_became_active":"2024-01-22T05:37:58.258966+0000","last_became_peered":"2024-01-22T05:37:58.258966+0000","last_unstale":"2024-01-22T05:37:58.714350+0000","last_undegraded":"2024-01-22T05:37:58.714350+0000","last_fullsized":"2024-01-22T05:37:58.714350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.718454+0000","last_change":"2024-01-22T05:37:58.706730+0000","last_active":"2024-01-22T05:37:58.718454+0000","last_peered":"2024-01-22T05:37:58.718454+0000","last_clean":"2024-01-22T05:37:58.718454+0000","last_became_active":"2024-01-22T05:37:58.706540+0000","last_became_peered":"2024-01-22T05:37:58.706540+0000","last_unstale":"2024-01-22T05:37:58.718454+0000","last_undegraded":"2024-01-22T05:37:58.718454+0000","last_fullsized":"2024-01-22T05:37:58.718454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723490+0000","last_change":"2024-01-22T05:37:58.260703+0000","last_active":"2024-01-22T05:37:58.723490+0000","last_peered":"2024-01-22T05:37:58.723490+0000","last_clean":"2024-01-22T05:37:58.723490+0000","last_became_active":"2024-01-22T05:37:58.255191+0000","last_became_peered":"2024-01-22T05:37:58.255191+0000","last_unstale":"2024-01-22T05:37:58.723490+0000","last_undegraded":"2024-01-22T05:37:58.723490+0000","last_fullsized":"2024-01-22T05:37:58.723490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.727300+0000","last_change":"2024-01-22T05:37:58.720676+0000","last_active":"2024-01-22T05:37:58.727300+0000","last_peered":"2024-01-22T05:37:58.727300+0000","last_clean":"2024-01-22T05:37:58.727300+0000","last_became_active":"2024-01-22T05:37:58.720340+0000","last_became_peered":"2024-01-22T05:37:58.720340+0000","last_unstale":"2024-01-22T05:37:58.727300+0000","last_undegraded":"2024-01-22T05:37:58.727300+0000","last_fullsized":"2024-01-22T05:37:58.727300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724060+0000","last_change":"2024-01-22T05:37:58.252332+0000","last_active":"2024-01-22T05:37:58.724060+0000","last_peered":"2024-01-22T05:37:58.724060+0000","last_clean":"2024-01-22T05:37:58.724060+0000","last_became_active":"2024-01-22T05:37:58.251974+0000","last_became_peered":"2024-01-22T05:37:58.251974+0000","last_unstale":"2024-01-22T05:37:58.724060+0000","last_undegraded":"2024-01-22T05:37:58.724060+0000","last_fullsized":"2024-01-22T05:37:58.724060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.722376+0000","last_change":"2024-01-22T05:37:58.710217+0000","last_active":"2024-01-22T05:37:58.722376+0000","last_peered":"2024-01-22T05:37:58.722376+0000","last_clean":"2024-01-22T05:37:58.722376+0000","last_became_active":"2024-01-22T05:37:58.708965+0000","last_became_peered":"2024-01-22T05:37:58.708965+0000","last_unstale":"2024-01-22T05:37:58.722376+0000","last_undegraded":"2024-01-22T05:37:58.722376+0000","last_fullsized":"2024-01-22T05:37:58.722376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.710339+0000","last_change":"2024-01-22T05:37:58.251023+0000","last_active":"2024-01-22T05:37:58.710339+0000","last_peered":"2024-01-22T05:37:58.710339+0000","last_clean":"2024-01-22T05:37:58.710339+0000","last_became_active":"2024-01-22T05:37:58.250678+0000","last_became_peered":"2024-01-22T05:37:58.250678+0000","last_unstale":"2024-01-22T05:37:58.710339+0000","last_undegraded":"2024-01-22T05:37:58.710339+0000","last_fullsized":"2024-01-22T05:37:58.710339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.723126+0000","last_change":"2024-01-22T05:37:58.710302+0000","last_active":"2024-01-22T05:37:58.723126+0000","last_peered":"2024-01-22T05:37:58.723126+0000","last_clean":"2024-01-22T05:37:58.723126+0000","last_became_active":"2024-01-22T05:37:58.709580+0000","last_became_peered":"2024-01-22T05:37:58.709580+0000","last_unstale":"2024-01-22T05:37:58.723126+0000","last_undegraded":"2024-01-22T05:37:58.723126+0000","last_fullsized":"2024-01-22T05:37:58.723126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.709432+0000","last_change":"2024-01-22T05:37:58.251159+0000","last_active":"2024-01-22T05:37:58.709432+0000","last_peered":"2024-01-22T05:37:58.709432+0000","last_clean":"2024-01-22T05:37:58.709432+0000","last_became_active":"2024-01-22T05:37:58.250824+0000","last_became_peered":"2024-01-22T05:37:58.250824+0000","last_unstale":"2024-01-22T05:37:58.709432+0000","last_undegraded":"2024-01-22T05:37:58.709432+0000","last_fullsized":"2024-01-22T05:37:58.709432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.705513+0000","last_change":"2024-01-22T05:37:58.698080+0000","last_active":"2024-01-22T05:37:58.705513+0000","last_peered":"2024-01-22T05:37:58.705513+0000","last_clean":"2024-01-22T05:37:58.705513+0000","last_became_active":"2024-01-22T05:37:58.697818+0000","last_became_peered":"2024-01-22T05:37:58.697818+0000","last_unstale":"2024-01-22T05:37:58.705513+0000","last_undegraded":"2024-01-22T05:37:58.705513+0000","last_fullsized":"2024-01-22T05:37:58.705513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:58.219613+0000","last_clean_scrub_stamp":"2024-01-22T05:37:58.219613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-22T05:37:58.724005+0000","last_change":"2024-01-22T05:37:58.264651+0000","last_active":"2024-01-22T05:37:58.724005+0000","last_peered":"2024-01-22T05:37:58.724005+0000","last_clean":"2024-01-22T05:37:58.724005+0000","last_became_active":"2024-01-22T05:37:58.264021+0000","last_became_peered":"2024-01-22T05:37:58.264021+0000","last_unstale":"2024-01-22T05:37:58.724005+0000","last_undegraded":"2024-01-22T05:37:58.724005+0000","last_fullsized":"2024-01-22T05:37:58.724005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:57.213781+0000","last_clean_scrub_stamp":"2024-01-22T05:37:57.213781+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":84071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":83801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:38:11.816 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-22T05:38:11.816 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-22T05:38:11.816 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-22T05:38:11.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-22T05:38:12.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.033+0000 7fa926a00700 1 Processor -- start 2024-01-22T05:38:12.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.033+0000 7fa926a00700 1 -- start start 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa926a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa920153ff0 0x7fa9201543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa926a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9200c5cd0 0x7fa9200c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa926a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9200a9d30 0x7fa9200aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa926a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200aa6d0 con 0x7fa9200c5cd0 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa926a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200c66e0 con 0x7fa920153ff0 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa926a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200c0750 con 0x7fa9200a9d30 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa91f400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9200c5cd0 0x7fa9200c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa91f400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9200c5cd0 0x7fa9200c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55368/0 (socket says 172.21.15.100:55368) 2024-01-22T05:38:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa91f400700 1 -- 172.21.15.100:0/2715137144 learned_addr learned my addr 172.21.15.100:0/2715137144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa924a00700 1 --2- 172.21.15.100:0/2715137144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9200a9d30 0x7fa9200aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.034+0000 7fa91fe00700 1 --2- 172.21.15.100:0/2715137144 >> v2:172.21.15.169:3300/0 conn(0x7fa920153ff0 0x7fa9201543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91f400700 1 -- 172.21.15.100:0/2715137144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9200a9d30 msgr2=0x7fa9200aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91f400700 1 --2- 172.21.15.100:0/2715137144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9200a9d30 0x7fa9200aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91f400700 1 -- 172.21.15.100:0/2715137144 >> v2:172.21.15.169:3300/0 conn(0x7fa920153ff0 msgr2=0x7fa9201543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91f400700 1 --2- 172.21.15.100:0/2715137144 >> v2:172.21.15.169:3300/0 conn(0x7fa920153ff0 0x7fa9201543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91f400700 1 -- 172.21.15.100:0/2715137144 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200bfe20 con 0x7fa9200c5cd0 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91f400700 1 --2- 172.21.15.100:0/2715137144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200c5cd0 0x7fa9200c6150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa920083710 tx=0x7fa9080090f0).ready entity=mon.0 client_cookie=b7b22984c4c1d910 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91ea00700 1 -- 172.21.15.100:0/2715137144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90800f510 con 0x7fa9200c5cd0 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91ea00700 1 -- 172.21.15.100:0/2715137144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90800f670 con 0x7fa9200c5cd0 2024-01-22T05:38:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.035+0000 7fa91ea00700 1 -- 172.21.15.100:0/2715137144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90800fa10 con 0x7fa9200c5cd0 2024-01-22T05:38:12.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 -- 172.21.15.100:0/2715137144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200c5cd0 msgr2=0x7fa9200c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 --2- 172.21.15.100:0/2715137144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200c5cd0 0x7fa9200c6150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa920083710 tx=0x7fa9080090f0).stop 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 -- 172.21.15.100:0/2715137144 shutdown_connections 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 --2- 172.21.15.100:0/2715137144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9200a9d30 0x7fa9200aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 --2- 172.21.15.100:0/2715137144 >> v2:172.21.15.169:3300/0 conn(0x7fa920153ff0 0x7fa9201543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 --2- 172.21.15.100:0/2715137144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200c5cd0 0x7fa9200c6150 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 -- 172.21.15.100:0/2715137144 >> 172.21.15.100:0/2715137144 conn(0x7fa9200c82a0 msgr2=0x7fa92005e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 -- 172.21.15.100:0/2715137144 shutdown_connections 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.036+0000 7fa926a00700 1 -- 172.21.15.100:0/2715137144 wait complete. 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.037+0000 7fa926a00700 1 Processor -- start 2024-01-22T05:38:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.037+0000 7fa926a00700 1 -- start start 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa926a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200a9d30 0x7fa92014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa926a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9200c5cd0 0x7fa9200c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa926a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa920153ff0 0x7fa9200b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa926a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200c2b70 con 0x7fa9200a9d30 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa926a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92014c8b0 con 0x7fa9200c5cd0 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa926a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200c1f60 con 0x7fa920153ff0 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa91fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200a9d30 0x7fa92014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa91fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200a9d30 0x7fa92014c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55376/0 (socket says 172.21.15.100:55376) 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.038+0000 7fa91fe00700 1 -- 172.21.15.100:0/1167388169 learned_addr learned my addr 172.21.15.100:0/1167388169 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa91f400700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9200c5cd0 0x7fa9200c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa924a00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa920153ff0 0x7fa9200b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa91fe00700 1 -- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa920153ff0 msgr2=0x7fa9200b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa91fe00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa920153ff0 0x7fa9200b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa91fe00700 1 -- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9200c5cd0 msgr2=0x7fa9200c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa91fe00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9200c5cd0 0x7fa9200c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa91fe00700 1 -- 172.21.15.100:0/1167388169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908009370 con 0x7fa9200a9d30 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa91fe00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200a9d30 0x7fa92014c3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa91000e930 tx=0x7fa910009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa917400700 1 -- 172.21.15.100:0/1167388169 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910012600 con 0x7fa9200a9d30 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa917400700 1 -- 172.21.15.100:0/1167388169 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa910012760 con 0x7fa9200a9d30 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa917400700 1 -- 172.21.15.100:0/1167388169 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910012ae0 con 0x7fa9200a9d30 2024-01-22T05:38:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9200c2240 con 0x7fa9200a9d30 2024-01-22T05:38:12.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.039+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9200c2800 con 0x7fa9200a9d30 2024-01-22T05:38:12.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.041+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9200c2e50 con 0x7fa9200a9d30 2024-01-22T05:38:12.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.041+0000 7fa917400700 1 -- 172.21.15.100:0/1167388169 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa91001b400 con 0x7fa9200a9d30 2024-01-22T05:38:12.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.042+0000 7fa917400700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa8f805f150 0x7fa8f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.042+0000 7fa917400700 1 -- 172.21.15.100:0/1167388169 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa91007a700 con 0x7fa9200a9d30 2024-01-22T05:38:12.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.042+0000 7fa91f400700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa8f805f150 0x7fa8f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.043+0000 7fa91f400700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa8f805f150 0x7fa8f8061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa920083710 tx=0x7fa908017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.046+0000 7fa917400700 1 -- 172.21.15.100:0/1167388169 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa91004b8b0 con 0x7fa9200a9d30 2024-01-22T05:38:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.254+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa92005fdb0 con 0x7fa9200a9d30 2024-01-22T05:38:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.254+0000 7fa917400700 1 -- 172.21.15.100:0/1167388169 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fa91004eed0 con 0x7fa9200a9d30 2024-01-22T05:38:12.254 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.256+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa8f805f150 msgr2=0x7fa8f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.256+0000 7fa926a00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa8f805f150 0x7fa8f8061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa920083710 tx=0x7fa908017000).stop 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.256+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200a9d30 msgr2=0x7fa92014c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.256+0000 7fa926a00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200a9d30 0x7fa92014c3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa91000e930 tx=0x7fa910009060).stop 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.256+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 shutdown_connections 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.257+0000 7fa926a00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa8f805f150 0x7fa8f8061610 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.257+0000 7fa926a00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa920153ff0 0x7fa9200b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.257+0000 7fa926a00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9200a9d30 0x7fa92014c3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.257+0000 7fa926a00700 1 --2- 172.21.15.100:0/1167388169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9200c5cd0 0x7fa9200c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.257+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 >> 172.21.15.100:0/1167388169 conn(0x7fa9200c82a0 msgr2=0x7fa9200c0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.257+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 shutdown_connections 2024-01-22T05:38:12.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.257+0000 7fa926a00700 1 -- 172.21.15.100:0/1167388169 wait complete. 2024-01-22T05:38:12.273 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-22T05:38:12.274 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-22T05:38:12.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:12.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.457+0000 7fa699200700 1 Processor -- start 2024-01-22T05:38:12.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.458+0000 7fa699200700 1 -- start start 2024-01-22T05:38:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa699200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 0x7fa6941543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa699200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940c66e0 con 0x7fa6940c5cd0 2024-01-22T05:38:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa699200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940c0750 con 0x7fa6940aa440 2024-01-22T05:38:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa699200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940bfe20 con 0x7fa694153ff0 2024-01-22T05:38:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa691400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa6940c5cd0 0x7fa6940a9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41254/0 (socket says 172.21.15.100:41254) 2024-01-22T05:38:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa691400700 1 -- 172.21.15.100:0/2810860278 learned_addr learned my addr 172.21.15.100:0/2810860278 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa691e00700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 0x7fa6941543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015494547 0 0) 0x7fa6940c66e0 con 0x7fa6940c5cd0 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.459+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6740033f0 con 0x7fa6940c5cd0 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2094299076 0 0) 0x7fa6740033f0 con 0x7fa6940c5cd0 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 msgr2=0x7fa6941543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 0x7fa6941543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 >> v1:172.21.15.169:6789/0 conn(0x7fa6940aa440 legacy=0x7fa6940c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940c0100 con 0x7fa6940c5cd0 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fa67c001470 con 0x7fa6940c5cd0 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 >> v1:172.21.15.100:6789/0 conn(0x7fa6940c5cd0 legacy=0x7fa6940a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa674003910 0x7fa674003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa674004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 0x7fa674005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940bfe20 con 0x7fa674004690 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67400b910 con 0x7fa674003910 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67400bad0 con 0x7fa694153ff0 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa691400700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa674004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa691e00700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa674003910 0x7fa674003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.460+0000 7fa692800700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 0x7fa674005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa691400700 1 -- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 msgr2=0x7fa674005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa691400700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 0x7fa674005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa691400700 1 -- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa674003910 msgr2=0x7fa674003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa691400700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa674003910 0x7fa674003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa691400700 1 -- 172.21.15.100:0/2810860278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740033f0 con 0x7fa674004690 2024-01-22T05:38:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa692800700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa694153ff0 0x7fa674005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa691400700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa674004b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa67c00c160 tx=0x7fa67c001e50).ready entity=mon.0 client_cookie=f6e5d5b3faceb16c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c007a20 con 0x7fa674004690 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c00ca90 con 0x7fa674004690 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa690a00700 1 -- 172.21.15.100:0/2810860278 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00ce10 con 0x7fa674004690 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa699200700 1 -- 172.21.15.100:0/2810860278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 msgr2=0x7fa674004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa699200700 1 --2- 172.21.15.100:0/2810860278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa674004b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa67c00c160 tx=0x7fa67c001e50).stop 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.461+0000 7fa692800700 1 -- 172.21.15.100:0/2810860278 reap_dead start 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.462+0000 7fa699200700 1 -- 172.21.15.100:0/2810860278 shutdown_connections 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.462+0000 7fa699200700 1 -- 172.21.15.100:0/2810860278 >> 172.21.15.100:0/2810860278 conn(0x7fa6940c82a0 msgr2=0x7fa69405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.462+0000 7fa699200700 1 -- 172.21.15.100:0/2810860278 shutdown_connections 2024-01-22T05:38:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.462+0000 7fa699200700 1 -- 172.21.15.100:0/2810860278 wait complete. 2024-01-22T05:38:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.463+0000 7fa699200700 1 Processor -- start 2024-01-22T05:38:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.463+0000 7fa699200700 1 -- start start 2024-01-22T05:38:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa699200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa6940c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa699200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa69414ea70 0x7fa6940afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa699200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69414eef0 0x7fa6940b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa699200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940aee20 con 0x7fa674004690 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa699200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940af100 con 0x7fa69414eef0 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa699200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940af3e0 con 0x7fa69414ea70 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa691e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa6940c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa691e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa6940c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55386/0 (socket says 172.21.15.100:55386) 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.464+0000 7fa691e00700 1 -- 172.21.15.100:0/3156325806 learned_addr learned my addr 172.21.15.100:0/3156325806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa692800700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69414eef0 0x7fa6940b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa691400700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa69414ea70 0x7fa6940afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa691e00700 1 -- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa69414ea70 msgr2=0x7fa6940afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa691e00700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa69414ea70 0x7fa6940afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa691e00700 1 -- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69414eef0 msgr2=0x7fa6940b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa691e00700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69414eef0 0x7fa6940b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa691e00700 1 -- 172.21.15.100:0/3156325806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940af6c0 con 0x7fa674004690 2024-01-22T05:38:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa691e00700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa6940c1e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa6840119f0 tx=0x7fa684009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa689600700 1 -- 172.21.15.100:0/3156325806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684009560 con 0x7fa674004690 2024-01-22T05:38:12.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa689600700 1 -- 172.21.15.100:0/3156325806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400f940 con 0x7fa674004690 2024-01-22T05:38:12.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940af9a0 con 0x7fa674004690 2024-01-22T05:38:12.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa689600700 1 -- 172.21.15.100:0/3156325806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400fcc0 con 0x7fa674004690 2024-01-22T05:38:12.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.465+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6940c38d0 con 0x7fa674004690 2024-01-22T05:38:12.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.466+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69405fdb0 con 0x7fa674004690 2024-01-22T05:38:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.467+0000 7fa689600700 1 -- 172.21.15.100:0/3156325806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa684014650 con 0x7fa674004690 2024-01-22T05:38:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.468+0000 7fa689600700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa66c05f150 0x7fa66c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.468+0000 7fa689600700 1 -- 172.21.15.100:0/3156325806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa68407ae70 con 0x7fa674004690 2024-01-22T05:38:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.468+0000 7fa691400700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa66c05f150 0x7fa66c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.468+0000 7fa691400700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa66c05f150 0x7fa66c061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa69414f950 tx=0x7fa67c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.472+0000 7fa689600700 1 -- 172.21.15.100:0/3156325806 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa68404c080 con 0x7fa674004690 2024-01-22T05:38:12.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.643+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6940afd10 con 0x7fa674004690 2024-01-22T05:38:12.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.644+0000 7fa689600700 1 -- 172.21.15.100:0/3156325806 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fa68404f6a0 con 0x7fa674004690 2024-01-22T05:38:12.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:12.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa66c05f150 msgr2=0x7fa66c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa66c05f150 0x7fa66c061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa69414f950 tx=0x7fa67c015000).stop 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 msgr2=0x7fa6940c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa6940c1e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa6840119f0 tx=0x7fa684009060).stop 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 shutdown_connections 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa66c05f150 0x7fa66c061610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69414eef0 0x7fa6940b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674004690 0x7fa6940c1e30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 --2- 172.21.15.100:0/3156325806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa69414ea70 0x7fa6940afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 >> 172.21.15.100:0/3156325806 conn(0x7fa6940c82a0 msgr2=0x7fa6940abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 shutdown_connections 2024-01-22T05:38:12.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.646+0000 7fa699200700 1 -- 172.21.15.100:0/3156325806 wait complete. 2024-01-22T05:38:12.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:37:56.837820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:37:57.667310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:38:12.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:12.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.851+0000 7f2db4800700 1 Processor -- start 2024-01-22T05:38:12.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.851+0000 7f2db4800700 1 -- start start 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db4800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2dac157d80 0x7f2dac158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db4800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0c1a40 con 0x7f2dac1586f0 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db4800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0cbd30 con 0x7f2dac154260 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db4800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac158b80 con 0x7f2dac157d80 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db2800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2dac1586f0 0x7f2dac0c8c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41266/0 (socket says 172.21.15.100:41266) 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db2800700 1 -- 172.21.15.100:0/4060600862 learned_addr learned my addr 172.21.15.100:0/4060600862 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db1400700 1 --2- 172.21.15.100:0/4060600862 >> v2:172.21.15.169:3300/0 conn(0x7f2dac157d80 0x7f2dac158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db0a00700 1 -- 172.21.15.100:0/4060600862 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248480836 0 0) 0x7f2dac0c1a40 con 0x7f2dac1586f0 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db0a00700 1 -- 172.21.15.100:0/4060600862 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d8c0033f0 con 0x7f2dac1586f0 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db1400700 1 -- 172.21.15.100:0/4060600862 >> v1:172.21.15.169:6789/0 conn(0x7f2dac154260 legacy=0x7f2dac0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db1400700 1 -- 172.21.15.100:0/4060600862 >> v1:172.21.15.100:6789/0 conn(0x7f2dac1586f0 legacy=0x7f2dac0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.853+0000 7f2db1400700 1 -- 172.21.15.100:0/4060600862 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0c1110 con 0x7f2dac157d80 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.854+0000 7f2db1400700 1 --2- 172.21.15.100:0/4060600862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 0x7f2dac158200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2d94009760 tx=0x7f2d94009060).ready entity=mon.1 client_cookie=8582f7d91cb20438 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.854+0000 7f2db0a00700 1 -- 172.21.15.100:0/4060600862 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400f510 con 0x7f2dac157d80 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.854+0000 7f2db0a00700 1 -- 172.21.15.100:0/4060600862 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400f670 con 0x7f2dac157d80 2024-01-22T05:38:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.854+0000 7f2db0a00700 1 -- 172.21.15.100:0/4060600862 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400f9f0 con 0x7f2dac157d80 2024-01-22T05:38:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.854+0000 7f2db4800700 1 -- 172.21.15.100:0/4060600862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 msgr2=0x7f2dac158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.854+0000 7f2db4800700 1 --2- 172.21.15.100:0/4060600862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 0x7f2dac158200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2d94009760 tx=0x7f2d94009060).stop 2024-01-22T05:38:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.854+0000 7f2db4800700 1 -- 172.21.15.100:0/4060600862 shutdown_connections 2024-01-22T05:38:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.855+0000 7f2db4800700 1 --2- 172.21.15.100:0/4060600862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 0x7f2dac158200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.855+0000 7f2db4800700 1 -- 172.21.15.100:0/4060600862 >> 172.21.15.100:0/4060600862 conn(0x7f2dac05e9d0 msgr2=0x7f2dac0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.855+0000 7f2db4800700 1 -- 172.21.15.100:0/4060600862 shutdown_connections 2024-01-22T05:38:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.855+0000 7f2db4800700 1 -- 172.21.15.100:0/4060600862 wait complete. 2024-01-22T05:38:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.856+0000 7f2db4800700 1 Processor -- start 2024-01-22T05:38:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.856+0000 7f2db4800700 1 -- start start 2024-01-22T05:38:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db4800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dac154260 0x7f2dac0ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db4800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 0x7f2dac0aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db4800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac1586f0 0x7f2dac0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db4800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac151440 con 0x7f2dac1586f0 2024-01-22T05:38:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db4800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0ae830 con 0x7f2dac157d80 2024-01-22T05:38:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db4800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac168d00 con 0x7f2dac154260 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db2800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac1586f0 0x7f2dac0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db2800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac1586f0 0x7f2dac0af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55392/0 (socket says 172.21.15.100:55392) 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db2800700 1 -- 172.21.15.100:0/3467151791 learned_addr learned my addr 172.21.15.100:0/3467151791 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db1400700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 0x7f2dac0aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.857+0000 7f2db1e00700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dac154260 0x7f2dac0ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db2800700 1 -- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dac154260 msgr2=0x7f2dac0ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db2800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dac154260 0x7f2dac0ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db2800700 1 -- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 msgr2=0x7f2dac0aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db2800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 0x7f2dac0aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db2800700 1 -- 172.21.15.100:0/3467151791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940092a0 con 0x7f2dac1586f0 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db2800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac1586f0 0x7f2dac0af1b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2da400c770 tx=0x7f2da40015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2da9600700 1 -- 172.21.15.100:0/3467151791 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4005d30 con 0x7f2dac1586f0 2024-01-22T05:38:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2da9600700 1 -- 172.21.15.100:0/3467151791 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da4005e90 con 0x7f2dac1586f0 2024-01-22T05:38:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac0adf00 con 0x7f2dac1586f0 2024-01-22T05:38:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2da9600700 1 -- 172.21.15.100:0/3467151791 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4007320 con 0x7f2dac1586f0 2024-01-22T05:38:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.858+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac0ae4c0 con 0x7f2dac1586f0 2024-01-22T05:38:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.859+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac05fdb0 con 0x7f2dac1586f0 2024-01-22T05:38:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.860+0000 7f2da9600700 1 -- 172.21.15.100:0/3467151791 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2da4007710 con 0x7f2dac1586f0 2024-01-22T05:38:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.861+0000 7f2da9600700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d8405f150 0x7f2d84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.861+0000 7f2da9600700 1 -- 172.21.15.100:0/3467151791 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2da407a210 con 0x7f2dac1586f0 2024-01-22T05:38:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.861+0000 7f2db1e00700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d8405f150 0x7f2d84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.862+0000 7f2db1e00700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d8405f150 0x7f2d84061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2d9c000fb0 tx=0x7f2d9c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:12.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:12.865+0000 7f2da9600700 1 -- 172.21.15.100:0/3467151791 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2da404b520 con 0x7f2dac1586f0 2024-01-22T05:38:13.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.036+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2dac084940 con 0x7f2dac1586f0 2024-01-22T05:38:13.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.036+0000 7f2da9600700 1 -- 172.21.15.100:0/3467151791 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2da404eb40 con 0x7f2dac1586f0 2024-01-22T05:38:13.036 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d8405f150 msgr2=0x7f2d84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d8405f150 0x7f2d84061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2d9c000fb0 tx=0x7f2d9c009040).stop 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac1586f0 msgr2=0x7f2dac0af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac1586f0 0x7f2dac0af1b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2da400c770 tx=0x7f2da40015b0).stop 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 shutdown_connections 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d8405f150 0x7f2d84061610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac1586f0 0x7f2dac0af1b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dac154260 0x7f2dac0ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 --2- 172.21.15.100:0/3467151791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dac157d80 0x7f2dac0aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.038+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 >> 172.21.15.100:0/3467151791 conn(0x7f2dac05e9d0 msgr2=0x7f2dac064600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.039+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 shutdown_connections 2024-01-22T05:38:13.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.039+0000 7f2db4800700 1 -- 172.21.15.100:0/3467151791 wait complete. 2024-01-22T05:38:13.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.242+0000 7f3d87800700 1 Processor -- start 2024-01-22T05:38:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.243+0000 7f3d87800700 1 -- start start 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d87800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d800a9f60 0x7f3d800aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d87800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3d800c1940 0x7f3d800ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d87800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800c74b0 con 0x7f3d8005e1f0 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d87800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800cab90 con 0x7f3d800a9f60 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d87800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d80158660 con 0x7f3d800c1940 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d84e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d800a9f60 0x7f3d800aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d84e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d800a9f60 0x7f3d800aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33304/0 (socket says 172.21.15.100:33304) 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d84e00700 1 -- 172.21.15.100:0/3632447137 learned_addr learned my addr 172.21.15.100:0/3632447137 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d7fe00700 1 --2- 172.21.15.100:0/3632447137 >> v2:172.21.15.169:3300/0 conn(0x7f3d800c1940 0x7f3d800ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d84e00700 1 -- 172.21.15.100:0/3632447137 >> v2:172.21.15.169:3300/0 conn(0x7f3d800c1940 msgr2=0x7f3d800ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.244+0000 7f3d84e00700 1 --2- 172.21.15.100:0/3632447137 >> v2:172.21.15.169:3300/0 conn(0x7f3d800c1940 0x7f3d800ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d84e00700 1 -- 172.21.15.100:0/3632447137 >> v1:172.21.15.169:6789/0 conn(0x7f3d8005e1f0 legacy=0x7f3d80098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d84e00700 1 -- 172.21.15.100:0/3632447137 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80158940 con 0x7f3d800a9f60 2024-01-22T05:38:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d84e00700 1 --2- 172.21.15.100:0/3632447137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800aa340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3d800c88d0 tx=0x7f3d700090f0).ready entity=mon.0 client_cookie=16f7288e9d32fde6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d7f400700 1 -- 172.21.15.100:0/3632447137 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000b600 con 0x7f3d800a9f60 2024-01-22T05:38:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d7f400700 1 -- 172.21.15.100:0/3632447137 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7000b760 con 0x7f3d800a9f60 2024-01-22T05:38:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d7f400700 1 -- 172.21.15.100:0/3632447137 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000bae0 con 0x7f3d800a9f60 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d87800700 1 -- 172.21.15.100:0/3632447137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 msgr2=0x7f3d800aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d87800700 1 --2- 172.21.15.100:0/3632447137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800aa340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3d800c88d0 tx=0x7f3d700090f0).stop 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d87800700 1 -- 172.21.15.100:0/3632447137 shutdown_connections 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d87800700 1 --2- 172.21.15.100:0/3632447137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800aa340 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d87800700 1 --2- 172.21.15.100:0/3632447137 >> v2:172.21.15.169:3300/0 conn(0x7f3d800c1940 0x7f3d800ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.245+0000 7f3d87800700 1 -- 172.21.15.100:0/3632447137 >> 172.21.15.100:0/3632447137 conn(0x7f3d800cada0 msgr2=0x7f3d800cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.246+0000 7f3d87800700 1 -- 172.21.15.100:0/3632447137 shutdown_connections 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.246+0000 7f3d87800700 1 -- 172.21.15.100:0/3632447137 wait complete. 2024-01-22T05:38:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.247+0000 7f3d87800700 1 Processor -- start 2024-01-22T05:38:13.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.247+0000 7f3d87800700 1 -- start start 2024-01-22T05:38:13.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d87800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d8005e1f0 0x7f3d800c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d87800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d87800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d800c1940 0x7f3d80152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d87800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800ab6c0 con 0x7f3d800a9f60 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d87800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800c32b0 con 0x7f3d8005e1f0 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d87800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800c3590 con 0x7f3d800c1940 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d7fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d7fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33308/0 (socket says 172.21.15.100:33308) 2024-01-22T05:38:13.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d7fe00700 1 -- 172.21.15.100:0/2667275915 learned_addr learned my addr 172.21.15.100:0/2667275915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d84e00700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d8005e1f0 0x7f3d800c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.248+0000 7f3d85800700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d800c1940 0x7f3d80152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d7fe00700 1 -- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d800c1940 msgr2=0x7f3d80152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d7fe00700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d800c1940 0x7f3d80152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d7fe00700 1 -- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d8005e1f0 msgr2=0x7f3d800c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d7fe00700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d8005e1f0 0x7f3d800c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d7fe00700 1 -- 172.21.15.100:0/2667275915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70009370 con 0x7f3d800a9f60 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d7fe00700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800c43f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3d6800d890 tx=0x7f3d68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d77e00700 1 -- 172.21.15.100:0/2667275915 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680125f0 con 0x7f3d800a9f60 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d77e00700 1 -- 172.21.15.100:0/2667275915 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d68012750 con 0x7f3d800a9f60 2024-01-22T05:38:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d800c3870 con 0x7f3d800a9f60 2024-01-22T05:38:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d77e00700 1 -- 172.21.15.100:0/2667275915 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68012ad0 con 0x7f3d800a9f60 2024-01-22T05:38:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.249+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d800c48e0 con 0x7f3d800a9f60 2024-01-22T05:38:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.250+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8005fdb0 con 0x7f3d800a9f60 2024-01-22T05:38:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.251+0000 7f3d77e00700 1 -- 172.21.15.100:0/2667275915 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3d68013480 con 0x7f3d800a9f60 2024-01-22T05:38:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.252+0000 7f3d77e00700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3d5805f150 0x7f3d58061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.252+0000 7f3d77e00700 1 -- 172.21.15.100:0/2667275915 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d68079f90 con 0x7f3d800a9f60 2024-01-22T05:38:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.252+0000 7f3d84e00700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3d5805f150 0x7f3d58061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.252+0000 7f3d84e00700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3d5805f150 0x7f3d58061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3d70009fd0 tx=0x7f3d70017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:13.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.256+0000 7f3d77e00700 1 -- 172.21.15.100:0/2667275915 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3d6804b140 con 0x7f3d800a9f60 2024-01-22T05:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.427+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d800ca030 con 0x7f3d800a9f60 2024-01-22T05:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.427+0000 7f3d77e00700 1 -- 172.21.15.100:0/2667275915 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d6804e760 con 0x7f3d800a9f60 2024-01-22T05:38:13.428 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3d5805f150 msgr2=0x7f3d58061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3d5805f150 0x7f3d58061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3d70009fd0 tx=0x7f3d70017000).stop 2024-01-22T05:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 msgr2=0x7f3d800c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800c43f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3d6800d890 tx=0x7f3d68008040).stop 2024-01-22T05:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 shutdown_connections 2024-01-22T05:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3d5805f150 0x7f3d58061610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d8005e1f0 0x7f3d800c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d800c1940 0x7f3d80152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 --2- 172.21.15.100:0/2667275915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d800a9f60 0x7f3d800c43f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 >> 172.21.15.100:0/2667275915 conn(0x7f3d800cada0 msgr2=0x7f3d80157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 shutdown_connections 2024-01-22T05:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.430+0000 7f3d87800700 1 -- 172.21.15.100:0/2667275915 wait complete. 2024-01-22T05:38:13.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:38:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.634+0000 7f3091800700 1 Processor -- start 2024-01-22T05:38:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.634+0000 7f3091800700 1 -- start start 2024-01-22T05:38:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f3091800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c154260 0x7f308c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f3091800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f308c0c5c80 0x7f308c0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f3091800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308c0c1a40 con 0x7f308c0c65f0 2024-01-22T05:38:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f3091800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308c0cbd30 con 0x7f308c0c5c80 2024-01-22T05:38:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f3091800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0c6aa0 con 0x7f308c154260 2024-01-22T05:38:13.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f308a000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f308c0c5c80 0x7f308c0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f308a000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f308c0c5c80 0x7f308c0c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:34240/0 (socket says 172.21.15.100:34240) 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f308a000700 1 -- 172.21.15.100:0/857750168 learned_addr learned my addr 172.21.15.100:0/857750168 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.636+0000 7f308aa00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c154260 0x7f308c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.637+0000 7f308a000700 1 -- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c154260 msgr2=0x7f308c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.637+0000 7f308a000700 1 --2- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c154260 0x7f308c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.637+0000 7f308a000700 1 -- 172.21.15.100:0/857750168 >> v1:172.21.15.169:6789/0 conn(0x7f308c0c65f0 legacy=0x7f308c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.637+0000 7f308a000700 1 -- 172.21.15.100:0/857750168 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c0c1110 con 0x7f308c0c5c80 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.637+0000 7f3089600700 1 -- 172.21.15.100:0/857750168 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240037243 0 0) 0x7f308c0c1a40 con 0x7f308c0c65f0 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.637+0000 7f308aa00700 1 --2- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c154260 0x7f308c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.637+0000 7f308a000700 1 --2- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c0c5c80 0x7f308c0c6100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3074009830 tx=0x7f30740090f0).ready entity=mon.1 client_cookie=4a281f56f7a3e6d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3089600700 1 -- 172.21.15.100:0/857750168 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400b580 con 0x7f308c0c5c80 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3089600700 1 -- 172.21.15.100:0/857750168 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307400b6e0 con 0x7f308c0c5c80 2024-01-22T05:38:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3089600700 1 -- 172.21.15.100:0/857750168 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400ba60 con 0x7f308c0c5c80 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 -- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c0c5c80 msgr2=0x7f308c0c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 --2- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c0c5c80 0x7f308c0c6100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3074009830 tx=0x7f30740090f0).stop 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 -- 172.21.15.100:0/857750168 shutdown_connections 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 --2- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c154260 0x7f308c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 --2- 172.21.15.100:0/857750168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c0c5c80 0x7f308c0c6100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 -- 172.21.15.100:0/857750168 >> 172.21.15.100:0/857750168 conn(0x7f308c05e9d0 msgr2=0x7f308c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 -- 172.21.15.100:0/857750168 shutdown_connections 2024-01-22T05:38:13.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.638+0000 7f3091800700 1 -- 172.21.15.100:0/857750168 wait complete. 2024-01-22T05:38:13.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.640+0000 7f3091800700 1 Processor -- start 2024-01-22T05:38:13.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.640+0000 7f3091800700 1 -- start start 2024-01-22T05:38:13.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f3091800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c0c5c80 0x7f308c166f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f3091800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308c0c65f0 0x7f308c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f3091800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c154260 0x7f308c0c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f3091800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0ab2f0 con 0x7f308c0c65f0 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f3091800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0c4600 con 0x7f308c154260 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f3091800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0aa950 con 0x7f308c0c5c80 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308c0c65f0 0x7f308c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308c0c65f0 0x7f308c0c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33318/0 (socket says 172.21.15.100:33318) 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 -- 172.21.15.100:0/1022222341 learned_addr learned my addr 172.21.15.100:0/1022222341 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 -- 172.21.15.100:0/1022222341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c0c5c80 msgr2=0x7f308c166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c0c5c80 0x7f308c166f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 -- 172.21.15.100:0/1022222341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c154260 msgr2=0x7f308c0c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c154260 0x7f308c0c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 -- 172.21.15.100:0/1022222341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c009250 con 0x7f308c0c65f0 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.641+0000 7f308a000700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308c0c65f0 0x7f308c0c3c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3074011000 tx=0x7f3074017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.642+0000 7f3082000700 1 -- 172.21.15.100:0/1022222341 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074006a40 con 0x7f308c0c65f0 2024-01-22T05:38:13.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.642+0000 7f3082000700 1 -- 172.21.15.100:0/1022222341 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307400b850 con 0x7f308c0c65f0 2024-01-22T05:38:13.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.642+0000 7f3082000700 1 -- 172.21.15.100:0/1022222341 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307401c670 con 0x7f308c0c65f0 2024-01-22T05:38:13.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.642+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3074009370 con 0x7f308c0c65f0 2024-01-22T05:38:13.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.642+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c0aaf10 con 0x7f308c0c65f0 2024-01-22T05:38:13.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.643+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308c0c5030 con 0x7f308c0c65f0 2024-01-22T05:38:13.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.644+0000 7f3082000700 1 -- 172.21.15.100:0/1022222341 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f307401c9e0 con 0x7f308c0c65f0 2024-01-22T05:38:13.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.644+0000 7f3082000700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f306405f150 0x7f3064061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:13.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.644+0000 7f3082000700 1 -- 172.21.15.100:0/1022222341 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f307407bea0 con 0x7f308c0c65f0 2024-01-22T05:38:13.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.645+0000 7f308aa00700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f306405f150 0x7f3064061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:13.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.645+0000 7f308aa00700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f306405f150 0x7f3064061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f307c006fd0 tx=0x7f307c006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:13.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.648+0000 7f3082000700 1 -- 172.21.15.100:0/1022222341 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f307404d0b0 con 0x7f308c0c65f0 2024-01-22T05:38:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.816+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f308c0ab430 con 0x7f308c0c65f0 2024-01-22T05:38:13.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.817+0000 7f3082000700 1 -- 172.21.15.100:0/1022222341 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f308c0ab430 con 0x7f308c0c65f0 2024-01-22T05:38:13.817 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:13.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f306405f150 msgr2=0x7f3064061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f306405f150 0x7f3064061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f307c006fd0 tx=0x7f307c006f40).stop 2024-01-22T05:38:13.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308c0c65f0 msgr2=0x7f308c0c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:13.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308c0c65f0 0x7f308c0c3c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3074011000 tx=0x7f3074017000).stop 2024-01-22T05:38:13.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 shutdown_connections 2024-01-22T05:38:13.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f306405f150 0x7f3064061610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f308c154260 0x7f308c0c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f308c0c5c80 0x7f308c166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 --2- 172.21.15.100:0/1022222341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308c0c65f0 0x7f308c0c3c20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 >> 172.21.15.100:0/1022222341 conn(0x7f308c05e9d0 msgr2=0x7f308c064430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 shutdown_connections 2024-01-22T05:38:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:13.819+0000 7f3091800700 1 -- 172.21.15.100:0/1022222341 wait complete. 2024-01-22T05:38:13.836 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:38:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.021+0000 7ff9e5400700 1 Processor -- start 2024-01-22T05:38:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.022+0000 7ff9e5400700 1 -- start start 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9e5400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9e00a9f60 0x7ff9e00aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9e5400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff9e005e900 0x7ff9e00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9e5400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e00c74b0 con 0x7ff9e00c1940 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9e5400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e00cab90 con 0x7ff9e00a9f60 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9e5400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e0158660 con 0x7ff9e005e900 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9de800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9e00a9f60 0x7ff9e00aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9de800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9e00a9f60 0x7ff9e00aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33334/0 (socket says 172.21.15.100:33334) 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.023+0000 7ff9de800700 1 -- 172.21.15.100:0/1048819530 learned_addr learned my addr 172.21.15.100:0/1048819530 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9df200700 1 --2- 172.21.15.100:0/1048819530 >> v2:172.21.15.169:3300/0 conn(0x7ff9e005e900 0x7ff9e00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9de800700 1 -- 172.21.15.100:0/1048819530 >> v2:172.21.15.169:3300/0 conn(0x7ff9e005e900 msgr2=0x7ff9e00ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9de800700 1 --2- 172.21.15.100:0/1048819530 >> v2:172.21.15.169:3300/0 conn(0x7ff9e005e900 0x7ff9e00ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9de800700 1 -- 172.21.15.100:0/1048819530 >> v1:172.21.15.169:6789/0 conn(0x7ff9e00c1940 legacy=0x7ff9e005e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9de800700 1 -- 172.21.15.100:0/1048819530 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e0158940 con 0x7ff9e00a9f60 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9df200700 1 --2- 172.21.15.100:0/1048819530 >> v2:172.21.15.169:3300/0 conn(0x7ff9e005e900 0x7ff9e00ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9de800700 1 --2- 172.21.15.100:0/1048819530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00aa340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff9e00ca630 tx=0x7ff9d00090f0).ready entity=mon.0 client_cookie=287f9680fee63121 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9dd400700 1 -- 172.21.15.100:0/1048819530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000b600 con 0x7ff9e00a9f60 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9dd400700 1 -- 172.21.15.100:0/1048819530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000b760 con 0x7ff9e00a9f60 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.024+0000 7ff9dd400700 1 -- 172.21.15.100:0/1048819530 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000bae0 con 0x7ff9e00a9f60 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 -- 172.21.15.100:0/1048819530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e00a9f60 msgr2=0x7ff9e00aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1048819530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00aa340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff9e00ca630 tx=0x7ff9d00090f0).stop 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 -- 172.21.15.100:0/1048819530 shutdown_connections 2024-01-22T05:38:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1048819530 >> v2:172.21.15.169:3300/0 conn(0x7ff9e005e900 0x7ff9e00ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1048819530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00aa340 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 -- 172.21.15.100:0/1048819530 >> 172.21.15.100:0/1048819530 conn(0x7ff9e00cada0 msgr2=0x7ff9e00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:14.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 -- 172.21.15.100:0/1048819530 shutdown_connections 2024-01-22T05:38:14.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.025+0000 7ff9e5400700 1 -- 172.21.15.100:0/1048819530 wait complete. 2024-01-22T05:38:14.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.026+0000 7ff9e5400700 1 Processor -- start 2024-01-22T05:38:14.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.026+0000 7ff9e5400700 1 -- start start 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.027+0000 7ff9e5400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e005e900 0x7ff9e00acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.027+0000 7ff9e5400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.027+0000 7ff9e5400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9e00c1940 0x7ff9e00c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.027+0000 7ff9e5400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00acae0 con 0x7ff9e005e900 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.027+0000 7ff9e5400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00abed0 con 0x7ff9e00a9f60 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.027+0000 7ff9e5400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00ac1b0 con 0x7ff9e00c1940 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e005e900 0x7ff9e00acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e005e900 0x7ff9e00acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33346/0 (socket says 172.21.15.100:33346) 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 -- 172.21.15.100:0/1338477922 learned_addr learned my addr 172.21.15.100:0/1338477922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9df200700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9e00c1940 0x7ff9e00c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9dde00700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 -- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9e00c1940 msgr2=0x7ff9e00c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9e00c1940 0x7ff9e00c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 -- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e00a9f60 msgr2=0x7ff9e00c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 -- 172.21.15.100:0/1338477922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0009370 con 0x7ff9e005e900 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9dde00700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9de800700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e005e900 0x7ff9e00acf70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff9d0009fd0 tx=0x7ff9d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9d6000700 1 -- 172.21.15.100:0/1338477922 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000b8d0 con 0x7ff9e005e900 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9d6000700 1 -- 172.21.15.100:0/1338477922 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000ba30 con 0x7ff9e005e900 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9d6000700 1 -- 172.21.15.100:0/1338477922 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d001b660 con 0x7ff9e005e900 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.028+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e00ac490 con 0x7ff9e005e900 2024-01-22T05:38:14.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.029+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e00abb80 con 0x7ff9e005e900 2024-01-22T05:38:14.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.030+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e00acdc0 con 0x7ff9e005e900 2024-01-22T05:38:14.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.030+0000 7ff9d6000700 1 -- 172.21.15.100:0/1338477922 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff9d001ba10 con 0x7ff9e005e900 2024-01-22T05:38:14.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.031+0000 7ff9d6000700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff9b805f150 0x7ff9b8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.031+0000 7ff9d6000700 1 -- 172.21.15.100:0/1338477922 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff9d007bc10 con 0x7ff9e005e900 2024-01-22T05:38:14.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.031+0000 7ff9dde00700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff9b805f150 0x7ff9b8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.031+0000 7ff9dde00700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff9b805f150 0x7ff9b8061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff9e0165830 tx=0x7ff9c8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.035+0000 7ff9d6000700 1 -- 172.21.15.100:0/1338477922 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff9d004ce20 con 0x7ff9e005e900 2024-01-22T05:38:14.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.205+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9e005fdb0 con 0x7ff9e005e900 2024-01-22T05:38:14.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.205+0000 7ff9d6000700 1 -- 172.21.15.100:0/1338477922 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9d001f020 con 0x7ff9e005e900 2024-01-22T05:38:14.206 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff9b805f150 msgr2=0x7ff9b8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff9b805f150 0x7ff9b8061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff9e0165830 tx=0x7ff9c8009040).stop 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e005e900 msgr2=0x7ff9e00acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e005e900 0x7ff9e00acf70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff9d0009fd0 tx=0x7ff9d0017000).stop 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 shutdown_connections 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff9b805f150 0x7ff9b8061610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9e00c1940 0x7ff9e00c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9e005e900 0x7ff9e00acf70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 --2- 172.21.15.100:0/1338477922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e00a9f60 0x7ff9e00c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 >> 172.21.15.100:0/1338477922 conn(0x7ff9e00cada0 msgr2=0x7ff9e00ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:14.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 shutdown_connections 2024-01-22T05:38:14.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.208+0000 7ff9e5400700 1 -- 172.21.15.100:0/1338477922 wait complete. 2024-01-22T05:38:14.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.410+0000 7f3695e00700 1 Processor -- start 2024-01-22T05:38:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.410+0000 7f3695e00700 1 -- start start 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.411+0000 7f3695e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3690153ff0 0x7f36901543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.411+0000 7f3695e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f36900aa440 0x7f36900c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.411+0000 7f3695e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900c66e0 con 0x7f36900c5cd0 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.411+0000 7f3695e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900c0750 con 0x7f36900aa440 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.411+0000 7f3695e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900c1bf0 con 0x7f3690153ff0 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.411+0000 7f368e000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f36900c5cd0 0x7f36900a9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45538/0 (socket says 172.21.15.100:45538) 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.411+0000 7f368e000700 1 -- 172.21.15.100:0/305951705 learned_addr learned my addr 172.21.15.100:0/305951705 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368f400700 1 --2- 172.21.15.100:0/305951705 >> v2:172.21.15.169:3300/0 conn(0x7f36900aa440 0x7f36900c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368ea00700 1 --2- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3690153ff0 0x7f36901543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368d600700 1 -- 172.21.15.100:0/305951705 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343350973 0 0) 0x7f36900c66e0 con 0x7f36900c5cd0 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368d600700 1 -- 172.21.15.100:0/305951705 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36700033f0 con 0x7f36900c5cd0 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368f400700 1 -- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3690153ff0 msgr2=0x7f36901543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368f400700 1 --2- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3690153ff0 0x7f36901543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368f400700 1 -- 172.21.15.100:0/305951705 >> v1:172.21.15.100:6789/0 conn(0x7f36900c5cd0 legacy=0x7f36900a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368f400700 1 -- 172.21.15.100:0/305951705 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900bfe20 con 0x7f36900aa440 2024-01-22T05:38:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.412+0000 7f368f400700 1 --2- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 0x7f36900c6150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3688009e60 tx=0x7f3688009780).ready entity=mon.1 client_cookie=5ba4e4df5ec9ebb5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f368d600700 1 -- 172.21.15.100:0/305951705 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800e070 con 0x7f36900aa440 2024-01-22T05:38:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f368d600700 1 -- 172.21.15.100:0/305951705 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368800bab0 con 0x7f36900aa440 2024-01-22T05:38:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f368d600700 1 -- 172.21.15.100:0/305951705 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800be30 con 0x7f36900aa440 2024-01-22T05:38:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 -- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 msgr2=0x7f36900c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 --2- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 0x7f36900c6150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3688009e60 tx=0x7f3688009780).stop 2024-01-22T05:38:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 -- 172.21.15.100:0/305951705 shutdown_connections 2024-01-22T05:38:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 --2- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 0x7f36900c6150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 --2- 172.21.15.100:0/305951705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3690153ff0 0x7f36901543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 -- 172.21.15.100:0/305951705 >> 172.21.15.100:0/305951705 conn(0x7f36900c82a0 msgr2=0x7f369005e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 -- 172.21.15.100:0/305951705 shutdown_connections 2024-01-22T05:38:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.413+0000 7f3695e00700 1 -- 172.21.15.100:0/305951705 wait complete. 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.415+0000 7f3695e00700 1 Processor -- start 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.415+0000 7f3695e00700 1 -- start start 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f3695e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 0x7f369013f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f3695e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36900c5cd0 0x7f3690158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f3695e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690153ff0 0x7f3690159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f3695e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36901598f0 con 0x7f3690153ff0 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f3695e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690156590 con 0x7f36900aa440 2024-01-22T05:38:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f3695e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3690156870 con 0x7f36900c5cd0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690153ff0 0x7f3690159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690153ff0 0x7f3690159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33356/0 (socket says 172.21.15.100:33356) 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 -- 172.21.15.100:0/737462007 learned_addr learned my addr 172.21.15.100:0/737462007 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 -- 172.21.15.100:0/737462007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36900c5cd0 msgr2=0x7f3690158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36900c5cd0 0x7f3690158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 -- 172.21.15.100:0/737462007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 msgr2=0x7f369013f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 0x7f369013f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.416+0000 7f368f400700 1 -- 172.21.15.100:0/737462007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009a20 con 0x7f3690153ff0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.417+0000 7f368f400700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690153ff0 0x7f3690159400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f368800b610 tx=0x7f3688009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.417+0000 7f3686000700 1 -- 172.21.15.100:0/737462007 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368801d630 con 0x7f3690153ff0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.417+0000 7f3686000700 1 -- 172.21.15.100:0/737462007 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368801d790 con 0x7f3690153ff0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.417+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3690156b50 con 0x7f3690153ff0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.417+0000 7f3686000700 1 -- 172.21.15.100:0/737462007 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368801db50 con 0x7f3690153ff0 2024-01-22T05:38:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.417+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3690156240 con 0x7f3690153ff0 2024-01-22T05:38:14.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.418+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3690157070 con 0x7f3690153ff0 2024-01-22T05:38:14.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.419+0000 7f3686000700 1 -- 172.21.15.100:0/737462007 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3688026410 con 0x7f3690153ff0 2024-01-22T05:38:14.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.419+0000 7f3686000700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f366805f150 0x7f3668061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.419+0000 7f3686000700 1 -- 172.21.15.100:0/737462007 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f368807bff0 con 0x7f3690153ff0 2024-01-22T05:38:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.420+0000 7f368ea00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f366805f150 0x7f3668061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.420+0000 7f368ea00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f366805f150 0x7f3668061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3680009990 tx=0x7f3680009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.424+0000 7f3686000700 1 -- 172.21.15.100:0/737462007 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f36880aab00 con 0x7f3690153ff0 2024-01-22T05:38:14.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.635+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f369005fdb0 con 0x7f3690153ff0 2024-01-22T05:38:14.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.636+0000 7f3686000700 1 -- 172.21.15.100:0/737462007 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f3690157070 con 0x7f3690153ff0 2024-01-22T05:38:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:14.636 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f366805f150 msgr2=0x7f3668061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f366805f150 0x7f3668061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3680009990 tx=0x7f3680009060).stop 2024-01-22T05:38:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690153ff0 msgr2=0x7f3690159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690153ff0 0x7f3690159400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f368800b610 tx=0x7f3688009780).stop 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 shutdown_connections 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f366805f150 0x7f3668061610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36900aa440 0x7f369013f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690153ff0 0x7f3690159400 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 --2- 172.21.15.100:0/737462007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36900c5cd0 0x7f3690158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 >> 172.21.15.100:0/737462007 conn(0x7f36900c82a0 msgr2=0x7f36900a9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 shutdown_connections 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.638+0000 7f3695e00700 1 -- 172.21.15.100:0/737462007 wait complete. 2024-01-22T05:38:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:14.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:14.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.841+0000 7f5c76400700 1 Processor -- start 2024-01-22T05:38:14.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.841+0000 7f5c76400700 1 -- start start 2024-01-22T05:38:14.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.842+0000 7f5c76400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c700a96e0 0x7f5c700c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.842+0000 7f5c76400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c700a9250 con 0x7f5c70153fd0 2024-01-22T05:38:14.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.842+0000 7f5c76400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c700a8640 con 0x7f5c700aa4d0 2024-01-22T05:38:14.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.842+0000 7f5c76400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c700a8920 con 0x7f5c700a96e0 2024-01-22T05:38:14.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.842+0000 7f5c6fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c700a96e0 0x7f5c700c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.842+0000 7f5c6f400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5c70153fd0 0x7f5c700a9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45554/0 (socket says 172.21.15.100:45554) 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.842+0000 7f5c6f400700 1 -- 172.21.15.100:0/773313192 learned_addr learned my addr 172.21.15.100:0/773313192 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6ea00700 1 -- 172.21.15.100:0/773313192 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110388156 0 0) 0x7f5c700a9250 con 0x7f5c70153fd0 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6ea00700 1 -- 172.21.15.100:0/773313192 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c500033f0 con 0x7f5c70153fd0 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6fe00700 1 -- 172.21.15.100:0/773313192 >> v1:172.21.15.169:6789/0 conn(0x7f5c700aa4d0 legacy=0x7f5c700c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6ea00700 1 -- 172.21.15.100:0/773313192 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172460619 0 0) 0x7f5c700a8640 con 0x7f5c700aa4d0 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6fe00700 1 -- 172.21.15.100:0/773313192 >> v1:172.21.15.100:6789/0 conn(0x7f5c70153fd0 legacy=0x7f5c700a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6fe00700 1 -- 172.21.15.100:0/773313192 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c700a8c00 con 0x7f5c700a96e0 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6fe00700 1 --2- 172.21.15.100:0/773313192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700a96e0 0x7f5c700c0ef0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5c68009e60 tx=0x7f5c68009780).ready entity=mon.0 client_cookie=8ed4cbbe2dc77cf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6ea00700 1 -- 172.21.15.100:0/773313192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800e070 con 0x7f5c700a96e0 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6ea00700 1 -- 172.21.15.100:0/773313192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800bb60 con 0x7f5c700a96e0 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.843+0000 7f5c6ea00700 1 -- 172.21.15.100:0/773313192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800bee0 con 0x7f5c700a96e0 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.844+0000 7f5c76400700 1 -- 172.21.15.100:0/773313192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700a96e0 msgr2=0x7f5c700c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.844+0000 7f5c76400700 1 --2- 172.21.15.100:0/773313192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700a96e0 0x7f5c700c0ef0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5c68009e60 tx=0x7f5c68009780).stop 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.844+0000 7f5c76400700 1 -- 172.21.15.100:0/773313192 shutdown_connections 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.844+0000 7f5c76400700 1 --2- 172.21.15.100:0/773313192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700a96e0 0x7f5c700c0ef0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.844+0000 7f5c76400700 1 -- 172.21.15.100:0/773313192 >> 172.21.15.100:0/773313192 conn(0x7f5c700944d0 msgr2=0x7f5c7005e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.844+0000 7f5c76400700 1 -- 172.21.15.100:0/773313192 shutdown_connections 2024-01-22T05:38:14.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.844+0000 7f5c76400700 1 -- 172.21.15.100:0/773313192 wait complete. 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.845+0000 7f5c76400700 1 Processor -- start 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.846+0000 7f5c76400700 1 -- start start 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.846+0000 7f5c76400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c700a96e0 0x7f5c7014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.846+0000 7f5c76400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700aa4d0 0x7f5c70156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.846+0000 7f5c76400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c70153fd0 0x7f5c700afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.846+0000 7f5c76400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701543b0 con 0x7f5c700aa4d0 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.846+0000 7f5c76400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701551d0 con 0x7f5c700a96e0 2024-01-22T05:38:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.846+0000 7f5c76400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7014fa90 con 0x7f5c70153fd0 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700aa4d0 0x7f5c70156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c6f400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c700a96e0 0x7f5c7014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700aa4d0 0x7f5c70156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33366/0 (socket says 172.21.15.100:33366) 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 -- 172.21.15.100:0/2191195864 learned_addr learned my addr 172.21.15.100:0/2191195864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c6fe00700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c70153fd0 0x7f5c700afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 -- 172.21.15.100:0/2191195864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c70153fd0 msgr2=0x7f5c700afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c70153fd0 0x7f5c700afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 -- 172.21.15.100:0/2191195864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c700a96e0 msgr2=0x7f5c7014f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c700a96e0 0x7f5c7014f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 -- 172.21.15.100:0/2191195864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68009a20 con 0x7f5c700aa4d0 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c67e00700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700aa4d0 0x7f5c70156220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5c5800c4f0 tx=0x7f5c58007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c66a00700 1 -- 172.21.15.100:0/2191195864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5800f470 con 0x7f5c700aa4d0 2024-01-22T05:38:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c66a00700 1 -- 172.21.15.100:0/2191195864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5800f5f0 con 0x7f5c700aa4d0 2024-01-22T05:38:14.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c701545c0 con 0x7f5c700aa4d0 2024-01-22T05:38:14.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.847+0000 7f5c66a00700 1 -- 172.21.15.100:0/2191195864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5800f9b0 con 0x7f5c700aa4d0 2024-01-22T05:38:14.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.848+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70154b80 con 0x7f5c700aa4d0 2024-01-22T05:38:14.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.849+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7005fdb0 con 0x7f5c700aa4d0 2024-01-22T05:38:14.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.849+0000 7f5c66a00700 1 -- 172.21.15.100:0/2191195864 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5c58012400 con 0x7f5c700aa4d0 2024-01-22T05:38:14.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.850+0000 7f5c66a00700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c4805f150 0x7f5c48061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:14.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.850+0000 7f5c66a00700 1 -- 172.21.15.100:0/2191195864 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5c58079820 con 0x7f5c700aa4d0 2024-01-22T05:38:14.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.850+0000 7f5c6f400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c4805f150 0x7f5c48061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:14.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.851+0000 7f5c6f400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c4805f150 0x7f5c48061610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5c60005750 tx=0x7f5c60009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:14.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:14.854+0000 7f5c66a00700 1 -- 172.21.15.100:0/2191195864 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5c5804a9d0 con 0x7f5c700aa4d0 2024-01-22T05:38:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.026+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c700a8ee0 con 0x7f5c700aa4d0 2024-01-22T05:38:15.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.027+0000 7f5c66a00700 1 -- 172.21.15.100:0/2191195864 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f5c5804dff0 con 0x7f5c700aa4d0 2024-01-22T05:38:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:15.027 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:15.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c4805f150 msgr2=0x7f5c48061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c4805f150 0x7f5c48061610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5c60005750 tx=0x7f5c60009040).stop 2024-01-22T05:38:15.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700aa4d0 msgr2=0x7f5c70156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700aa4d0 0x7f5c70156220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5c5800c4f0 tx=0x7f5c58007c20).stop 2024-01-22T05:38:15.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 shutdown_connections 2024-01-22T05:38:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c4805f150 0x7f5c48061610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c700a96e0 0x7f5c7014f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c70153fd0 0x7f5c700afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 --2- 172.21.15.100:0/2191195864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700aa4d0 0x7f5c70156220 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 >> 172.21.15.100:0/2191195864 conn(0x7f5c700944d0 msgr2=0x7f5c700c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 shutdown_connections 2024-01-22T05:38:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.029+0000 7f5c76400700 1 -- 172.21.15.100:0/2191195864 wait complete. 2024-01-22T05:38:15.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:37:56.837820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:37:57.667310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:38:15.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:15.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.237+0000 7f38f7e00700 1 Processor -- start 2024-01-22T05:38:15.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.237+0000 7f38f7e00700 1 -- start start 2024-01-22T05:38:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f7e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f0138440 0x7f38f00681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f7e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f38f00c5830 0x7f38f00686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f7e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f0064520 con 0x7f38f0138820 2024-01-22T05:38:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f7e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f0064e30 con 0x7f38f00c5830 2024-01-22T05:38:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f7e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0068bc0 con 0x7f38f0138440 2024-01-22T05:38:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f5e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f38f00c5830 0x7f38f00686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f5e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f38f00c5830 0x7f38f00686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33378/0 (socket says 172.21.15.100:33378) 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f5e00700 1 -- 172.21.15.100:0/2881939481 learned_addr learned my addr 172.21.15.100:0/2881939481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.238+0000 7f38f4a00700 1 --1- 172.21.15.100:0/2881939481 >> v1:172.21.15.100:6789/0 conn(0x7f38f0138820 0x7f38f00c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45556/0 (socket says 172.21.15.100:45556) 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38f5400700 1 --2- 172.21.15.100:0/2881939481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f0138440 0x7f38f00681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38f5e00700 1 -- 172.21.15.100:0/2881939481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f0138440 msgr2=0x7f38f00681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38f5e00700 1 --2- 172.21.15.100:0/2881939481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f0138440 0x7f38f00681e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38f5e00700 1 -- 172.21.15.100:0/2881939481 >> v1:172.21.15.100:6789/0 conn(0x7f38f0138820 legacy=0x7f38f00c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38f5e00700 1 -- 172.21.15.100:0/2881939481 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f00c5e50 con 0x7f38f00c5830 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38efe00700 1 -- 172.21.15.100:0/2881939481 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968831482 0 0) 0x7f38f0064520 con 0x7f38f0138820 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38f5e00700 1 --2- 172.21.15.100:0/2881939481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f00c5830 0x7f38f00686d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f38e8009f20 tx=0x7f38e8009840).ready entity=mon.0 client_cookie=bffce22566d56176 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38efe00700 1 -- 172.21.15.100:0/2881939481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800e070 con 0x7f38f00c5830 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38efe00700 1 -- 172.21.15.100:0/2881939481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800ba80 con 0x7f38f00c5830 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.239+0000 7f38efe00700 1 -- 172.21.15.100:0/2881939481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800be00 con 0x7f38f00c5830 2024-01-22T05:38:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 -- 172.21.15.100:0/2881939481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f00c5830 msgr2=0x7f38f00686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 --2- 172.21.15.100:0/2881939481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f00c5830 0x7f38f00686d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f38e8009f20 tx=0x7f38e8009840).stop 2024-01-22T05:38:15.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 -- 172.21.15.100:0/2881939481 shutdown_connections 2024-01-22T05:38:15.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 --2- 172.21.15.100:0/2881939481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f00c5830 0x7f38f00686d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 --2- 172.21.15.100:0/2881939481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f0138440 0x7f38f00681e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 -- 172.21.15.100:0/2881939481 >> 172.21.15.100:0/2881939481 conn(0x7f38f00630c0 msgr2=0x7f38f00c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:15.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 -- 172.21.15.100:0/2881939481 shutdown_connections 2024-01-22T05:38:15.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.240+0000 7f38f7e00700 1 -- 172.21.15.100:0/2881939481 wait complete. 2024-01-22T05:38:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.241+0000 7f38f7e00700 1 Processor -- start 2024-01-22T05:38:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.241+0000 7f38f7e00700 1 -- start start 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.242+0000 7f38f7e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f00c5830 0x7f38f0151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.242+0000 7f38f7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f0138440 0x7f38f0159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.242+0000 7f38f7e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38f0138820 0x7f38f00aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.242+0000 7f38f7e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0151530 con 0x7f38f0138440 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.242+0000 7f38f7e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f01519b0 con 0x7f38f0138820 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.242+0000 7f38f7e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0168940 con 0x7f38f00c5830 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f0138440 0x7f38f0159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f0138440 0x7f38f0159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33386/0 (socket says 172.21.15.100:33386) 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 -- 172.21.15.100:0/1666304073 learned_addr learned my addr 172.21.15.100:0/1666304073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f5400700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f00c5830 0x7f38f0151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f5e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38f0138820 0x7f38f00aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 -- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f00c5830 msgr2=0x7f38f0151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f00c5830 0x7f38f0151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 -- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38f0138820 msgr2=0x7f38f00aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38f0138820 0x7f38f00aba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 -- 172.21.15.100:0/1666304073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009ae0 con 0x7f38f0138440 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f5400700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f00c5830 0x7f38f0151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f5e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38f0138820 0x7f38f00aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f4a00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f0138440 0x7f38f0159640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f38d800c490 tx=0x7f38d8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38ecc00700 1 -- 172.21.15.100:0/1666304073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80072e0 con 0x7f38f0138440 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38ecc00700 1 -- 172.21.15.100:0/1666304073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d8007440 con 0x7f38f0138440 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f0167dc0 con 0x7f38f0138440 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.243+0000 7f38ecc00700 1 -- 172.21.15.100:0/1666304073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8005930 con 0x7f38f0138440 2024-01-22T05:38:15.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.244+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f0168380 con 0x7f38f0138440 2024-01-22T05:38:15.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.245+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f00c0c60 con 0x7f38f0138440 2024-01-22T05:38:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.245+0000 7f38ecc00700 1 -- 172.21.15.100:0/1666304073 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f38d8005ce0 con 0x7f38f0138440 2024-01-22T05:38:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.246+0000 7f38ecc00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38c805f150 0x7f38c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.246+0000 7f38ecc00700 1 -- 172.21.15.100:0/1666304073 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f38d80799b0 con 0x7f38f0138440 2024-01-22T05:38:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.246+0000 7f38f5400700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38c805f150 0x7f38c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.247+0000 7f38f5400700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38c805f150 0x7f38c8061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f38e000bb60 tx=0x7f38e0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:15.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.250+0000 7f38ecc00700 1 -- 172.21.15.100:0/1666304073 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f38d804ac80 con 0x7f38f0138440 2024-01-22T05:38:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.420+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f38f006bcc0 con 0x7f38f0138440 2024-01-22T05:38:15.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.421+0000 7f38ecc00700 1 -- 172.21.15.100:0/1666304073 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f38d804e2a0 con 0x7f38f0138440 2024-01-22T05:38:15.421 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38c805f150 msgr2=0x7f38c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38c805f150 0x7f38c8061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f38e000bb60 tx=0x7f38e0008040).stop 2024-01-22T05:38:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f0138440 msgr2=0x7f38f0159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f0138440 0x7f38f0159640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f38d800c490 tx=0x7f38d8007e00).stop 2024-01-22T05:38:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 shutdown_connections 2024-01-22T05:38:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38c805f150 0x7f38c8061610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38f0138820 0x7f38f00aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38f00c5830 0x7f38f0151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 --2- 172.21.15.100:0/1666304073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38f0138440 0x7f38f0159640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 >> 172.21.15.100:0/1666304073 conn(0x7f38f00630c0 msgr2=0x7f38f00bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:15.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 shutdown_connections 2024-01-22T05:38:15.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.423+0000 7f38f7e00700 1 -- 172.21.15.100:0/1666304073 wait complete. 2024-01-22T05:38:15.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.626+0000 7f43cce00700 1 Processor -- start 2024-01-22T05:38:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.626+0000 7f43cce00700 1 -- start start 2024-01-22T05:38:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.627+0000 7f43cce00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43c805e900 0x7f43c80aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.627+0000 7f43cce00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c80c74b0 con 0x7f43c80c1940 2024-01-22T05:38:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.627+0000 7f43cce00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c8158660 con 0x7f43c80a9f60 2024-01-22T05:38:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.627+0000 7f43cce00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c8158940 con 0x7f43c805e900 2024-01-22T05:38:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c6800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f43c80c1940 0x7f43c8098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45564/0 (socket says 172.21.15.100:45564) 2024-01-22T05:38:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c6800700 1 -- 172.21.15.100:0/1205620541 learned_addr learned my addr 172.21.15.100:0/1205620541 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c5400700 1 --2- 172.21.15.100:0/1205620541 >> v2:172.21.15.169:3300/0 conn(0x7f43c805e900 0x7f43c80aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568877689 0 0) 0x7f43c80c74b0 con 0x7f43c80c1940 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a80033f0 con 0x7f43c80c1940 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808636301 0 0) 0x7f43c8158660 con 0x7f43c80a9f60 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c80c74b0 con 0x7f43c80a9f60 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615981855 0 0) 0x7f43a80033f0 con 0x7f43c80c1940 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 >> v2:172.21.15.169:3300/0 conn(0x7f43c805e900 msgr2=0x7f43c80aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 --2- 172.21.15.100:0/1205620541 >> v2:172.21.15.169:3300/0 conn(0x7f43c805e900 0x7f43c80aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 >> v1:172.21.15.169:6789/0 conn(0x7f43c80a9f60 legacy=0x7f43c805e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80c7140 con 0x7f43c80c1940 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f43c00017f0 con 0x7f43c80c1940 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 >> v1:172.21.15.100:6789/0 conn(0x7f43c80c1940 legacy=0x7f43c8098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43a8003a70 0x7f43a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8004690 0x7f43a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8158940 con 0x7f43a8005000 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a800be80 con 0x7f43a8004690 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.628+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a800c040 con 0x7f43a8003a70 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c5e00700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43a8003a70 0x7f43a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c5400700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8004690 0x7f43a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 -- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43a8003a70 msgr2=0x7f43a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43a8003a70 0x7f43a8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 -- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8004690 msgr2=0x7f43a8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8004690 0x7f43a8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 -- 172.21.15.100:0/1205620541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80033f0 con 0x7f43a8005000 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 -- 172.21.15.100:0/1205620541 reap_dead start 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c6800700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43a800b8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f43c0007fd0 tx=0x7f43c0007f40).ready entity=mon.0 client_cookie=dcefe7baa0f1202c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000cd90 con 0x7f43a8005000 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0005b20 con 0x7f43a8005000 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.629+0000 7f43c4a00700 1 -- 172.21.15.100:0/1205620541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0005ea0 con 0x7f43a8005000 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.630+0000 7f43cce00700 1 -- 172.21.15.100:0/1205620541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 msgr2=0x7f43a800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.630+0000 7f43cce00700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43a800b8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f43c0007fd0 tx=0x7f43c0007f40).stop 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.630+0000 7f43cce00700 1 -- 172.21.15.100:0/1205620541 shutdown_connections 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.630+0000 7f43cce00700 1 --2- 172.21.15.100:0/1205620541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43a800b8e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.630+0000 7f43cce00700 1 -- 172.21.15.100:0/1205620541 >> 172.21.15.100:0/1205620541 conn(0x7f43c80cada0 msgr2=0x7f43c80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.630+0000 7f43cce00700 1 -- 172.21.15.100:0/1205620541 shutdown_connections 2024-01-22T05:38:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.630+0000 7f43cce00700 1 -- 172.21.15.100:0/1205620541 wait complete. 2024-01-22T05:38:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.632+0000 7f43cce00700 1 Processor -- start 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.632+0000 7f43cce00700 1 -- start start 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43cce00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43c8154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43cce00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43c815a350 0x7f43c80c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43cce00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c80c3d30 0x7f43c8141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43cce00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8155a80 con 0x7f43a8005000 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43cce00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8154e70 con 0x7f43c80c3d30 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43cce00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8155150 con 0x7f43c815a350 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43c8154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43c8154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33398/0 (socket says 172.21.15.100:33398) 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 -- 172.21.15.100:0/1752442484 learned_addr learned my addr 172.21.15.100:0/1752442484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5400700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43c815a350 0x7f43c80c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c6800700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c80c3d30 0x7f43c8141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 -- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43c815a350 msgr2=0x7f43c80c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43c815a350 0x7f43c80c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 -- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c80c3d30 msgr2=0x7f43c8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c80c3d30 0x7f43c8141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 -- 172.21.15.100:0/1752442484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8155430 con 0x7f43a8005000 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c6800700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c80c3d30 0x7f43c8141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.633+0000 7f43c5e00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43c8154690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f43b8002a20 tx=0x7f43b8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.634+0000 7f43bd600700 1 -- 172.21.15.100:0/1752442484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800f8d0 con 0x7f43a8005000 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.634+0000 7f43bd600700 1 -- 172.21.15.100:0/1752442484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800fa30 con 0x7f43a8005000 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.634+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c8155710 con 0x7f43a8005000 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.634+0000 7f43bd600700 1 -- 172.21.15.100:0/1752442484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800fdd0 con 0x7f43a8005000 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.634+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c8141c30 con 0x7f43a8005000 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.635+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c805fdb0 con 0x7f43a8005000 2024-01-22T05:38:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.635+0000 7f43bd600700 1 -- 172.21.15.100:0/1752442484 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f43b801d3b0 con 0x7f43a8005000 2024-01-22T05:38:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.636+0000 7f43bd600700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43a005f120 0x7f43a00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.636+0000 7f43bd600700 1 -- 172.21.15.100:0/1752442484 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f43b807a1b0 con 0x7f43a8005000 2024-01-22T05:38:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.636+0000 7f43c5400700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43a005f120 0x7f43a00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.637+0000 7f43c5400700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43a005f120 0x7f43a00615e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f43c80c4dd0 tx=0x7f43b0009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.640+0000 7f43bd600700 1 -- 172.21.15.100:0/1752442484 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f43b804b420 con 0x7f43a8005000 2024-01-22T05:38:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.807+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43c80ca030 con 0x7f43a8005000 2024-01-22T05:38:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.807+0000 7f43bd600700 1 -- 172.21.15.100:0/1752442484 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43b804ea40 con 0x7f43a8005000 2024-01-22T05:38:15.808 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43a005f120 msgr2=0x7f43a00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43a005f120 0x7f43a00615e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f43c80c4dd0 tx=0x7f43b0009060).stop 2024-01-22T05:38:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 msgr2=0x7f43c8154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43c8154690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f43b8002a20 tx=0x7f43b8007bb0).stop 2024-01-22T05:38:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 shutdown_connections 2024-01-22T05:38:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43a005f120 0x7f43a00615e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43c80c3d30 0x7f43c8141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a8005000 0x7f43c8154690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 --2- 172.21.15.100:0/1752442484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43c815a350 0x7f43c80c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.809+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 >> 172.21.15.100:0/1752442484 conn(0x7f43c80cada0 msgr2=0x7f43c80add50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.810+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 shutdown_connections 2024-01-22T05:38:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:15.810+0000 7f43cce00700 1 -- 172.21.15.100:0/1752442484 wait complete. 2024-01-22T05:38:15.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:38:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.011+0000 7fe5bd600700 1 Processor -- start 2024-01-22T05:38:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.012+0000 7fe5bd600700 1 -- start start 2024-01-22T05:38:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.013+0000 7fe5bd600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 0x7fe5b8158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.013+0000 7fe5bd600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe5b81586f0 0x7fe5b80c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.013+0000 7fe5bd600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b80c1a40 con 0x7fe5b8154260 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.013+0000 7fe5bd600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80cbd30 con 0x7fe5b81586f0 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.013+0000 7fe5bd600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8158b80 con 0x7fe5b8157d80 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.013+0000 7fe5b6a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe5b8154260 0x7fe5b80cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45580/0 (socket says 172.21.15.100:45580) 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.013+0000 7fe5b6a00700 1 -- 172.21.15.100:0/2555111774 learned_addr learned my addr 172.21.15.100:0/2555111774 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b6000700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 0x7fe5b8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b7400700 1 --2- 172.21.15.100:0/2555111774 >> v2:172.21.15.169:3300/0 conn(0x7fe5b81586f0 0x7fe5b80c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018806354 0 0) 0x7fe5b80c1a40 con 0x7fe5b8154260 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5980033f0 con 0x7fe5b8154260 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1945646636 0 0) 0x7fe5980033f0 con 0x7fe5b8154260 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 msgr2=0x7fe5b8158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 0x7fe5b8158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 >> v2:172.21.15.169:3300/0 conn(0x7fe5b81586f0 msgr2=0x7fe5b80c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 --2- 172.21.15.100:0/2555111774 >> v2:172.21.15.169:3300/0 conn(0x7fe5b81586f0 0x7fe5b80c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80c1110 con 0x7fe5b8154260 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fe5a80015f0 con 0x7fe5b8154260 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 >> v1:172.21.15.100:6789/0 conn(0x7fe5b8154260 legacy=0x7fe5b80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980038e0 0x7fe598003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 0x7fe598004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe598004b80 0x7fe598005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80cbd30 con 0x7fe5980038e0 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8158b80 con 0x7fe598004b80 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59800b8e0 con 0x7fe5b8157d80 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b6a00700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980038e0 0x7fe598003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b6000700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 0x7fe598004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.014+0000 7fe5b7400700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe598004b80 0x7fe598005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b6a00700 1 -- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 msgr2=0x7fe598004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b6a00700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b8157d80 0x7fe598004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b6a00700 1 -- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe598004b80 msgr2=0x7fe598005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b6a00700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe598004b80 0x7fe598005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b6a00700 1 -- 172.21.15.100:0/2555111774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980033f0 con 0x7fe5980038e0 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b7400700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe598004b80 0x7fe598005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b6a00700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980038e0 0x7fe598003d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe5a800c160 tx=0x7fe5a80077a0).ready entity=mon.0 client_cookie=a366f05ce8c3437 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80079d0 con 0x7fe5980038e0 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a800ca90 con 0x7fe5980038e0 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.015+0000 7fe5b5600700 1 -- 172.21.15.100:0/2555111774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800ce10 con 0x7fe5980038e0 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.016+0000 7fe5bd600700 1 -- 172.21.15.100:0/2555111774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980038e0 msgr2=0x7fe598003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.016+0000 7fe5bd600700 1 --2- 172.21.15.100:0/2555111774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980038e0 0x7fe598003d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe5a800c160 tx=0x7fe5a80077a0).stop 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.016+0000 7fe5b7400700 1 -- 172.21.15.100:0/2555111774 reap_dead start 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.016+0000 7fe5bd600700 1 -- 172.21.15.100:0/2555111774 shutdown_connections 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.016+0000 7fe5bd600700 1 -- 172.21.15.100:0/2555111774 >> 172.21.15.100:0/2555111774 conn(0x7fe5b805e9d0 msgr2=0x7fe5b80cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.016+0000 7fe5bd600700 1 -- 172.21.15.100:0/2555111774 shutdown_connections 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.016+0000 7fe5bd600700 1 -- 172.21.15.100:0/2555111774 wait complete. 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.017+0000 7fe5bd600700 1 Processor -- start 2024-01-22T05:38:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.017+0000 7fe5bd600700 1 -- start start 2024-01-22T05:38:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.018+0000 7fe5bd600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5980038e0 0x7fe5b8148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.018+0000 7fe5bd600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b80a8b50 0x7fe5b80a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.018+0000 7fe5bd600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b81548f0 0x7fe5b8154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.018+0000 7fe5bd600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80af310 con 0x7fe5b80a8b50 2024-01-22T05:38:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.018+0000 7fe5bd600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80a94c0 con 0x7fe5980038e0 2024-01-22T05:38:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.018+0000 7fe5bd600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8148f90 con 0x7fe5b81548f0 2024-01-22T05:38:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.018+0000 7fe5b6000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b80a8b50 0x7fe5b80a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b80a8b50 0x7fe5b80a8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33422/0 (socket says 172.21.15.100:33422) 2024-01-22T05:38:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 -- 172.21.15.100:0/1405625862 learned_addr learned my addr 172.21.15.100:0/1405625862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6a00700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5980038e0 0x7fe5b8148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b7400700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b81548f0 0x7fe5b8154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 -- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b81548f0 msgr2=0x7fe5b8154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b81548f0 0x7fe5b8154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 -- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5980038e0 msgr2=0x7fe5b8148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5980038e0 0x7fe5b8148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 -- 172.21.15.100:0/1405625862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8155640 con 0x7fe5b80a8b50 2024-01-22T05:38:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5b6000700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b80a8b50 0x7fe5b80a8fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fe5a0011a20 tx=0x7fe5a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5ae000700 1 -- 172.21.15.100:0/1405625862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0011e60 con 0x7fe5b80a8b50 2024-01-22T05:38:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5ae000700 1 -- 172.21.15.100:0/1405625862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000f8c0 con 0x7fe5b80a8b50 2024-01-22T05:38:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b8155920 con 0x7fe5b80a8b50 2024-01-22T05:38:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5ae000700 1 -- 172.21.15.100:0/1405625862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000fc40 con 0x7fe5b80a8b50 2024-01-22T05:38:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.019+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b80aefa0 con 0x7fe5b80a8b50 2024-01-22T05:38:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.021+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b805fdb0 con 0x7fe5b80a8b50 2024-01-22T05:38:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.021+0000 7fe5ae000700 1 -- 172.21.15.100:0/1405625862 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe5a0014440 con 0x7fe5b80a8b50 2024-01-22T05:38:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.022+0000 7fe5ae000700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe59005f150 0x7fe590061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.022+0000 7fe5ae000700 1 -- 172.21.15.100:0/1405625862 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe5a007acc0 con 0x7fe5b80a8b50 2024-01-22T05:38:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.022+0000 7fe5b6a00700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe59005f150 0x7fe590061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.023+0000 7fe5b6a00700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe59005f150 0x7fe590061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe5a8000ef0 tx=0x7fe5a8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.026+0000 7fe5ae000700 1 -- 172.21.15.100:0/1405625862 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5a004bf30 con 0x7fe5b80a8b50 2024-01-22T05:38:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.200+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5b8084940 con 0x7fe5b80a8b50 2024-01-22T05:38:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.200+0000 7fe5ae000700 1 -- 172.21.15.100:0/1405625862 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5a004f550 con 0x7fe5b80a8b50 2024-01-22T05:38:16.202 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:16.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe59005f150 msgr2=0x7fe590061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe59005f150 0x7fe590061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe5a8000ef0 tx=0x7fe5a8015000).stop 2024-01-22T05:38:16.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b80a8b50 msgr2=0x7fe5b80a8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b80a8b50 0x7fe5b80a8fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fe5a0011a20 tx=0x7fe5a0009060).stop 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 shutdown_connections 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe59005f150 0x7fe590061610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5980038e0 0x7fe5b8148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5b81548f0 0x7fe5b8154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 --2- 172.21.15.100:0/1405625862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b80a8b50 0x7fe5b80a8fd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.202+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 >> 172.21.15.100:0/1405625862 conn(0x7fe5b805e9d0 msgr2=0x7fe5b80ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.203+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 shutdown_connections 2024-01-22T05:38:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.203+0000 7fe5bd600700 1 -- 172.21.15.100:0/1405625862 wait complete. 2024-01-22T05:38:16.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:38:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.406+0000 7fb74f000700 1 Processor -- start 2024-01-22T05:38:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.407+0000 7fb74f000700 1 -- start start 2024-01-22T05:38:16.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb74f000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb748154260 0x7fb7480cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb74f000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 0x7fb7480c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb74f000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480c1a40 con 0x7fb7480c5c80 2024-01-22T05:38:16.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb74f000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480cbd30 con 0x7fb748154260 2024-01-22T05:38:16.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb74f000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480c1110 con 0x7fb7480c6810 2024-01-22T05:38:16.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb747e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb748154260 0x7fb7480cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb747e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb748154260 0x7fb7480cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33436/0 (socket says 172.21.15.100:33436) 2024-01-22T05:38:16.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb747e00700 1 -- 172.21.15.100:0/4092647337 learned_addr learned my addr 172.21.15.100:0/4092647337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:16.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb747e00700 1 -- 172.21.15.100:0/4092647337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 msgr2=0x7fb7480c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:16.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb747e00700 1 --2- 172.21.15.100:0/4092647337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 0x7fb7480c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:16.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.408+0000 7fb747e00700 1 -- 172.21.15.100:0/4092647337 >> v1:172.21.15.169:6789/0 conn(0x7fb7480c5c80 legacy=0x7fb7480c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:16.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.409+0000 7fb747e00700 1 -- 172.21.15.100:0/4092647337 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480c13f0 con 0x7fb748154260 2024-01-22T05:38:16.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.409+0000 7fb747e00700 1 --2- 172.21.15.100:0/4092647337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb7480cb4e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fb738009810 tx=0x7fb738009060).ready entity=mon.0 client_cookie=79c4e0c5f1f01062 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.409+0000 7fb746a00700 1 -- 172.21.15.100:0/4092647337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738005880 con 0x7fb748154260 2024-01-22T05:38:16.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.409+0000 7fb746a00700 1 -- 172.21.15.100:0/4092647337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7380059e0 con 0x7fb748154260 2024-01-22T05:38:16.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.409+0000 7fb746a00700 1 -- 172.21.15.100:0/4092647337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738005d60 con 0x7fb748154260 2024-01-22T05:38:16.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.409+0000 7fb74f000700 1 -- 172.21.15.100:0/4092647337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 msgr2=0x7fb7480cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.409+0000 7fb74f000700 1 --2- 172.21.15.100:0/4092647337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb7480cb4e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fb738009810 tx=0x7fb738009060).stop 2024-01-22T05:38:16.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.410+0000 7fb74f000700 1 -- 172.21.15.100:0/4092647337 shutdown_connections 2024-01-22T05:38:16.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.410+0000 7fb74f000700 1 --2- 172.21.15.100:0/4092647337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb7480cb4e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.410+0000 7fb74f000700 1 --2- 172.21.15.100:0/4092647337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 0x7fb7480c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:16.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.410+0000 7fb74f000700 1 -- 172.21.15.100:0/4092647337 >> 172.21.15.100:0/4092647337 conn(0x7fb74805e9d0 msgr2=0x7fb7480cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:16.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.410+0000 7fb74f000700 1 -- 172.21.15.100:0/4092647337 shutdown_connections 2024-01-22T05:38:16.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.410+0000 7fb74f000700 1 -- 172.21.15.100:0/4092647337 wait complete. 2024-01-22T05:38:16.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.412+0000 7fb74f000700 1 Processor -- start 2024-01-22T05:38:16.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.412+0000 7fb74f000700 1 -- start start 2024-01-22T05:38:16.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74f000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7480c5c80 0x7fb7480af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74f000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 0x7fb7480aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74f000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb748152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74f000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480b0820 con 0x7fb748154260 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74f000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480afc10 con 0x7fb7480c5c80 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74f000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480afef0 con 0x7fb7480c6810 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74d000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb748152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74d000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb748152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33448/0 (socket says 172.21.15.100:33448) 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb74d000700 1 -- 172.21.15.100:0/270701536 learned_addr learned my addr 172.21.15.100:0/270701536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb747e00700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7480c5c80 0x7fb7480af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.413+0000 7fb747400700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 0x7fb7480aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74d000700 1 -- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 msgr2=0x7fb7480aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74d000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 0x7fb7480aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74d000700 1 -- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7480c5c80 msgr2=0x7fb7480af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74d000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7480c5c80 0x7fb7480af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74d000700 1 -- 172.21.15.100:0/270701536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738009300 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74d000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb748152e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb74000bb60 tx=0x7fb740009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb73f400700 1 -- 172.21.15.100:0/270701536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000c7e0 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb73f400700 1 -- 172.21.15.100:0/270701536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74000c960 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480b01d0 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb73f400700 1 -- 172.21.15.100:0/270701536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000cb10 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.414+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7480af090 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.415+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7480b0990 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.416+0000 7fb73f400700 1 -- 172.21.15.100:0/270701536 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb740012020 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.417+0000 7fb73f400700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72005f150 0x7fb720061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.417+0000 7fb73f400700 1 -- 172.21.15.100:0/270701536 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb74007a120 con 0x7fb748154260 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.417+0000 7fb747e00700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72005f150 0x7fb720061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.417+0000 7fb747e00700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72005f150 0x7fb720061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb738009fd0 tx=0x7fb738016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.420+0000 7fb73f400700 1 -- 172.21.15.100:0/270701536 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb74004b3e0 con 0x7fb748154260 2024-01-22T05:38:16.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.589+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7480c16d0 con 0x7fb748154260 2024-01-22T05:38:16.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.590+0000 7fb73f400700 1 -- 172.21.15.100:0/270701536 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb740009910 con 0x7fb748154260 2024-01-22T05:38:16.591 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:16.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.591+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72005f150 msgr2=0x7fb720061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.591+0000 7fb74f000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72005f150 0x7fb720061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb738009fd0 tx=0x7fb738016000).stop 2024-01-22T05:38:16.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 msgr2=0x7fb748152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb748152e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb74000bb60 tx=0x7fb740009810).stop 2024-01-22T05:38:16.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 shutdown_connections 2024-01-22T05:38:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72005f150 0x7fb720061610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7480c5c80 0x7fb7480af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb748154260 0x7fb748152e00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 --2- 172.21.15.100:0/270701536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7480c6810 0x7fb7480aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 >> 172.21.15.100:0/270701536 conn(0x7fb74805e9d0 msgr2=0x7fb7481536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 shutdown_connections 2024-01-22T05:38:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.592+0000 7fb74f000700 1 -- 172.21.15.100:0/270701536 wait complete. 2024-01-22T05:38:16.610 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:16.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.793+0000 7f5ae3600700 1 Processor -- start 2024-01-22T05:38:16.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.793+0000 7f5ae3600700 1 -- start start 2024-01-22T05:38:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.794+0000 7f5ae3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.794+0000 7f5ae3600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc065760 con 0x7f5adc06a290 2024-01-22T05:38:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.794+0000 7f5ae3600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0bc340 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.794+0000 7f5ae3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc06a780 con 0x7f5adc0a5ab0 2024-01-22T05:38:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.794+0000 7f5ae1600700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5adc06a290 0x7f5adc153da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45584/0 (socket says 172.21.15.100:45584) 2024-01-22T05:38:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.794+0000 7f5ae1600700 1 -- 172.21.15.100:0/2689816643 learned_addr learned my addr 172.21.15.100:0/2689816643 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:16.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.794+0000 7f5ae0c00700 1 --2- 172.21.15.100:0/2689816643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5adb400700 1 -- 172.21.15.100:0/2689816643 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117505026 0 0) 0x7f5adc065760 con 0x7f5adc06a290 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5adb400700 1 -- 172.21.15.100:0/2689816643 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5abc005600 con 0x7f5adc06a290 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5adb400700 1 -- 172.21.15.100:0/2689816643 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102823338 0 0) 0x7f5adc0bc340 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5adb400700 1 -- 172.21.15.100:0/2689816643 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5adc065760 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5ae0c00700 1 -- 172.21.15.100:0/2689816643 >> v1:172.21.15.169:6789/0 conn(0x7f5adc0c0fc0 legacy=0x7f5adc069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5ae0c00700 1 -- 172.21.15.100:0/2689816643 >> v1:172.21.15.100:6789/0 conn(0x7f5adc06a290 legacy=0x7f5adc153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5ae0c00700 1 -- 172.21.15.100:0/2689816643 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0bba50 con 0x7f5adc0a5ab0 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5ae0c00700 1 --2- 172.21.15.100:0/2689816643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0a5e90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5acc009790 tx=0x7f5acc009060).ready entity=mon.2 client_cookie=f6a6e1bc31c48521 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5adb400700 1 -- 172.21.15.100:0/2689816643 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0090d0 con 0x7f5adc0a5ab0 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5adb400700 1 -- 172.21.15.100:0/2689816643 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00f510 con 0x7f5adc0a5ab0 2024-01-22T05:38:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.795+0000 7f5adb400700 1 -- 172.21.15.100:0/2689816643 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00f890 con 0x7f5adc0a5ab0 2024-01-22T05:38:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.796+0000 7f5ae3600700 1 -- 172.21.15.100:0/2689816643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 msgr2=0x7f5adc0a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.796+0000 7f5ae3600700 1 --2- 172.21.15.100:0/2689816643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0a5e90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5acc009790 tx=0x7f5acc009060).stop 2024-01-22T05:38:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.796+0000 7f5ae3600700 1 -- 172.21.15.100:0/2689816643 shutdown_connections 2024-01-22T05:38:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.796+0000 7f5ae3600700 1 --2- 172.21.15.100:0/2689816643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0a5e90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.796+0000 7f5ae3600700 1 -- 172.21.15.100:0/2689816643 >> 172.21.15.100:0/2689816643 conn(0x7f5adc063090 msgr2=0x7f5adc0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.796+0000 7f5ae3600700 1 -- 172.21.15.100:0/2689816643 shutdown_connections 2024-01-22T05:38:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.796+0000 7f5ae3600700 1 -- 172.21.15.100:0/2689816643 wait complete. 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.797+0000 7f5ae3600700 1 Processor -- start 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.798+0000 7f5ae3600700 1 -- start start 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.798+0000 7f5ae3600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5adc06a290 0x7f5adc148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.798+0000 7f5ae3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0bec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae3600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5adc0c0fc0 0x7f5adc0bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae3600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc151120 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae3600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc150510 con 0x7f5adc06a290 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc1507f0 con 0x7f5adc0a5ab0 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5adc0c0fc0 0x7f5adc0bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5adc0c0fc0 0x7f5adc0bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33460/0 (socket says 172.21.15.100:33460) 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 -- 172.21.15.100:0/96371476 learned_addr learned my addr 172.21.15.100:0/96371476 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae0c00700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5adc06a290 0x7f5adc148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5adbe00700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0bec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 -- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 msgr2=0x7f5adc0bec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0bec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 -- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5adc06a290 msgr2=0x7f5adc148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5adc06a290 0x7f5adc148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 -- 172.21.15.100:0/96371476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0092a0 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.799+0000 7f5ae1600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5adc0c0fc0 0x7f5adc0bf140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5ad4001560 tx=0x7f5ad40015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.800+0000 7f5ad3e00700 1 -- 172.21.15.100:0/96371476 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4005d30 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.800+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc150ad0 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.800+0000 7f5ad3e00700 1 -- 172.21.15.100:0/96371476 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4005e90 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.800+0000 7f5ad3e00700 1 -- 172.21.15.100:0/96371476 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40072e0 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.800+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc0bf630 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.801+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc151290 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.801+0000 7f5ad3e00700 1 -- 172.21.15.100:0/96371476 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5ad4007650 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.802+0000 7f5ad3e00700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5ab405f150 0x7f5ab4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.802+0000 7f5ad3e00700 1 -- 172.21.15.100:0/96371476 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ad4079b50 con 0x7f5adc0c0fc0 2024-01-22T05:38:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.802+0000 7f5ae0c00700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5ab405f150 0x7f5ab4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:16.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.803+0000 7f5ae0c00700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5ab405f150 0x7f5ab4061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5acc009fd0 tx=0x7f5acc017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:16.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:16.806+0000 7f5ad3e00700 1 -- 172.21.15.100:0/96371476 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ad404ae20 con 0x7f5adc0c0fc0 2024-01-22T05:38:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.014+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5adc05fdb0 con 0x7f5adc0c0fc0 2024-01-22T05:38:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.014+0000 7f5ad3e00700 1 -- 172.21.15.100:0/96371476 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f5ad404e440 con 0x7f5adc0c0fc0 2024-01-22T05:38:17.015 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:17.016 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5ab405f150 msgr2=0x7f5ab4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5ab405f150 0x7f5ab4061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5acc009fd0 tx=0x7f5acc017000).stop 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5adc0c0fc0 msgr2=0x7f5adc0bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5adc0c0fc0 0x7f5adc0bf140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5ad4001560 tx=0x7f5ad40015b0).stop 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 shutdown_connections 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5ab405f150 0x7f5ab4061610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5adc06a290 0x7f5adc148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5adc0c0fc0 0x7f5adc0bf140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 --2- 172.21.15.100:0/96371476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5adc0a5ab0 0x7f5adc0bec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.016+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 >> 172.21.15.100:0/96371476 conn(0x7f5adc063090 msgr2=0x7f5adc0c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.017+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 shutdown_connections 2024-01-22T05:38:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.017+0000 7f5ae3600700 1 -- 172.21.15.100:0/96371476 wait complete. 2024-01-22T05:38:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:17.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:17.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.220+0000 7f1e39400700 1 Processor -- start 2024-01-22T05:38:17.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.220+0000 7f1e39400700 1 -- start start 2024-01-22T05:38:17.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.221+0000 7f1e39400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 0x7f1e341543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.221+0000 7f1e39400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1e340c5cd0 0x7f1e340c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.221+0000 7f1e39400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e340c66e0 con 0x7f1e340a9d30 2024-01-22T05:38:17.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.221+0000 7f1e39400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e340c0750 con 0x7f1e340c5cd0 2024-01-22T05:38:17.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.221+0000 7f1e39400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340c1bf0 con 0x7f1e34153ff0 2024-01-22T05:38:17.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.221+0000 7f1e33200700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1e340a9d30 0x7f1e34157dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45588/0 (socket says 172.21.15.100:45588) 2024-01-22T05:38:17.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e33200700 1 -- 172.21.15.100:0/2266087740 learned_addr learned my addr 172.21.15.100:0/2266087740 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e32800700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 0x7f1e341543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2266087740 >> v2:172.21.15.169:3300/0 conn(0x7f1e340c5cd0 0x7f1e340c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318465799 0 0) 0x7f1e340c66e0 con 0x7f1e340a9d30 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e140033f0 con 0x7f1e340a9d30 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621368585 0 0) 0x7f1e140033f0 con 0x7f1e340a9d30 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 msgr2=0x7f1e341543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 0x7f1e341543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 >> v2:172.21.15.169:3300/0 conn(0x7f1e340c5cd0 msgr2=0x7f1e340c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 --2- 172.21.15.100:0/2266087740 >> v2:172.21.15.169:3300/0 conn(0x7f1e340c5cd0 0x7f1e340c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340bfe20 con 0x7f1e340a9d30 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f1e2c0017f0 con 0x7f1e340a9d30 2024-01-22T05:38:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 >> v1:172.21.15.100:6789/0 conn(0x7f1e340a9d30 legacy=0x7f1e34157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e14003960 0x7f1e14003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 0x7f1e14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340c0750 con 0x7f1e14004690 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340c1bf0 con 0x7f1e14003960 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.222+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1400b8e0 con 0x7f1e34153ff0 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e32800700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e14003960 0x7f1e14003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e33200700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 0x7f1e14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31e00700 1 -- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 msgr2=0x7f1e14005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34153ff0 0x7f1e14005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31e00700 1 -- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e14003960 msgr2=0x7f1e14003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e14003960 0x7f1e14003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31e00700 1 -- 172.21.15.100:0/2266087740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140033f0 con 0x7f1e14004690 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e14004b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1e340c52e0 tx=0x7f1e1c009060).ready entity=mon.0 client_cookie=ac3787253237bd89 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c009e90 con 0x7f1e14004690 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c009430 con 0x7f1e14004690 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.223+0000 7f1e31400700 1 -- 172.21.15.100:0/2266087740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00e850 con 0x7f1e14004690 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.224+0000 7f1e39400700 1 -- 172.21.15.100:0/2266087740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 msgr2=0x7f1e14004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.224+0000 7f1e39400700 1 --2- 172.21.15.100:0/2266087740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e14004b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1e340c52e0 tx=0x7f1e1c009060).stop 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.224+0000 7f1e33200700 1 -- 172.21.15.100:0/2266087740 reap_dead start 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.224+0000 7f1e39400700 1 -- 172.21.15.100:0/2266087740 shutdown_connections 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.224+0000 7f1e39400700 1 -- 172.21.15.100:0/2266087740 >> 172.21.15.100:0/2266087740 conn(0x7f1e340c82a0 msgr2=0x7f1e3405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.224+0000 7f1e39400700 1 -- 172.21.15.100:0/2266087740 shutdown_connections 2024-01-22T05:38:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.224+0000 7f1e39400700 1 -- 172.21.15.100:0/2266087740 wait complete. 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.226+0000 7f1e39400700 1 Processor -- start 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.226+0000 7f1e39400700 1 -- start start 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e39400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e341560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e39400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34158d30 0x7f1e341591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e39400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e340ae940 0x7f1e340aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e39400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e341596a0 con 0x7f1e14004690 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e39400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34156730 con 0x7f1e340ae940 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e39400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34156a10 con 0x7f1e34158d30 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e341560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e341560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33488/0 (socket says 172.21.15.100:33488) 2024-01-22T05:38:17.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 -- 172.21.15.100:0/2848508586 learned_addr learned my addr 172.21.15.100:0/2848508586 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34158d30 0x7f1e341591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e33200700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e340ae940 0x7f1e340aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 -- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34158d30 msgr2=0x7f1e341591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34158d30 0x7f1e341591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 -- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e340ae940 msgr2=0x7f1e340aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e340ae940 0x7f1e340aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 -- 172.21.15.100:0/2848508586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34156cf0 con 0x7f1e14004690 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34158d30 0x7f1e341591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e33200700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e340ae940 0x7f1e340aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.227+0000 7f1e32800700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e341560c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1e240119f0 tx=0x7f1e24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.228+0000 7f1e2a000700 1 -- 172.21.15.100:0/2848508586 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400f940 con 0x7f1e14004690 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.228+0000 7f1e2a000700 1 -- 172.21.15.100:0/2848508586 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2400faa0 con 0x7f1e14004690 2024-01-22T05:38:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.228+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e34156fd0 con 0x7f1e14004690 2024-01-22T05:38:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.228+0000 7f1e2a000700 1 -- 172.21.15.100:0/2848508586 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400fe20 con 0x7f1e14004690 2024-01-22T05:38:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.228+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e340af2b0 con 0x7f1e14004690 2024-01-22T05:38:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.229+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e34157620 con 0x7f1e14004690 2024-01-22T05:38:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.229+0000 7f1e2a000700 1 -- 172.21.15.100:0/2848508586 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e24014650 con 0x7f1e14004690 2024-01-22T05:38:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.230+0000 7f1e2a000700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e0c05f150 0x7f1e0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.231+0000 7f1e2a000700 1 -- 172.21.15.100:0/2848508586 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e2407ad90 con 0x7f1e14004690 2024-01-22T05:38:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.231+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e0c05f150 0x7f1e0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.231+0000 7f1e31e00700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e0c05f150 0x7f1e0c061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1e1c0095a0 tx=0x7f1e1c01a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.235+0000 7f1e2a000700 1 -- 172.21.15.100:0/2848508586 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e2404c060 con 0x7f1e14004690 2024-01-22T05:38:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.406+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e3405fdb0 con 0x7f1e14004690 2024-01-22T05:38:17.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.407+0000 7f1e2a000700 1 -- 172.21.15.100:0/2848508586 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f1e2404f680 con 0x7f1e14004690 2024-01-22T05:38:17.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:17.408 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e0c05f150 msgr2=0x7f1e0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e0c05f150 0x7f1e0c061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1e1c0095a0 tx=0x7f1e1c01a000).stop 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 msgr2=0x7f1e341560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e341560c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1e240119f0 tx=0x7f1e24009060).stop 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 shutdown_connections 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1e0c05f150 0x7f1e0c061610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e340ae940 0x7f1e340aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004690 0x7f1e341560c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 --2- 172.21.15.100:0/2848508586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e34158d30 0x7f1e341591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 >> 172.21.15.100:0/2848508586 conn(0x7f1e340c82a0 msgr2=0x7f1e340c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 shutdown_connections 2024-01-22T05:38:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.409+0000 7f1e39400700 1 -- 172.21.15.100:0/2848508586 wait complete. 2024-01-22T05:38:17.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.607+0000 7fec9fa00700 1 Processor -- start 2024-01-22T05:38:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.607+0000 7fec9fa00700 1 -- start start 2024-01-22T05:38:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.608+0000 7fec9fa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fec980a58a0 0x7fec9806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.608+0000 7fec9fa00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fec980a5c80 0x7fec98064b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.608+0000 7fec9fa00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec98065c90 con 0x7fec980681e0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.608+0000 7fec9fa00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9806a790 con 0x7fec980a58a0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.608+0000 7fec9fa00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec980bba50 con 0x7fec980a5c80 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fec980a58a0 0x7fec9806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fec980a58a0 0x7fec9806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33496/0 (socket says 172.21.15.100:33496) 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 -- 172.21.15.100:0/3215194407 learned_addr learned my addr 172.21.15.100:0/3215194407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec97e00700 1 --2- 172.21.15.100:0/3215194407 >> v2:172.21.15.169:3300/0 conn(0x7fec980a5c80 0x7fec98064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 -- 172.21.15.100:0/3215194407 >> v2:172.21.15.169:3300/0 conn(0x7fec980a5c80 msgr2=0x7fec98064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 --2- 172.21.15.100:0/3215194407 >> v2:172.21.15.169:3300/0 conn(0x7fec980a5c80 0x7fec98064b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 -- 172.21.15.100:0/3215194407 >> v1:172.21.15.169:6789/0 conn(0x7fec980681e0 legacy=0x7fec98155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 -- 172.21.15.100:0/3215194407 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980653f0 con 0x7fec980a58a0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec9d000700 1 --2- 172.21.15.100:0/3215194407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a58a0 0x7fec9806a2a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fec9813b8e0 tx=0x7fec880090f0).ready entity=mon.0 client_cookie=ac477418dd131822 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.609+0000 7fec97400700 1 -- 172.21.15.100:0/3215194407 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800b520 con 0x7fec980a58a0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec97400700 1 -- 172.21.15.100:0/3215194407 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8800b680 con 0x7fec980a58a0 2024-01-22T05:38:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec97400700 1 -- 172.21.15.100:0/3215194407 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800ba00 con 0x7fec980a58a0 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 -- 172.21.15.100:0/3215194407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a58a0 msgr2=0x7fec9806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3215194407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a58a0 0x7fec9806a2a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fec9813b8e0 tx=0x7fec880090f0).stop 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 -- 172.21.15.100:0/3215194407 shutdown_connections 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3215194407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a58a0 0x7fec9806a2a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3215194407 >> v2:172.21.15.169:3300/0 conn(0x7fec980a5c80 0x7fec98064b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 -- 172.21.15.100:0/3215194407 >> 172.21.15.100:0/3215194407 conn(0x7fec98063090 msgr2=0x7fec980c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 -- 172.21.15.100:0/3215194407 shutdown_connections 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.610+0000 7fec9fa00700 1 -- 172.21.15.100:0/3215194407 wait complete. 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.612+0000 7fec9fa00700 1 Processor -- start 2024-01-22T05:38:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.612+0000 7fec9fa00700 1 -- start start 2024-01-22T05:38:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9fa00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec980681e0 0x7fec98139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9fa00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec980a58a0 0x7fec980ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9fa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a5c80 0x7fec98154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9fa00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980bebe0 con 0x7fec980a5c80 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9fa00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98139c80 con 0x7fec980a58a0 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9fa00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980bdfd0 con 0x7fec980681e0 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a5c80 0x7fec98154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a5c80 0x7fec98154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33500/0 (socket says 172.21.15.100:33500) 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 -- 172.21.15.100:0/3765913078 learned_addr learned my addr 172.21.15.100:0/3765913078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec97e00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec980a58a0 0x7fec980ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9d000700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec980681e0 0x7fec98139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 -- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec980681e0 msgr2=0x7fec98139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec980681e0 0x7fec98139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 -- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec980a58a0 msgr2=0x7fec980ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec980a58a0 0x7fec980ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 -- 172.21.15.100:0/3765913078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88009370 con 0x7fec980a5c80 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.613+0000 7fec9da00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a5c80 0x7fec98154800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fec9000c790 tx=0x7fec900015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.614+0000 7fec8fe00700 1 -- 172.21.15.100:0/3765913078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9000e4a0 con 0x7fec980a5c80 2024-01-22T05:38:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.614+0000 7fec8fe00700 1 -- 172.21.15.100:0/3765913078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9000e600 con 0x7fec980a5c80 2024-01-22T05:38:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.614+0000 7fec8fe00700 1 -- 172.21.15.100:0/3765913078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9000e980 con 0x7fec980a5c80 2024-01-22T05:38:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.614+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec980be2b0 con 0x7fec980a5c80 2024-01-22T05:38:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.614+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec980be870 con 0x7fec980a5c80 2024-01-22T05:38:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.615+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec980bed90 con 0x7fec980a5c80 2024-01-22T05:38:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.615+0000 7fec8fe00700 1 -- 172.21.15.100:0/3765913078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fec9001b3b0 con 0x7fec980a5c80 2024-01-22T05:38:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.617+0000 7fec8fe00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fec7005f150 0x7fec70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.617+0000 7fec8fe00700 1 -- 172.21.15.100:0/3765913078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fec90079890 con 0x7fec980a5c80 2024-01-22T05:38:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.617+0000 7fec9d000700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fec7005f150 0x7fec70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.617+0000 7fec9d000700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fec7005f150 0x7fec70061610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fec88009130 tx=0x7fec88017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:17.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.621+0000 7fec8fe00700 1 -- 172.21.15.100:0/3765913078 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fec90048b00 con 0x7fec980a5c80 2024-01-22T05:38:17.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.832+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec9805fdb0 con 0x7fec980a5c80 2024-01-22T05:38:17.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.832+0000 7fec8fe00700 1 -- 172.21.15.100:0/3765913078 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7fec980bed90 con 0x7fec980a5c80 2024-01-22T05:38:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:17.834 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:17.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fec7005f150 msgr2=0x7fec70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fec7005f150 0x7fec70061610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fec88009130 tx=0x7fec88017000).stop 2024-01-22T05:38:17.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a5c80 msgr2=0x7fec98154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:17.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a5c80 0x7fec98154800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fec9000c790 tx=0x7fec900015e0).stop 2024-01-22T05:38:17.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 shutdown_connections 2024-01-22T05:38:17.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fec7005f150 0x7fec70061610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec980a5c80 0x7fec98154800 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec980681e0 0x7fec98139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 --2- 172.21.15.100:0/3765913078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec980a58a0 0x7fec980ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:17.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 >> 172.21.15.100:0/3765913078 conn(0x7fec98063090 msgr2=0x7fec980c5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:17.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 shutdown_connections 2024-01-22T05:38:17.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:17.835+0000 7fec9fa00700 1 -- 172.21.15.100:0/3765913078 wait complete. 2024-01-22T05:38:17.837 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:18.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:37:58.683906+0000', 'modified': '2024-01-22T05:38:01.694679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6836/1564330749', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 1564330749}, {'type': 'v1', 'addr': '172.21.15.100:6836', 'nonce': 1564330749}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:38:18.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:38:18.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:38:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.440+0000 7f79c5000700 1 Processor -- start 2024-01-22T05:38:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.440+0000 7f79c5000700 1 -- start start 2024-01-22T05:38:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.441+0000 7f79c5000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79c00a9f60 0x7f79c00aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.441+0000 7f79c5000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79c00c1940 0x7f79c00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.441+0000 7f79c5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c005e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.441+0000 7f79c5000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00c74b0 con 0x7f79c00c1940 2024-01-22T05:38:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.441+0000 7f79c5000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00cab90 con 0x7f79c00a9f60 2024-01-22T05:38:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.441+0000 7f79c5000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c005eb70 con 0x7f79c005e1f0 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.441+0000 7f79bd400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79c00c1940 0x7f79c00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79c00c1940 0x7f79c00ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33502/0 (socket says 172.21.15.100:33502) 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 -- 172.21.15.100:0/4105120425 learned_addr learned my addr 172.21.15.100:0/4105120425 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bde00700 1 --2- 172.21.15.100:0/4105120425 >> v2:172.21.15.169:3300/0 conn(0x7f79c00a9f60 0x7f79c00aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79be800700 1 --2- 172.21.15.100:0/4105120425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c005e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 -- 172.21.15.100:0/4105120425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 msgr2=0x7f79c005e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 --2- 172.21.15.100:0/4105120425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c005e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 -- 172.21.15.100:0/4105120425 >> v2:172.21.15.169:3300/0 conn(0x7f79c00a9f60 msgr2=0x7f79c00aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 --2- 172.21.15.100:0/4105120425 >> v2:172.21.15.169:3300/0 conn(0x7f79c00a9f60 0x7f79c00aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 -- 172.21.15.100:0/4105120425 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0158660 con 0x7f79c00c1940 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bd400700 1 --2- 172.21.15.100:0/4105120425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00ca6a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f79c00c8850 tx=0x7f79a80090f0).ready entity=mon.0 client_cookie=1e346fcf105fe11e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bca00700 1 -- 172.21.15.100:0/4105120425 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800b600 con 0x7f79c00c1940 2024-01-22T05:38:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bca00700 1 -- 172.21.15.100:0/4105120425 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800b760 con 0x7f79c00c1940 2024-01-22T05:38:18.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.442+0000 7f79bca00700 1 -- 172.21.15.100:0/4105120425 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800bae0 con 0x7f79c00c1940 2024-01-22T05:38:18.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 -- 172.21.15.100:0/4105120425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 msgr2=0x7f79c00ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 --2- 172.21.15.100:0/4105120425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00ca6a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f79c00c8850 tx=0x7f79a80090f0).stop 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 -- 172.21.15.100:0/4105120425 shutdown_connections 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 --2- 172.21.15.100:0/4105120425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c005e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 --2- 172.21.15.100:0/4105120425 >> v2:172.21.15.169:3300/0 conn(0x7f79c00a9f60 0x7f79c00aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 --2- 172.21.15.100:0/4105120425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00ca6a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 -- 172.21.15.100:0/4105120425 >> 172.21.15.100:0/4105120425 conn(0x7f79c00cada0 msgr2=0x7f79c00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 -- 172.21.15.100:0/4105120425 shutdown_connections 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.443+0000 7f79c5000700 1 -- 172.21.15.100:0/4105120425 wait complete. 2024-01-22T05:38:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.445+0000 7f79c5000700 1 Processor -- start 2024-01-22T05:38:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.445+0000 7f79c5000700 1 -- start start 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.446+0000 7f79c5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c0147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.446+0000 7f79c5000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79c00a9f60 0x7f79c00642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79c5000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79c5000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0064c90 con 0x7f79c00c1940 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79c5000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0165370 con 0x7f79c00a9f60 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79c5000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01644f0 con 0x7f79c005e1f0 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33510/0 (socket says 172.21.15.100:33510) 2024-01-22T05:38:18.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 -- 172.21.15.100:0/4167086929 learned_addr learned my addr 172.21.15.100:0/4167086929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:18.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79bde00700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c0147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79bd400700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79c00a9f60 0x7f79c00642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 -- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 msgr2=0x7f79c0147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c0147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 -- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79c00a9f60 msgr2=0x7f79c00642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79c00a9f60 0x7f79c00642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 -- 172.21.15.100:0/4167086929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a8009370 con 0x7f79c00c1940 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79bde00700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c0147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79bd400700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79c00a9f60 0x7f79c00642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79be800700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00647a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f79b8007f20 tx=0x7f79b8009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79b5600700 1 -- 172.21.15.100:0/4167086929 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b800eca0 con 0x7f79c00c1940 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.447+0000 7f79b5600700 1 -- 172.21.15.100:0/4167086929 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b800ee00 con 0x7f79c00c1940 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.448+0000 7f79b5600700 1 -- 172.21.15.100:0/4167086929 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8014610 con 0x7f79c00c1940 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.448+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c01647d0 con 0x7f79c00c1940 2024-01-22T05:38:18.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.448+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c0164d90 con 0x7f79c00c1940 2024-01-22T05:38:18.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.449+0000 7f79b5600700 1 -- 172.21.15.100:0/4167086929 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f79b8014980 con 0x7f79c00c1940 2024-01-22T05:38:18.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.450+0000 7f79b5600700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f799805f150 0x7f7998061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.450+0000 7f79b5600700 1 -- 172.21.15.100:0/4167086929 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f79b807a830 con 0x7f79c00c1940 2024-01-22T05:38:18.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.451+0000 7f79bde00700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f799805f150 0x7f7998061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.451+0000 7f79bde00700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f799805f150 0x7f7998061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f79b0009810 tx=0x7f79b0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.453+0000 7f79dc501b80 1 Processor -- start 2024-01-22T05:38:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.453+0000 7f79dc501b80 1 -- start start 2024-01-22T05:38:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860ea740 0x5571860c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55718609e9c0 0x5571860eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860df7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79dc501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557185fd82f0 con 0x5571860ea740 2024-01-22T05:38:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x557185fed7e0 con 0x55718609e9c0 2024-01-22T05:38:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x557185fed920 con 0x5571860eb010 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860ea740 0x5571860c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860ea740 0x5571860c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33512/0 (socket says 172.21.15.100:33512) 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 -- 172.21.15.100:0/4077611969 learned_addr learned my addr 172.21.15.100:0/4077611969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79be800700 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860df7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bd400700 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55718609e9c0 0x5571860eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 -- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 msgr2=0x5571860df7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860df7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 -- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55718609e9c0 msgr2=0x5571860eab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55718609e9c0 0x5571860eab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.454+0000 7f79bde00700 1 -- 172.21.15.100:0/4077611969 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557185fe6720 con 0x5571860ea740 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79bde00700 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860ea740 0x5571860c43d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f79b0016870 tx=0x7f79b0012000).ready entity=mon.0 client_cookie=5941c34af3f336d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79ada00700 1 -- 172.21.15.100:0/4077611969 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b001b070 con 0x5571860ea740 2024-01-22T05:38:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79ada00700 1 -- 172.21.15.100:0/4077611969 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00160d0 con 0x5571860ea740 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79ada00700 1 -- 172.21.15.100:0/4077611969 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0013890 con 0x5571860ea740 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79dc501b80 1 -- 172.21.15.100:0/4077611969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860ea740 msgr2=0x5571860c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79dc501b80 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860ea740 0x5571860c43d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f79b0016870 tx=0x7f79b0012000).stop 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79dc501b80 1 -- 172.21.15.100:0/4077611969 shutdown_connections 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79dc501b80 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860df7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79dc501b80 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860ea740 0x5571860c43d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79dc501b80 1 --2- 172.21.15.100:0/4077611969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55718609e9c0 0x5571860eab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.455+0000 7f79dc501b80 1 -- 172.21.15.100:0/4077611969 >> 172.21.15.100:0/4077611969 conn(0x557185f05940 msgr2=0x5571860e51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.456+0000 7f79dc501b80 1 -- 172.21.15.100:0/4077611969 shutdown_connections 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.456+0000 7f79dc501b80 1 -- 172.21.15.100:0/4077611969 wait complete. 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.456+0000 7f79dc501b80 1 -- start start 2024-01-22T05:38:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.456+0000 7f79dc501b80 1 Processor -- start 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.457+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55718609e9c0 0x5571860c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.457+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.457+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860eb010 0x5571860c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.457+0000 7f79dc501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557185fedba0 con 0x5571860eb010 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.457+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x557185fb8e60 con 0x5571860ea740 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.457+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571860c5be0 con 0x55718609e9c0 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79dc501b80 10 client.0 ll_register_callbacks cb 0x557185f8dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860eb010 0x5571860c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860eb010 0x5571860c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33526/0 (socket says 172.21.15.100:33526) 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 -- 172.21.15.100:0/3339992010 learned_addr learned my addr 172.21.15.100:0/3339992010 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:18.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79bde00700 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55718609e9c0 0x5571860c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79bd400700 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 -- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55718609e9c0 msgr2=0x5571860c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55718609e9c0 0x5571860c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 -- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 msgr2=0x5571860c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 -- 172.21.15.100:0/3339992010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b00165e0 con 0x5571860eb010 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79be800700 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860eb010 0x5571860c8170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f79b804f400 tx=0x7f79b807a040).ready entity=mon.0 client_cookie=ae839aacca33fd35 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79a6000700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79a6000700 1 -- 172.21.15.100:0/3339992010 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8058020 con 0x5571860eb010 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.458+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571860901a0 con 0x5571860eb010 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79a6000700 1 -- 172.21.15.100:0/3339992010 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f79b804b4f0 con 0x5571860eb010 2024-01-22T05:38:18.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79a6000700 1 -- 172.21.15.100:0/3339992010 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79b804b6b0 con 0x5571860eb010 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 10 client.4644 fetch_fsmap learned FSMap version 7 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557185fe1ac0 con 0x5571860eb010 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79a6000700 1 -- 172.21.15.100:0/3339992010 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571860901a0 con 0x5571860eb010 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79a6000700 1 -- 172.21.15.100:0/3339992010 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79b804e660 con 0x5571860eb010 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 10 client.4644 fetch_fsmap finished waiting for FSMap version 7 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 10 client.4644 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 20 client.4644 populate_metadata read hostname 'smithi100' 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c2d90 0x5571860c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 4 client.4644 mds_command: new command op to 4272 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 --> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557185e55ef0 con 0x5571860c2d90 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.459+0000 7f79bde00700 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c2d90 0x5571860c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.460+0000 7f79a6000700 10 client.4644 ms_handle_connect on v2:172.21.15.100:6834/1564330749 2024-01-22T05:38:18.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.460+0000 7f79bde00700 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c2d90 0x5571860c3170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8f0950811ce5a68d server_cookie=3b54f4349f86767b in_seq=0 out_seq=0 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.460+0000 7f79a6000700 1 -- 172.21.15.100:0/3339992010 <== mds.0 v2:172.21.15.100:6834/1564330749 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x557185e55ef0 con 0x5571860c2d90 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.460+0000 7f79a6000700 10 client.4644 handle_command_reply: tid=0 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.460+0000 7f79dc501b80 1 client.4644 shutdown 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860eb010 msgr2=0x5571860c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860eb010 0x5571860c8170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f79b804f400 tx=0x7f79b807a040).stop 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 shutdown_connections 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c2d90 0x5571860c3170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571860eb010 0x5571860c8170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55718609e9c0 0x5571860c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79a6000700 0 client.4644 ms_handle_reset on v2:172.21.15.100:6834/1564330749 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 --2- 172.21.15.100:0/3339992010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 >> 172.21.15.100:0/3339992010 conn(0x557185f05940 msgr2=0x55718609cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 shutdown_connections 2024-01-22T05:38:18.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 1 -- 172.21.15.100:0/3339992010 wait complete. 2024-01-22T05:38:18.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.461+0000 7f79dc501b80 20 client.4644 trim_cache size 0 max 16384 2024-01-22T05:38:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.478+0000 7f79dc501b80 1 Processor -- start 2024-01-22T05:38:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.478+0000 7f79dc501b80 1 -- start start 2024-01-22T05:38:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186098390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x55718609c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x557186141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79dc501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571860c5970 con 0x55718609e9c0 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571860c0340 con 0x5571860ea740 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571860994b0 con 0x5571860eb010 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186098390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186098390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33536/0 (socket says 172.21.15.100:33536) 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 -- 172.21.15.100:0/2719599345 learned_addr learned my addr 172.21.15.100:0/2719599345 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bd400700 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x55718609c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79be800700 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x557186141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 -- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 msgr2=0x557186141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x557186141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 -- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 msgr2=0x55718609c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x55718609c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 -- 172.21.15.100:0/2719599345 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557185fe1810 con 0x55718609e9c0 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bd400700 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x55718609c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.479+0000 7f79bde00700 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186098390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f79b0008010 tx=0x7f79b0023040).ready entity=mon.0 client_cookie=ee446f04e49b6cfc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79ae400700 1 -- 172.21.15.100:0/2719599345 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0027040 con 0x55718609e9c0 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79ae400700 1 -- 172.21.15.100:0/2719599345 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0013680 con 0x55718609e9c0 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79ae400700 1 -- 172.21.15.100:0/2719599345 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b002b280 con 0x55718609e9c0 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 -- 172.21.15.100:0/2719599345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 msgr2=0x557186098390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186098390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f79b0008010 tx=0x7f79b0023040).stop 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 -- 172.21.15.100:0/2719599345 shutdown_connections 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x557186141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186098390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 --2- 172.21.15.100:0/2719599345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x55718609c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 -- 172.21.15.100:0/2719599345 >> 172.21.15.100:0/2719599345 conn(0x557185f05940 msgr2=0x55718609caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:18.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 -- 172.21.15.100:0/2719599345 shutdown_connections 2024-01-22T05:38:18.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.480+0000 7f79dc501b80 1 -- 172.21.15.100:0/2719599345 wait complete. 2024-01-22T05:38:18.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.481+0000 7f79dc501b80 1 -- start start 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.481+0000 7f79dc501b80 1 Processor -- start 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186146240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79dc501b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79dc501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571860c19b0 con 0x55718609e9c0 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571860c25d0 con 0x5571860ea740 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79dc501b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571860e86f0 con 0x5571860eb010 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79dc501b80 10 client.0 ll_register_callbacks cb 0x557185f8dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79bde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79bde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33552/0 (socket says 172.21.15.100:33552) 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.483+0000 7f79bde00700 1 -- 172.21.15.100:0/1688983860 learned_addr learned my addr 172.21.15.100:0/1688983860 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bd400700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bde00700 1 -- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 msgr2=0x5571860c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79be800700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bde00700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bde00700 1 -- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 msgr2=0x5571860c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bde00700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bde00700 1 -- 172.21.15.100:0/1688983860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557185fe6720 con 0x55718609e9c0 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bd400700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79be800700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79bde00700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186146240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f79b0009620 tx=0x7f79b0029000).ready entity=mon.0 client_cookie=2097e057a3b44486 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79a6000700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79a6000700 1 -- 172.21.15.100:0/1688983860 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0027070 con 0x55718609e9c0 2024-01-22T05:38:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79b00160d0 con 0x55718609e9c0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79a6000700 1 -- 172.21.15.100:0/1688983860 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f79b0013c80 con 0x55718609e9c0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79a6000700 1 -- 172.21.15.100:0/1688983860 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79b0013e40 con 0x55718609e9c0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79dc501b80 10 client.4650 fetch_fsmap learned FSMap version 7 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557185e5b1d0 con 0x55718609e9c0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.484+0000 7f79a6000700 1 -- 172.21.15.100:0/1688983860 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00160d0 con 0x55718609e9c0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79a6000700 1 -- 172.21.15.100:0/1688983860 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79b002a070 con 0x55718609e9c0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79dc501b80 10 client.4650 fetch_fsmap finished waiting for FSMap version 7 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79dc501b80 10 client.4650 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79dc501b80 20 client.4650 populate_metadata read hostname 'smithi100' 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79dc501b80 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c05e0 0x5571860c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79dc501b80 4 client.4650 mds_command: new command op to 4272 tid=0[{"prefix": "status"}] 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 --> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557185e8b040 con 0x5571860c05e0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79bd400700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c05e0 0x5571860c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79bd400700 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c05e0 0x5571860c09c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=25ab910a2ed0b4d4 server_cookie=de86247bf7757496 in_seq=0 out_seq=0 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79a6000700 10 client.4650 ms_handle_connect on v2:172.21.15.100:6834/1564330749 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.485+0000 7f79a6000700 1 -- 172.21.15.100:0/1688983860 <== mds.0 v2:172.21.15.100:6834/1564330749 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x557185e8b040 con 0x5571860c05e0 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79a6000700 10 client.4650 handle_command_reply: tid=0 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 client.4650 shutdown 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 msgr2=0x557186146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186146240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f79b0009620 tx=0x7f79b0029000).stop 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 shutdown_connections 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:6834/1564330749,v1:172.21.15.100:6836/1564330749] conn(0x5571860c05e0 0x5571860c09c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5571860eb010 0x5571860c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55718609e9c0 0x557186146240 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79a6000700 0 client.4650 ms_handle_reset on v2:172.21.15.100:6834/1564330749 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 --2- 172.21.15.100:0/1688983860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571860ea740 0x5571860c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 >> 172.21.15.100:0/1688983860 conn(0x557185f05940 msgr2=0x55718609c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 shutdown_connections 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 1 -- 172.21.15.100:0/1688983860 wait complete. 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.486+0000 7f79dc501b80 20 client.4650 trim_cache size 0 max 16384 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "2373e7ef-4ea1-4c09-a2b1-243cb5e8dade", 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4272, 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-01-22T05:38:18.492 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-01-22T05:38:18.493 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 19.800531179, 2024-01-22T05:38:18.493 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 7, 2024-01-22T05:38:18.493 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 22, 2024-01-22T05:38:18.493 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 22, 2024-01-22T05:38:18.493 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 25.11624883 2024-01-22T05:38:18.493 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f799805f150 msgr2=0x7f7998061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f799805f150 0x7f7998061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f79b0009810 tx=0x7f79b0008040).stop 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 msgr2=0x7f79c00647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00647a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f79b8007f20 tx=0x7f79b8009860).stop 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 shutdown_connections 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f799805f150 0x7f7998061610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c00c1940 0x7f79c00647a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79c005e1f0 0x7f79c0147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 --2- 172.21.15.100:0/4167086929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79c00a9f60 0x7f79c00642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 >> 172.21.15.100:0/4167086929 conn(0x7f79c00cada0 msgr2=0x7f79c00c0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:18.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 shutdown_connections 2024-01-22T05:38:18.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.487+0000 7f79c5000700 1 -- 172.21.15.100:0/4167086929 wait complete. 2024-01-22T05:38:18.505 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-22T05:38:18.527 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-22T05:38:18.527 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-22T05:38:18.527 INFO:tasks.ceph_fuse:client.0 config is {} 2024-01-22T05:38:18.528 INFO:tasks.ceph_fuse:client.2 config is {} 2024-01-22T05:38:18.528 INFO:tasks.ceph_fuse:client.1 config is {} 2024-01-22T05:38:18.528 INFO:tasks.ceph_fuse:client.3 config is {} 2024-01-22T05:38:18.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:18.528 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:38:18.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:18.573 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-01-22T05:38:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-01-22T05:38:18.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:38:18.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:18.685 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-01-22T05:38:18.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:18.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-01-22T05:38:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:Cannot find device "ceph-brx" 2024-01-22T05:38:18.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:38:18.812 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-22T05:38:18.812 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:38:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.965+0000 7f057a800700 1 Processor -- start 2024-01-22T05:38:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.965+0000 7f057a800700 1 -- start start 2024-01-22T05:38:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.966+0000 7f057a800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 0x7f057415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.966+0000 7f057a800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0574155030 con 0x7f05740c1980 2024-01-22T05:38:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.966+0000 7f057a800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05740c0cd0 con 0x7f05740c15a0 2024-01-22T05:38:18.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.966+0000 7f057a800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740650f0 con 0x7f05740aa3c0 2024-01-22T05:38:18.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f05740c1980 0x7f05740a9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45590/0 (socket says 172.21.15.100:45590) 2024-01-22T05:38:18.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572a00700 1 -- 172.21.15.100:0/3297505626 learned_addr learned my addr 172.21.15.100:0/3297505626 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:18.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0573e00700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 0x7f057415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623726766 0 0) 0x7f0574155030 con 0x7f05740c1980 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05540033f0 con 0x7f05740c1980 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406773974 0 0) 0x7f05740c0cd0 con 0x7f05740c15a0 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0574155030 con 0x7f05740c15a0 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963975205 0 0) 0x7f05540033f0 con 0x7f05740c1980 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 msgr2=0x7f057415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 0x7f057415ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 >> v1:172.21.15.169:6789/0 conn(0x7f05740c15a0 legacy=0x7f05740646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574154700 con 0x7f05740c1980 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f055c001470 con 0x7f05740c1980 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 >> v1:172.21.15.100:6789/0 conn(0x7f05740c1980 legacy=0x7f05740a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0554003aa0 0x7f0554003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f0554004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.967+0000 7f0572000700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 0x7f0554005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740650f0 con 0x7f0554004690 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055400b990 con 0x7f0554003aa0 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055400bb50 con 0x7f05740aa3c0 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572a00700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f0554004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0573400700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0554003aa0 0x7f0554003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0573e00700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 0x7f0554005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572a00700 1 -- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 msgr2=0x7f0554005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572a00700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05740aa3c0 0x7f0554005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572a00700 1 -- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0554003aa0 msgr2=0x7f0554003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572a00700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0554003aa0 0x7f0554003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572a00700 1 -- 172.21.15.100:0/3297505626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540033f0 con 0x7f0554004690 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0573400700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0554003aa0 0x7f0554003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572a00700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f0554004b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f055c007f30 tx=0x7f055c001d40).ready entity=mon.0 client_cookie=af276d2a4e450ea4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.968+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c00c980 con 0x7f0554004690 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c00cae0 con 0x7f0554004690 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f0572000700 1 -- 172.21.15.100:0/3297505626 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c00ce80 con 0x7f0554004690 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f057a800700 1 -- 172.21.15.100:0/3297505626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 msgr2=0x7f0554004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f057a800700 1 --2- 172.21.15.100:0/3297505626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f0554004b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f055c007f30 tx=0x7f055c001d40).stop 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f0573e00700 1 -- 172.21.15.100:0/3297505626 reap_dead start 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f057a800700 1 -- 172.21.15.100:0/3297505626 shutdown_connections 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f057a800700 1 -- 172.21.15.100:0/3297505626 >> 172.21.15.100:0/3297505626 conn(0x7f05740cb7f0 msgr2=0x7f05740c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f057a800700 1 -- 172.21.15.100:0/3297505626 shutdown_connections 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.969+0000 7f057a800700 1 -- 172.21.15.100:0/3297505626 wait complete. 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.971+0000 7f057a800700 1 Processor -- start 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.971+0000 7f057a800700 1 -- start start 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f057a800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f05740c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f057a800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f057414d580 0x7f057414f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f057a800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f057414da00 0x7f057414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f057a800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0574150240 con 0x7f0554004690 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f057a800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c2450 con 0x7f057414d580 2024-01-22T05:38:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f057a800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c4db0 con 0x7f057414da00 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f05740c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f05740c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33572/0 (socket says 172.21.15.100:33572) 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 -- 172.21.15.100:0/2996148200 learned_addr learned my addr 172.21.15.100:0/2996148200 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0572a00700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f057414d580 0x7f057414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573e00700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f057414da00 0x7f057414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 -- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f057414da00 msgr2=0x7f057414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f057414da00 0x7f057414fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 -- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f057414d580 msgr2=0x7f057414f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f057414d580 0x7f057414f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 -- 172.21.15.100:0/2996148200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740c5040 con 0x7f0554004690 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573e00700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f057414da00 0x7f057414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f0573400700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f05740c27d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f056400fa00 tx=0x7f0564007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.972+0000 7f056aa00700 1 -- 172.21.15.100:0/2996148200 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400fe90 con 0x7f0554004690 2024-01-22T05:38:18.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.973+0000 7f056aa00700 1 -- 172.21.15.100:0/2996148200 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056400d850 con 0x7f0554004690 2024-01-22T05:38:18.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.973+0000 7f056aa00700 1 -- 172.21.15.100:0/2996148200 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400dbd0 con 0x7f0554004690 2024-01-22T05:38:18.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.973+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05740c5320 con 0x7f0554004690 2024-01-22T05:38:18.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.973+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05740c20e0 con 0x7f0554004690 2024-01-22T05:38:18.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.974+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05740475e0 con 0x7f0554004690 2024-01-22T05:38:18.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.974+0000 7f056aa00700 1 -- 172.21.15.100:0/2996148200 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f056401d3b0 con 0x7f0554004690 2024-01-22T05:38:18.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.975+0000 7f056aa00700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f054c05f150 0x7f054c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:18.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.975+0000 7f056aa00700 1 -- 172.21.15.100:0/2996148200 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0564079f70 con 0x7f0554004690 2024-01-22T05:38:18.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.975+0000 7f0572a00700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f054c05f150 0x7f054c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:18.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.976+0000 7f0572a00700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f054c05f150 0x7f054c061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f05740b0f10 tx=0x7f055c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:18.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:18.979+0000 7f056aa00700 1 -- 172.21.15.100:0/2996148200 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f056404ab00 con 0x7f0554004690 2024-01-22T05:38:19.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.194+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05741549e0 con 0x7f0554004690 2024-01-22T05:38:19.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.194+0000 7f056aa00700 1 -- 172.21.15.100:0/2996148200 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f056404b290 con 0x7f0554004690 2024-01-22T05:38:19.195 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:38:19.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f054c05f150 msgr2=0x7f054c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f054c05f150 0x7f054c061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f05740b0f10 tx=0x7f055c015000).stop 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 msgr2=0x7f05740c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f05740c27d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f056400fa00 tx=0x7f0564007bb0).stop 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 shutdown_connections 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f054c05f150 0x7f054c061610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f057414da00 0x7f057414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0554004690 0x7f05740c27d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 --2- 172.21.15.100:0/2996148200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f057414d580 0x7f057414f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 >> 172.21.15.100:0/2996148200 conn(0x7f05740cb7f0 msgr2=0x7f05740c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 shutdown_connections 2024-01-22T05:38:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:19.196+0000 7f057a800700 1 -- 172.21.15.100:0/2996148200 wait complete. 2024-01-22T05:38:19.213 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:38:19.213 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:38:19.213 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:38:19.214 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:38:19.214 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:38:19.214 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:38:19.214 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:38:19.214 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:38:19.214 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:38:19.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:19.214 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:38:19.260 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:19.260 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:19.260 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:19.261 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:38:19.262 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40892sec preferred_lft 40892sec 2024-01-22T05:38:19.262 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:38:19.262 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:19.262 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-22T05:38:19.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:19.262 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:19.262 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:19.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-01-22T05:38:19.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-01-22T05:38:19.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-01-22T05:38:19.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-22T05:38:19.263 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:19.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:19.723 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:38:19.826 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:38:19.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:19.830 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:38:19.894 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:38:19.895 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:38:19.895 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:38:19.895 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:38:19.895 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:38:19.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:19.896 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:19.896 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:19.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:38:19.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:38:19.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:38:19.896 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:20.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:20.574 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:38:20.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:20.619 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-01-22T05:38:20.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:20.704 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:20.704 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:20.704 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:38:20.704 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-22T05:38:20.704 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:20.880 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-22T05:38:20.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:20.880 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:20.880 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:20.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-22T05:38:20.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-22T05:38:20.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-22T05:38:20.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-22T05:38:20.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-22T05:38:20.881 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:21.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:21.149 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:21.149 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:21.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-22T05:38:21.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-01-22T05:38:21.149 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:21.315 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-22T05:38:21.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:21.315 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T05:38:21.360 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:38:21.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:38:21.468 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:21.468 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:21.533 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:21.536 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:21.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:21.536 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:38:21.582 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:38:21.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:38:21.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:38:21.693 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:21.693 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:21.767 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:21.769 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:21.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:21.770 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:38:21.792 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-01-22T05:38:21.792+0000 7f40fab153c0 -1 init, newargv = 0x5610b23451d0 newargc=15 2024-01-22T05:38:21.793 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[78418]: starting ceph client 2024-01-22T05:38:21.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[78418]: starting fuse 2024-01-22T05:38:21.817 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:38:21.818 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:38:21.818 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:38:21.819 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:38:21.820 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:21.820 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-01-22T05:38:21.820 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:38:21.996 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.78418.asok 2024-01-22T05:38:22.174 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.78418.asok 2024-01-22T05:38:22.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:22.174 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.78418.asok status 2024-01-22T05:38:22.390 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "78418", 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4665, 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:38:22.391 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4665 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1932086840 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:38:22.392 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1932086840 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4665 192.168.0.1:0/1932086840", 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/1932086840", 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 7, 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 22, 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:38:22.393 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:38:22.404 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:38:22.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.558+0000 7f70b9e00700 1 Processor -- start 2024-01-22T05:38:22.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.558+0000 7f70b9e00700 1 -- start start 2024-01-22T05:38:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.559+0000 7f70b9e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b40646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.559+0000 7f70b9e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f70b40c1980 0x7f70b40a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.559+0000 7f70b9e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b4155030 con 0x7f70b4064b90 2024-01-22T05:38:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.559+0000 7f70b9e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40c0cd0 con 0x7f70b40c1980 2024-01-22T05:38:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.559+0000 7f70b9e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40650f0 con 0x7f70b40c15a0 2024-01-22T05:38:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f70b40c1980 0x7f70b40a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f70b40c1980 0x7f70b40a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33574/0 (socket says 172.21.15.100:33574) 2024-01-22T05:38:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 -- 172.21.15.100:0/1302088533 learned_addr learned my addr 172.21.15.100:0/1302088533 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2a00700 1 --2- 172.21.15.100:0/1302088533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b40646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 -- 172.21.15.100:0/1302088533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 msgr2=0x7f70b40646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 --2- 172.21.15.100:0/1302088533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b40646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 -- 172.21.15.100:0/1302088533 >> v1:172.21.15.169:6789/0 conn(0x7f70b4064b90 legacy=0x7f70b4157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 -- 172.21.15.100:0/1302088533 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4154700 con 0x7f70b40c1980 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.560+0000 7f70b2000700 1 --2- 172.21.15.100:0/1302088533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b40a9cb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f709c006fd0 tx=0x7f709c0090f0).ready entity=mon.0 client_cookie=f0f9e8bd8a5a0898 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b1600700 1 -- 172.21.15.100:0/1302088533 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c00b600 con 0x7f70b40c1980 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b1600700 1 -- 172.21.15.100:0/1302088533 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c00b760 con 0x7f70b40c1980 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b1600700 1 -- 172.21.15.100:0/1302088533 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c00bae0 con 0x7f70b40c1980 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 -- 172.21.15.100:0/1302088533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 msgr2=0x7f70b40a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1302088533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b40a9cb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f709c006fd0 tx=0x7f709c0090f0).stop 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 -- 172.21.15.100:0/1302088533 shutdown_connections 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1302088533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b40646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1302088533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b40a9cb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 -- 172.21.15.100:0/1302088533 >> 172.21.15.100:0/1302088533 conn(0x7f70b40cb7f0 msgr2=0x7f70b40c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 -- 172.21.15.100:0/1302088533 shutdown_connections 2024-01-22T05:38:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.561+0000 7f70b9e00700 1 -- 172.21.15.100:0/1302088533 wait complete. 2024-01-22T05:38:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.563+0000 7f70b9e00700 1 Processor -- start 2024-01-22T05:38:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.563+0000 7f70b9e00700 1 -- start start 2024-01-22T05:38:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b9e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70b4064b90 0x7f70b4150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b9e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b4164100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b9e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b41645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b9e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40a3210 con 0x7f70b40c1980 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b9e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40c3b40 con 0x7f70b4064b90 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b9e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40c4680 con 0x7f70b40c15a0 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b3400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b41645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b2000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b4164100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b2000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b4164100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:43836/0 (socket says 172.21.15.100:43836) 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b2000700 1 -- 172.21.15.100:0/1987385840 learned_addr learned my addr 172.21.15.100:0/1987385840 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.564+0000 7f70b2a00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70b4064b90 0x7f70b4150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b3400700 1 -- 172.21.15.100:0/1987385840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 msgr2=0x7f70b4164100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b3400700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b4164100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b3400700 1 -- 172.21.15.100:0/1987385840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70b4064b90 msgr2=0x7f70b4150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b3400700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70b4064b90 0x7f70b4150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b3400700 1 -- 172.21.15.100:0/1987385840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c009370 con 0x7f70b40c1980 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b3400700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b41645f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f70ac00c790 tx=0x7f70ac001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70aa000700 1 -- 172.21.15.100:0/1987385840 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00e4a0 con 0x7f70b40c1980 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70aa000700 1 -- 172.21.15.100:0/1987385840 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac00e600 con 0x7f70b40c1980 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b40c3d50 con 0x7f70b40c1980 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70aa000700 1 -- 172.21.15.100:0/1987385840 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00e980 con 0x7f70b40c1980 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.565+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b40c4310 con 0x7f70b40c1980 2024-01-22T05:38:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.566+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b40475e0 con 0x7f70b40c1980 2024-01-22T05:38:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.567+0000 7f70aa000700 1 -- 172.21.15.100:0/1987385840 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f70ac0123f0 con 0x7f70b40c1980 2024-01-22T05:38:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.568+0000 7f70aa000700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f708c05f150 0x7f708c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.568+0000 7f70aa000700 1 -- 172.21.15.100:0/1987385840 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f70ac079a40 con 0x7f70b40c1980 2024-01-22T05:38:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.568+0000 7f70b2a00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f708c05f150 0x7f708c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.568+0000 7f70b2a00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f708c05f150 0x7f708c061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f70a400bbc0 tx=0x7f70a4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:22.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.572+0000 7f70aa000700 1 -- 172.21.15.100:0/1987385840 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f70ac047b00 con 0x7f70b40c1980 2024-01-22T05:38:22.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.791+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f70b40c47c0 con 0x7f70b40c1980 2024-01-22T05:38:22.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.791+0000 7f70aa000700 1 -- 172.21.15.100:0/1987385840 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f70ac04abf0 con 0x7f70b40c1980 2024-01-22T05:38:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.793+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f708c05f150 msgr2=0x7f708c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.793+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f708c05f150 0x7f708c061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f70a400bbc0 tx=0x7f70a4008040).stop 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.793+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 msgr2=0x7f70b41645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.793+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b41645f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f70ac00c790 tx=0x7f70ac001530).stop 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 shutdown_connections 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f708c05f150 0x7f708c061610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70b4064b90 0x7f70b4150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b40c1980 0x7f70b41645f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 --2- 172.21.15.100:0/1987385840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70b40c15a0 0x7f70b4164100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 >> 172.21.15.100:0/1987385840 conn(0x7f70b40cb7f0 msgr2=0x7f70b4152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:22.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 shutdown_connections 2024-01-22T05:38:22.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:22.794+0000 7f70b9e00700 1 -- 172.21.15.100:0/1987385840 wait complete. 2024-01-22T05:38:22.809 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:38:22.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:38:22.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:38:22.810 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-22T05:38:22.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-22T05:38:22.810 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:38:22.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:38:22.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:38:22.810 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-22T05:38:22.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:22.810 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:38:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:38:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40888sec preferred_lft 40888sec 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:22.857 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f05d:9bff:feba:b90d/64 scope link 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::1c0c:7cff:fe73:80ca/64 scope link 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:22.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:22.858 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:38:22.959 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:38:22.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:22.963 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:38:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:38:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:38:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:38:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:38:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:38:23.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.011 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:23.011 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:23.011 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:38:23.011 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:38:23.012 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:38:23.012 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:23.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.172 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:38:23.217 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:38:23.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.217 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-01-22T05:38:23.303 INFO:teuthology.orchestra.run.smithi100.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-22T05:38:23.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.303 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:23.303 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:23.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:38:23.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-22T05:38:23.304 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:23.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.477 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-22T05:38:23.543 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:23.543 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:23.543 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:23.543 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.543 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:23.543 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.543 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:38:23.544 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether d2:eb:d5:80:dc:85 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:38:23.544 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:38:23.544 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.544 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::d0eb:d5ff:fe80:dc85/64 scope link 2024-01-22T05:38:23.544 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-22T05:38:23.612 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:23.612 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether d2:eb:d5:80:dc:85 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::d0eb:d5ff:fe80:dc85/64 scope link 2024-01-22T05:38:23.613 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:23.615 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-22T05:38:23.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-22T05:38:23.616 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:23.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:23.850 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:38:23.850 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:38:23.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.1 up 2024-01-22T05:38:23.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.1 master ceph-brx 2024-01-22T05:38:23.850 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:38:24.015 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-01-22T05:38:24.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:24.015 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.2 2024-01-22T05:38:24.059 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-01-22T05:38:24.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:38:24.170 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:24.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:24.235 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:24.238 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:24.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:24.238 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:38:24.282 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:38:24.283 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-01-22T05:38:24.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 2 /home/ubuntu/cephtest/mnt.2 2024-01-22T05:38:24.327 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:38:24.393 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:24.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:24.462 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:24.464 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:24.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:24.465 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:38:24.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:2024-01-22T05:38:24.482+0000 7ff1544063c0 -1 init, newargv = 0x560b086581f0 newargc=15 2024-01-22T05:38:24.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:ceph-fuse[79116]: starting ceph client 2024-01-22T05:38:24.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:ceph-fuse[79116]: starting fuse 2024-01-22T05:38:24.515 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:38:24.515 INFO:teuthology.orchestra.run.smithi100.stdout:45 2024-01-22T05:38:24.516 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 45] 2024-01-22T05:38:24.516 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:38:24.516 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:38:24.516 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:38:24.516 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:38:24.516 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:38:24.517 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:38:24.518 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:38:24.518 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:38:24.518 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:38:24.518 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:38:24.518 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:38:24.518 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.2")) 2024-01-22T05:38:24.518 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:38:24.695 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.2.79116.asok 2024-01-22T05:38:24.873 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.79116.asok 2024-01-22T05:38:24.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:24.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.79116.asok status 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "2", 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "79116", 2024-01-22T05:38:25.087 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4677, 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4677 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 722069845 2024-01-22T05:38:25.088 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 722069845 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4677 192.168.0.2:0/722069845", 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.2:0/722069845", 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 7, 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 22, 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:38:25.089 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:38:25.090 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:38:25.101 DEBUG:teuthology.orchestra.run.smithi169:> ceph fs ls 2024-01-22T05:38:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.268+0000 7fd781400700 1 Processor -- start 2024-01-22T05:38:25.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.269+0000 7fd781400700 1 -- start start 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd781400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd77c154060 0x7fd77c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd781400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c1586a0 0x7fd77c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd781400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0c1ca0 con 0x7fd77c154440 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd781400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c1548c0 con 0x7fd77c154060 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd781400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c158df0 con 0x7fd77c1586a0 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd77a800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd77c154060 0x7fd77c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd77b200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c1586a0 0x7fd77c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd779e00700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd77c154440 0x7fd77c157f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:49888/0 (socket says 172.21.15.169:49888) 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.270+0000 7fd779e00700 1 -- 172.21.15.169:0/2108241634 learned_addr learned my addr 172.21.15.169:0/2108241634 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd77b200700 1 -- 172.21.15.169:0/2108241634 >> v2:172.21.15.169:3300/0 conn(0x7fd77c154060 msgr2=0x7fd77c0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd779400700 1 -- 172.21.15.169:0/2108241634 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064433837 0 0) 0x7fd77c0c1ca0 con 0x7fd77c154440 2024-01-22T05:38:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd77b200700 1 --2- 172.21.15.169:0/2108241634 >> v2:172.21.15.169:3300/0 conn(0x7fd77c154060 0x7fd77c0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd77b200700 1 -- 172.21.15.169:0/2108241634 >> v1:172.21.15.169:6789/0 conn(0x7fd77c154440 legacy=0x7fd77c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:25.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd77b200700 1 -- 172.21.15.169:0/2108241634 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0c5da0 con 0x7fd77c1586a0 2024-01-22T05:38:25.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd77a800700 1 --2- 172.21.15.169:0/2108241634 >> v2:172.21.15.169:3300/0 conn(0x7fd77c154060 0x7fd77c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:25.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd77b200700 1 --2- 172.21.15.169:0/2108241634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c1586a0 0x7fd77c06a280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd774009e60 tx=0x7fd774009780).ready entity=mon.2 client_cookie=2baeeb2722e59e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:25.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd779400700 1 -- 172.21.15.169:0/2108241634 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77400e070 con 0x7fd77c1586a0 2024-01-22T05:38:25.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd779400700 1 -- 172.21.15.169:0/2108241634 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77400bb60 con 0x7fd77c1586a0 2024-01-22T05:38:25.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.271+0000 7fd779400700 1 -- 172.21.15.169:0/2108241634 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774012410 con 0x7fd77c1586a0 2024-01-22T05:38:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 -- 172.21.15.169:0/2108241634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c1586a0 msgr2=0x7fd77c06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 --2- 172.21.15.169:0/2108241634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c1586a0 0x7fd77c06a280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd774009e60 tx=0x7fd774009780).stop 2024-01-22T05:38:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 -- 172.21.15.169:0/2108241634 shutdown_connections 2024-01-22T05:38:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 --2- 172.21.15.169:0/2108241634 >> v2:172.21.15.169:3300/0 conn(0x7fd77c154060 0x7fd77c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 --2- 172.21.15.169:0/2108241634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c1586a0 0x7fd77c06a280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 -- 172.21.15.169:0/2108241634 >> 172.21.15.169:0/2108241634 conn(0x7fd77c063280 msgr2=0x7fd77c0c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 -- 172.21.15.169:0/2108241634 shutdown_connections 2024-01-22T05:38:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.272+0000 7fd781400700 1 -- 172.21.15.169:0/2108241634 wait complete. 2024-01-22T05:38:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.273+0000 7fd781400700 1 Processor -- start 2024-01-22T05:38:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.274+0000 7fd781400700 1 -- start start 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.274+0000 7fd781400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c154060 0x7fd77c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.274+0000 7fd781400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c154440 0x7fd77c14c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.274+0000 7fd781400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77c1586a0 0x7fd77c068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd781400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c155b80 con 0x7fd77c1586a0 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd781400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c168980 con 0x7fd77c154060 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd781400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c154bb0 con 0x7fd77c154440 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c154060 0x7fd77c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd779e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c154440 0x7fd77c14c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c154060 0x7fd77c155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:40324/0 (socket says 172.21.15.169:40324) 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 -- 172.21.15.169:0/1170799202 learned_addr learned my addr 172.21.15.169:0/1170799202 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:38:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77b200700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77c1586a0 0x7fd77c068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 -- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c154440 msgr2=0x7fd77c14c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c154440 0x7fd77c14c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 -- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77c1586a0 msgr2=0x7fd77c068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77c1586a0 0x7fd77c068e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 -- 172.21.15.169:0/1170799202 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0092a0 con 0x7fd77c154060 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd779e00700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c154440 0x7fd77c14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77b200700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77c1586a0 0x7fd77c068e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.275+0000 7fd77a800700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c154060 0x7fd77c155690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd76c00ea20 tx=0x7fd76c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.276+0000 7fd772000700 1 -- 172.21.15.169:0/1170799202 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00c850 con 0x7fd77c154060 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.276+0000 7fd772000700 1 -- 172.21.15.169:0/1170799202 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c00c9b0 con 0x7fd77c154060 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.276+0000 7fd772000700 1 -- 172.21.15.169:0/1170799202 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00cd30 con 0x7fd77c154060 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.276+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd774009a20 con 0x7fd77c154060 2024-01-22T05:38:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.276+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c155170 con 0x7fd77c154060 2024-01-22T05:38:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.277+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c0c69c0 con 0x7fd77c154060 2024-01-22T05:38:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.277+0000 7fd772000700 1 -- 172.21.15.169:0/1170799202 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd76c012600 con 0x7fd77c154060 2024-01-22T05:38:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.278+0000 7fd772000700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd75405f150 0x7fd754061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.279+0000 7fd772000700 1 -- 172.21.15.169:0/1170799202 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd76c07a850 con 0x7fd77c154060 2024-01-22T05:38:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.279+0000 7fd779e00700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd75405f150 0x7fd754061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.279+0000 7fd779e00700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd75405f150 0x7fd754061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd77c158100 tx=0x7fd764007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.284+0000 7fd772000700 1 -- 172.21.15.169:0/1170799202 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd76c04ba60 con 0x7fd77c154060 2024-01-22T05:38:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.497+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd77c1554e0 con 0x7fd77c154060 2024-01-22T05:38:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.497+0000 7fd772000700 1 -- 172.21.15.169:0/1170799202 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd76c04f080 con 0x7fd77c154060 2024-01-22T05:38:25.498 INFO:teuthology.orchestra.run.smithi169.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.499+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd75405f150 msgr2=0x7fd754061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.499+0000 7fd781400700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd75405f150 0x7fd754061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd77c158100 tx=0x7fd764007bb0).stop 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.499+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c154060 msgr2=0x7fd77c155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.499+0000 7fd781400700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c154060 0x7fd77c155690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd76c00ea20 tx=0x7fd76c009060).stop 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 shutdown_connections 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd75405f150 0x7fd754061610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c154060 0x7fd77c155690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77c1586a0 0x7fd77c068e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 --2- 172.21.15.169:0/1170799202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd77c154440 0x7fd77c14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 >> 172.21.15.169:0/1170799202 conn(0x7fd77c063280 msgr2=0x7fd77c068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 shutdown_connections 2024-01-22T05:38:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:25.500+0000 7fd781400700 1 -- 172.21.15.169:0/1170799202 wait complete. 2024-01-22T05:38:25.514 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:38:25.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:38:25.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2024-01-22T05:38:25.515 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-22T05:38:25.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-22T05:38:25.515 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:38:25.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:38:25.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:38:25.515 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-22T05:38:25.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:25.515 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 40824sec preferred_lft 40824sec 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:25.562 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-22T05:38:25.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:25.563 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:25.563 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:25.563 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add name ceph-brx type bridge 2024-01-22T05:38:25.563 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr flush dev ceph-brx 2024-01-22T05:38:25.563 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set ceph-brx up 2024-01-22T05:38:25.563 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-22T05:38:25.563 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:25.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:26.011 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:38:26.098 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-01-22T05:38:26.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:26.101 DEBUG:teuthology.orchestra.run.smithi169:> route 2024-01-22T05:38:26.165 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2024-01-22T05:38:26.165 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:38:26.165 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:38:26.165 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:38:26.165 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:38:26.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:26.167 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:26.167 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:26.167 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:38:26.167 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:38:26.167 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:38:26.167 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:26.694 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:38:26.699 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:38:26.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:26.877 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-01-22T05:38:26.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:26.922 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2024-01-22T05:38:27.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:27.006 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:27.006 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:27.007 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-22T05:38:27.007 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-22T05:38:27.007 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:27.182 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-22T05:38:27.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:27.182 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:27.182 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:27.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-22T05:38:27.183 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-22T05:38:27.183 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-22T05:38:27.183 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-22T05:38:27.183 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-22T05:38:27.183 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:27.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:27.459 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:27.459 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:27.459 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.0 up 2024-01-22T05:38:27.459 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.0 master ceph-brx 2024-01-22T05:38:27.459 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:27.624 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-01-22T05:38:27.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:27.625 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.1 2024-01-22T05:38:27.669 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-22T05:38:27.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-01-22T05:38:27.777 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:27.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:27.842 INFO:teuthology.orchestra.run.smithi169.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:27.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:27.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:27.845 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-01-22T05:38:27.893 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:38:27.893 DEBUG:teuthology.orchestra.run.smithi169:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 1 /home/ubuntu/cephtest/mnt.1 2024-01-22T05:38:27.897 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-01-22T05:38:27.965 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:27.966 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:28.030 INFO:teuthology.orchestra.run.smithi169.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:28.034 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:28.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:28.035 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-01-22T05:38:28.057 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi169.stderr:2024-01-22T05:38:28.057+0000 7f63f0a913c0 -1 init, newargv = 0x559e728c2310 newargc=15 2024-01-22T05:38:28.057 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi169.stderr:ceph-fuse[75596]: starting ceph client 2024-01-22T05:38:28.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi169.stderr:ceph-fuse[75596]: starting fuse 2024-01-22T05:38:28.084 INFO:teuthology.orchestra.run.smithi169.stdout:44 2024-01-22T05:38:28.084 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-01-22T05:38:28.084 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:38:28.084 DEBUG:teuthology.orchestra.run.smithi169:> import glob 2024-01-22T05:38:28.084 DEBUG:teuthology.orchestra.run.smithi169:> import re 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> import os 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> import subprocess 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> def _find_admin_socket(client_name): 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> files = glob.glob(asok_path) 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> # Given a non-glob path, it better be there 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> if "*" not in asok_path: 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> assert(len(files) == 1) 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> return files[0] 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> for f in files: 2024-01-22T05:38:28.085 DEBUG:teuthology.orchestra.run.smithi169:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> contents = proc_f.read() 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> if mountpoint in contents: 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> return f 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> print(_find_admin_socket("client.1")) 2024-01-22T05:38:28.086 DEBUG:teuthology.orchestra.run.smithi169:> ' 2024-01-22T05:38:28.267 INFO:teuthology.orchestra.run.smithi169.stdout:/var/run/ceph/ceph-client.1.75596.asok 2024-01-22T05:38:28.446 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.75596.asok 2024-01-22T05:38:28.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:28.447 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.75596.asok status 2024-01-22T05:38:28.659 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-01-22T05:38:28.659 INFO:teuthology.orchestra.run.smithi169.stdout: "metadata": { 2024-01-22T05:38:28.659 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:38:28.659 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:38:28.659 INFO:teuthology.orchestra.run.smithi169.stdout: "entity_id": "1", 2024-01-22T05:38:28.659 INFO:teuthology.orchestra.run.smithi169.stdout: "hostname": "smithi169", 2024-01-22T05:38:28.659 INFO:teuthology.orchestra.run.smithi169.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "pid": "75596", 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "root": "/" 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_count": 0, 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_pinned_count": 0, 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "id": 4532, 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "inst": { 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "name": { 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "client", 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "num": 4532 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-01-22T05:38:28.660 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 1267987189 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 1267987189 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:28.661 INFO:teuthology.orchestra.run.smithi169.stdout: "inst_str": "client.4532 192.168.0.1:0/1267987189", 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout: "addr_str": "192.168.0.1:0/1267987189", 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout: "inode_count": 1, 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_epoch": 7, 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch": 22, 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout: "blocklisted": false, 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout: "fs_name": "cephfs" 2024-01-22T05:38:28.662 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-01-22T05:38:28.672 DEBUG:teuthology.orchestra.run.smithi169:> ceph fs ls 2024-01-22T05:38:28.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.828+0000 7fbb59600700 1 Processor -- start 2024-01-22T05:38:28.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.828+0000 7fbb59600700 1 -- start start 2024-01-22T05:38:28.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.829+0000 7fbb59600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbb54157310 0x7fbb540c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:28.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.829+0000 7fbb59600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbb540c1c90 0x7fbb540a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:28.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.829+0000 7fbb59600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb540633c0 con 0x7fbb541576f0 2024-01-22T05:38:28.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.829+0000 7fbb59600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540a5d50 con 0x7fbb540c1c90 2024-01-22T05:38:28.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.829+0000 7fbb59600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540627b0 con 0x7fbb54157310 2024-01-22T05:38:28.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.829+0000 7fbb52a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbb54157310 0x7fbb540c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:28.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb52a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbb54157310 0x7fbb540c17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:40336/0 (socket says 172.21.15.169:40336) 2024-01-22T05:38:28.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb52a00700 1 -- 172.21.15.169:0/1574287921 learned_addr learned my addr 172.21.15.169:0/1574287921 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:38:28.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb53400700 1 --2- 172.21.15.169:0/1574287921 >> v2:172.21.15.100:3300/0 conn(0x7fbb540c1c90 0x7fbb540a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:28.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb52a00700 1 -- 172.21.15.169:0/1574287921 >> v2:172.21.15.100:3300/0 conn(0x7fbb540c1c90 msgr2=0x7fbb540a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb52a00700 1 --2- 172.21.15.169:0/1574287921 >> v2:172.21.15.100:3300/0 conn(0x7fbb540c1c90 0x7fbb540a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb52a00700 1 -- 172.21.15.169:0/1574287921 >> v1:172.21.15.100:6789/0 conn(0x7fbb541576f0 legacy=0x7fbb54063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb52a00700 1 -- 172.21.15.169:0/1574287921 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54062a90 con 0x7fbb54157310 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb53400700 1 --2- 172.21.15.169:0/1574287921 >> v2:172.21.15.100:3300/0 conn(0x7fbb540c1c90 0x7fbb540a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb52a00700 1 --2- 172.21.15.169:0/1574287921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb54157310 0x7fbb540c17a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fbb540c70b0 tx=0x7fbb440090f0).ready entity=mon.1 client_cookie=37e5304feff9a3c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb51600700 1 -- 172.21.15.169:0/1574287921 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400b5a0 con 0x7fbb54157310 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb51600700 1 -- 172.21.15.169:0/1574287921 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4400b700 con 0x7fbb54157310 2024-01-22T05:38:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.830+0000 7fbb51600700 1 -- 172.21.15.169:0/1574287921 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400ba80 con 0x7fbb54157310 2024-01-22T05:38:28.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 -- 172.21.15.169:0/1574287921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb54157310 msgr2=0x7fbb540c17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:28.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 --2- 172.21.15.169:0/1574287921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb54157310 0x7fbb540c17a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fbb540c70b0 tx=0x7fbb440090f0).stop 2024-01-22T05:38:28.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 -- 172.21.15.169:0/1574287921 shutdown_connections 2024-01-22T05:38:28.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 --2- 172.21.15.169:0/1574287921 >> v2:172.21.15.100:3300/0 conn(0x7fbb540c1c90 0x7fbb540a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:28.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 --2- 172.21.15.169:0/1574287921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb54157310 0x7fbb540c17a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:28.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 -- 172.21.15.169:0/1574287921 >> 172.21.15.169:0/1574287921 conn(0x7fbb54064910 msgr2=0x7fbb54064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:28.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 -- 172.21.15.169:0/1574287921 shutdown_connections 2024-01-22T05:38:28.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.831+0000 7fbb59600700 1 -- 172.21.15.169:0/1574287921 wait complete. 2024-01-22T05:38:28.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.833+0000 7fbb59600700 1 Processor -- start 2024-01-22T05:38:28.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.833+0000 7fbb59600700 1 -- start start 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb59600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb540c1c90 0x7fbb54068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb59600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb54157310 0x7fbb54142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb59600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb541576f0 0x7fbb5406a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb59600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb541431b0 con 0x7fbb54157310 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb59600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54068ed0 con 0x7fbb541576f0 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb59600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540691b0 con 0x7fbb540c1c90 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb52a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb540c1c90 0x7fbb54068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb53400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb541576f0 0x7fbb5406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb52a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb540c1c90 0x7fbb54068910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:42566/0 (socket says 172.21.15.169:42566) 2024-01-22T05:38:28.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb52a00700 1 -- 172.21.15.169:0/566384590 learned_addr learned my addr 172.21.15.169:0/566384590 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.834+0000 7fbb52000700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb54157310 0x7fbb54142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb52a00700 1 -- 172.21.15.169:0/566384590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb541576f0 msgr2=0x7fbb5406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb52a00700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb541576f0 0x7fbb5406a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb52a00700 1 -- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb54157310 msgr2=0x7fbb54142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb52a00700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb54157310 0x7fbb54142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb52a00700 1 -- 172.21.15.169:0/566384590 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009370 con 0x7fbb540c1c90 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb52a00700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb540c1c90 0x7fbb54068910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fbb44009130 tx=0x7fbb44015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb4a000700 1 -- 172.21.15.169:0/566384590 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400b870 con 0x7fbb540c1c90 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb4a000700 1 -- 172.21.15.169:0/566384590 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4400b9d0 con 0x7fbb540c1c90 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb54069490 con 0x7fbb540c1c90 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb4a000700 1 -- 172.21.15.169:0/566384590 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4401c670 con 0x7fbb540c1c90 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.835+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5406ac30 con 0x7fbb540c1c90 2024-01-22T05:38:28.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.836+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb540699b0 con 0x7fbb540c1c90 2024-01-22T05:38:28.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.837+0000 7fbb4a000700 1 -- 172.21.15.169:0/566384590 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbb4401c9e0 con 0x7fbb540c1c90 2024-01-22T05:38:28.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.838+0000 7fbb4a000700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbb2c05f150 0x7fbb2c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:28.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.838+0000 7fbb4a000700 1 -- 172.21.15.169:0/566384590 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbb4407bff0 con 0x7fbb540c1c90 2024-01-22T05:38:28.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.838+0000 7fbb52000700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbb2c05f150 0x7fbb2c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:28.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.839+0000 7fbb52000700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbb2c05f150 0x7fbb2c061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbb54068e00 tx=0x7fbb3c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:28.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:28.843+0000 7fbb4a000700 1 -- 172.21.15.169:0/566384590 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbb540699b0 con 0x7fbb540c1c90 2024-01-22T05:38:29.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.055+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb540699b0 con 0x7fbb540c1c90 2024-01-22T05:38:29.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.055+0000 7fbb4a000700 1 -- 172.21.15.169:0/566384590 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb540699b0 con 0x7fbb540c1c90 2024-01-22T05:38:29.055 INFO:teuthology.orchestra.run.smithi169.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbb2c05f150 msgr2=0x7fbb2c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbb2c05f150 0x7fbb2c061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbb54068e00 tx=0x7fbb3c008040).stop 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb540c1c90 msgr2=0x7fbb54068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb540c1c90 0x7fbb54068910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fbb44009130 tx=0x7fbb44015000).stop 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 shutdown_connections 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbb2c05f150 0x7fbb2c061610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb541576f0 0x7fbb5406a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb540c1c90 0x7fbb54068910 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 --2- 172.21.15.169:0/566384590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb54157310 0x7fbb54142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.057+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 >> 172.21.15.169:0/566384590 conn(0x7fbb54064910 msgr2=0x7fbb54063c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.058+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 shutdown_connections 2024-01-22T05:38:29.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-01-22T05:38:29.058+0000 7fbb59600700 1 -- 172.21.15.169:0/566384590 wait complete. 2024-01-22T05:38:29.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:38:29.072 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-22T05:38:29.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.072 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2024-01-22T05:38:29.117 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 40820sec preferred_lft 40820sec 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 8a:c5:a1:a2:0c:0c brd ff:ff:ff:ff:ff:ff 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::2817:11ff:fe4a:42c5/64 scope link 2024-01-22T05:38:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.120 INFO:teuthology.orchestra.run.smithi169.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:38:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 8a:c5:a1:a2:0c:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-22T05:38:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::88c5:a1ff:fea2:c0c/64 scope link tentative 2024-01-22T05:38:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.120 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:38:29.222 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-01-22T05:38:29.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.226 DEBUG:teuthology.orchestra.run.smithi169:> route 2024-01-22T05:38:29.272 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2024-01-22T05:38:29.272 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:38:29.272 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:38:29.273 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:38:29.273 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:38:29.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.276 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:29.276 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:29.276 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:38:29.276 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:38:29.276 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:38:29.276 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:29.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.439 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-01-22T05:38:29.484 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-22T05:38:29.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.485 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2024-01-22T05:38:29.569 INFO:teuthology.orchestra.run.smithi169.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-22T05:38:29.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.570 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:29.570 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:29.570 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-22T05:38:29.570 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-22T05:38:29.570 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:29.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.746 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-22T05:38:29.814 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:29.814 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:29.814 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:29.814 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.814 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:29.814 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.814 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:38:29.815 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 32:e8:c3:18:db:26 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:38:29.815 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:38:29.815 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.815 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::30e8:c3ff:fe18:db26/64 scope link 2024-01-22T05:38:29.815 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.817 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-22T05:38:29.883 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 32:e8:c3:18:db:26 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::30e8:c3ff:fe18:db26/64 scope link 2024-01-22T05:38:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:38:29.886 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-22T05:38:29.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:29.887 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:29.887 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:29.887 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-22T05:38:29.887 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-22T05:38:29.887 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-22T05:38:29.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-22T05:38:29.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-22T05:38:29.888 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:30.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:30.121 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-01-22T05:38:30.122 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-01-22T05:38:30.122 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.1 up 2024-01-22T05:38:30.122 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.1 master ceph-brx 2024-01-22T05:38:30.122 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-01-22T05:38:30.290 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-01-22T05:38:30.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:30.291 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.3 2024-01-22T05:38:30.336 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-01-22T05:38:30.336 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-01-22T05:38:30.444 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:30.444 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:30.509 INFO:teuthology.orchestra.run.smithi169.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:30.511 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:30.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:30.512 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-01-22T05:38:30.556 INFO:teuthology.orchestra.run.smithi169.stdout:44 2024-01-22T05:38:30.556 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-01-22T05:38:30.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 3 /home/ubuntu/cephtest/mnt.3 2024-01-22T05:38:30.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-01-22T05:38:30.671 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:38:30.672 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:38:30.740 INFO:teuthology.orchestra.run.smithi169.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:38:30.742 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:38:30.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:30.743 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-01-22T05:38:30.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi169.stderr:2024-01-22T05:38:30.759+0000 7f30e170e3c0 -1 init, newargv = 0x558bb28f3250 newargc=15 2024-01-22T05:38:30.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi169.stderr:ceph-fuse[76292]: starting ceph client 2024-01-22T05:38:30.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi169.stderr:ceph-fuse[76292]: starting fuse 2024-01-22T05:38:30.791 INFO:teuthology.orchestra.run.smithi169.stdout:44 2024-01-22T05:38:30.791 INFO:teuthology.orchestra.run.smithi169.stdout:45 2024-01-22T05:38:30.791 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-01-22T05:38:30.791 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> import glob 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> import re 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> import os 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> import subprocess 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> def _find_admin_socket(client_name): 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> files = glob.glob(asok_path) 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> # Given a non-glob path, it better be there 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> if "*" not in asok_path: 2024-01-22T05:38:30.792 DEBUG:teuthology.orchestra.run.smithi169:> assert(len(files) == 1) 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> return files[0] 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> for f in files: 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> contents = proc_f.read() 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> if mountpoint in contents: 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> return f 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> print(_find_admin_socket("client.3")) 2024-01-22T05:38:30.793 DEBUG:teuthology.orchestra.run.smithi169:> ' 2024-01-22T05:38:30.972 INFO:teuthology.orchestra.run.smithi169.stdout:/var/run/ceph/ceph-client.3.76292.asok 2024-01-22T05:38:31.153 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.76292.asok 2024-01-22T05:38:31.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.76292.asok status 2024-01-22T05:38:31.381 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-01-22T05:38:31.381 INFO:teuthology.orchestra.run.smithi169.stdout: "metadata": { 2024-01-22T05:38:31.381 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:38:31.381 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "entity_id": "3", 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "hostname": "smithi169", 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "pid": "76292", 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "root": "/" 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_count": 0, 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_pinned_count": 0, 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "id": 4660, 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "inst": { 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "name": { 2024-01-22T05:38:31.382 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "client", 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "num": 4660 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.2:0", 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 804480753 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.2:0", 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 804480753 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-01-22T05:38:31.383 INFO:teuthology.orchestra.run.smithi169.stdout: "inst_str": "client.4660 192.168.0.2:0/804480753", 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout: "addr_str": "192.168.0.2:0/804480753", 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout: "inode_count": 1, 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_epoch": 7, 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch": 22, 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout: "blocklisted": false, 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout: "fs_name": "cephfs" 2024-01-22T05:38:31.384 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-01-22T05:38:31.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.394 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:38:31.394 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-22T05:38:31.453 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:38:31.453 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-22T05:38:31.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:38:31.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.531 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:38:31.531 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.2 2024-01-22T05:38:31.577 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:38:31.577 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-01-22T05:38:31.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-22T05:38:31.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.688 DEBUG:teuthology.orchestra.run.smithi169:> stat --file-system '--printf=%T 2024-01-22T05:38:31.688 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.1 2024-01-22T05:38:31.734 INFO:teuthology.orchestra.run.smithi169.stdout:fuseblk 2024-01-22T05:38:31.734 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-01-22T05:38:31.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.735 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-22T05:38:31.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.841 DEBUG:teuthology.orchestra.run.smithi169:> stat --file-system '--printf=%T 2024-01-22T05:38:31.841 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.3 2024-01-22T05:38:31.886 INFO:teuthology.orchestra.run.smithi169.stdout:fuseblk 2024-01-22T05:38:31.886 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-01-22T05:38:31.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:38:31.887 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-22T05:38:31.993 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-22T05:38:32.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.217+0000 7f31e2e00700 1 Processor -- start 2024-01-22T05:38:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.217+0000 7f31e2e00700 1 -- start start 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31e2e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f31dc062d00 0x7f31dc0bca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31e2e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31dc154440 0x7f31dc065780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31e2e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31dc0a4870 con 0x7f31dc154060 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31e2e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31dc0bd1a0 con 0x7f31dc154440 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31e2e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31dc0672e0 con 0x7f31dc062d00 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31e0e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31dc154440 0x7f31dc065780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31dbe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f31dc154060 0x7f31dc0625f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55062/0 (socket says 172.21.15.100:55062) 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31e0e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31dc154440 0x7f31dc065780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41208/0 (socket says 172.21.15.100:41208) 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31dbe00700 1 -- 172.21.15.100:0/4166099903 learned_addr learned my addr 172.21.15.100:0/4166099903 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.219+0000 7f31db400700 1 --2- 172.21.15.100:0/4166099903 >> v2:172.21.15.169:3300/0 conn(0x7f31dc062d00 0x7f31dc0bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31e0e00700 1 -- 172.21.15.100:0/4166099903 >> v2:172.21.15.169:3300/0 conn(0x7f31dc062d00 msgr2=0x7f31dc0bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31e0e00700 1 --2- 172.21.15.100:0/4166099903 >> v2:172.21.15.169:3300/0 conn(0x7f31dc062d00 0x7f31dc0bca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31e0e00700 1 -- 172.21.15.100:0/4166099903 >> v1:172.21.15.100:6789/0 conn(0x7f31dc154060 legacy=0x7f31dc0625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31e0e00700 1 -- 172.21.15.100:0/4166099903 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc06a740 con 0x7f31dc154440 2024-01-22T05:38:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31e0e00700 1 --2- 172.21.15.100:0/4166099903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154440 0x7f31dc065780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f31dc06c020 tx=0x7f31d4009780).ready entity=mon.0 client_cookie=270063ebf93f5186 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31daa00700 1 -- 172.21.15.100:0/4166099903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400e070 con 0x7f31dc154440 2024-01-22T05:38:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31daa00700 1 -- 172.21.15.100:0/4166099903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400bb20 con 0x7f31dc154440 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.220+0000 7f31daa00700 1 -- 172.21.15.100:0/4166099903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400bea0 con 0x7f31dc154440 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 -- 172.21.15.100:0/4166099903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154440 msgr2=0x7f31dc065780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 --2- 172.21.15.100:0/4166099903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154440 0x7f31dc065780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f31dc06c020 tx=0x7f31d4009780).stop 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 -- 172.21.15.100:0/4166099903 shutdown_connections 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 --2- 172.21.15.100:0/4166099903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154440 0x7f31dc065780 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 --2- 172.21.15.100:0/4166099903 >> v2:172.21.15.169:3300/0 conn(0x7f31dc062d00 0x7f31dc0bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 -- 172.21.15.100:0/4166099903 >> 172.21.15.100:0/4166099903 conn(0x7f31dc0c7ad0 msgr2=0x7f31dc0c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 -- 172.21.15.100:0/4166099903 shutdown_connections 2024-01-22T05:38:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.221+0000 7f31e2e00700 1 -- 172.21.15.100:0/4166099903 wait complete. 2024-01-22T05:38:32.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.223+0000 7f31e2e00700 1 Processor -- start 2024-01-22T05:38:32.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.223+0000 7f31e2e00700 1 -- start start 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.224+0000 7f31e2e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31dc062d00 0x7f31dc0a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.224+0000 7f31e2e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154060 0x7f31dc0a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.224+0000 7f31e2e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31dc154440 0x7f31dc0a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.224+0000 7f31e2e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc14cf90 con 0x7f31dc154060 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.224+0000 7f31e2e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1520f0 con 0x7f31dc154440 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.224+0000 7f31e2e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc153090 con 0x7f31dc062d00 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154060 0x7f31dc0a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154060 0x7f31dc0a75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41210/0 (socket says 172.21.15.100:41210) 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 -- 172.21.15.100:0/2606560733 learned_addr learned my addr 172.21.15.100:0/2606560733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31e0e00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31dc154440 0x7f31dc0a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31dbe00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31dc062d00 0x7f31dc0a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 -- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31dc062d00 msgr2=0x7f31dc0a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31dc062d00 0x7f31dc0a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 -- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31dc154440 msgr2=0x7f31dc0a7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31dc154440 0x7f31dc0a7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 -- 172.21.15.100:0/2606560733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d4009a20 con 0x7f31dc154060 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.225+0000 7f31db400700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154060 0x7f31dc0a75b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f31c400e8d0 tx=0x7f31c4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.226+0000 7f31d3400700 1 -- 172.21.15.100:0/2606560733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4012600 con 0x7f31dc154060 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.226+0000 7f31d3400700 1 -- 172.21.15.100:0/2606560733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c4012760 con 0x7f31dc154060 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.226+0000 7f31d3400700 1 -- 172.21.15.100:0/2606560733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4012ae0 con 0x7f31dc154060 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.226+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc1522d0 con 0x7f31dc154060 2024-01-22T05:38:32.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.226+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc152890 con 0x7f31dc154060 2024-01-22T05:38:32.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.227+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc05fdb0 con 0x7f31dc154060 2024-01-22T05:38:32.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.228+0000 7f31d3400700 1 -- 172.21.15.100:0/2606560733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f31c401b400 con 0x7f31dc154060 2024-01-22T05:38:32.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.228+0000 7f31d3400700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f31b405f150 0x7f31b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.228+0000 7f31d3400700 1 -- 172.21.15.100:0/2606560733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f31c407a5a0 con 0x7f31dc154060 2024-01-22T05:38:32.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.229+0000 7f31dbe00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f31b405f150 0x7f31b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.229+0000 7f31dbe00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f31b405f150 0x7f31b4061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f31cc007fd0 tx=0x7f31cc007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.233+0000 7f31d3400700 1 -- 172.21.15.100:0/2606560733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f31c404b7b0 con 0x7f31dc154060 2024-01-22T05:38:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.405+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31dc063230 con 0x7f31dc154060 2024-01-22T05:38:32.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.406+0000 7f31d3400700 1 -- 172.21.15.100:0/2606560733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f31c404edd0 con 0x7f31dc154060 2024-01-22T05:38:32.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:32.408 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.408+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f31b405f150 msgr2=0x7f31b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.408+0000 7f31e2e00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f31b405f150 0x7f31b4061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f31cc007fd0 tx=0x7f31cc007d30).stop 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.408+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154060 msgr2=0x7f31dc0a75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.408+0000 7f31e2e00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154060 0x7f31dc0a75b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f31c400e8d0 tx=0x7f31c4009060).stop 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.408+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 shutdown_connections 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.409+0000 7f31e2e00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f31b405f150 0x7f31b4061610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.409+0000 7f31e2e00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31dc154440 0x7f31dc0a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.409+0000 7f31e2e00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31dc062d00 0x7f31dc0a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.409+0000 7f31e2e00700 1 --2- 172.21.15.100:0/2606560733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31dc154060 0x7f31dc0a75b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.409+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 >> 172.21.15.100:0/2606560733 conn(0x7f31dc0c7ad0 msgr2=0x7f31dc0a5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.409+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 shutdown_connections 2024-01-22T05:38:32.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.409+0000 7f31e2e00700 1 -- 172.21.15.100:0/2606560733 wait complete. 2024-01-22T05:38:32.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:37:56.837820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:37:57.667310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:38:32.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:32.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.613+0000 7f2327200700 1 Processor -- start 2024-01-22T05:38:32.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.613+0000 7f2327200700 1 -- start start 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f2327200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2320157290 0x7f2320092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f2327200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2320092600 0x7f23200c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f2327200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2320065000 con 0x7f2320157670 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f2327200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200c4250 con 0x7f2320157290 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f2327200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200643f0 con 0x7f2320092600 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2320157290 0x7f2320092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2320157290 0x7f2320092110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41224/0 (socket says 172.21.15.100:41224) 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231fe00700 1 -- 172.21.15.100:0/3931301912 learned_addr learned my addr 172.21.15.100:0/3931301912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f2325200700 1 --1- 172.21.15.100:0/3931301912 >> v1:172.21.15.100:6789/0 conn(0x7f2320157670 0x7f2320157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55066/0 (socket says 172.21.15.100:55066) 2024-01-22T05:38:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231f400700 1 --2- 172.21.15.100:0/3931301912 >> v2:172.21.15.169:3300/0 conn(0x7f2320092600 0x7f23200c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231fe00700 1 -- 172.21.15.100:0/3931301912 >> v2:172.21.15.169:3300/0 conn(0x7f2320092600 msgr2=0x7f23200c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231fe00700 1 --2- 172.21.15.100:0/3931301912 >> v2:172.21.15.169:3300/0 conn(0x7f2320092600 0x7f23200c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231fe00700 1 -- 172.21.15.100:0/3931301912 >> v1:172.21.15.100:6789/0 conn(0x7f2320157670 legacy=0x7f2320157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231fe00700 1 -- 172.21.15.100:0/3931301912 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200646d0 con 0x7f2320157290 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.615+0000 7f231ea00700 1 -- 172.21.15.100:0/3931301912 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839068960 0 0) 0x7f2320065000 con 0x7f2320157670 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f231fe00700 1 --2- 172.21.15.100:0/3931301912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320157290 0x7f2320092110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f23200c6750 tx=0x7f23100090f0).ready entity=mon.0 client_cookie=c37290351eec274a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f231ea00700 1 -- 172.21.15.100:0/3931301912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000b520 con 0x7f2320157290 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f231ea00700 1 -- 172.21.15.100:0/3931301912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000b680 con 0x7f2320157290 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f231ea00700 1 -- 172.21.15.100:0/3931301912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000ba00 con 0x7f2320157290 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f2327200700 1 -- 172.21.15.100:0/3931301912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320157290 msgr2=0x7f2320092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f2327200700 1 --2- 172.21.15.100:0/3931301912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320157290 0x7f2320092110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f23200c6750 tx=0x7f23100090f0).stop 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f2327200700 1 -- 172.21.15.100:0/3931301912 shutdown_connections 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f2327200700 1 --2- 172.21.15.100:0/3931301912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320157290 0x7f2320092110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f2327200700 1 --2- 172.21.15.100:0/3931301912 >> v2:172.21.15.169:3300/0 conn(0x7f2320092600 0x7f23200c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.616+0000 7f2327200700 1 -- 172.21.15.100:0/3931301912 >> 172.21.15.100:0/3931301912 conn(0x7f232005e9d0 msgr2=0x7f2320091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:32.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.617+0000 7f2327200700 1 -- 172.21.15.100:0/3931301912 shutdown_connections 2024-01-22T05:38:32.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.617+0000 7f2327200700 1 -- 172.21.15.100:0/3931301912 wait complete. 2024-01-22T05:38:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.618+0000 7f2327200700 1 Processor -- start 2024-01-22T05:38:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.618+0000 7f2327200700 1 -- start start 2024-01-22T05:38:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f2327200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320092600 0x7f2320153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f2327200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2320157290 0x7f2320094e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f2327200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2320157670 0x7f2320066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f2327200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320154060 con 0x7f2320092600 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f2327200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200957c0 con 0x7f2320157290 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f2327200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320095aa0 con 0x7f2320157670 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f231fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320092600 0x7f2320153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f231fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320092600 0x7f2320153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41230/0 (socket says 172.21.15.100:41230) 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.619+0000 7f231fe00700 1 -- 172.21.15.100:0/4205524262 learned_addr learned my addr 172.21.15.100:0/4205524262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f2325200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2320157670 0x7f2320066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231fe00700 1 -- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2320157670 msgr2=0x7f2320066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231fe00700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2320157670 0x7f2320066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231f400700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2320157290 0x7f2320094e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231fe00700 1 -- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2320157290 msgr2=0x7f2320094e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231fe00700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2320157290 0x7f2320094e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231fe00700 1 -- 172.21.15.100:0/4205524262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009370 con 0x7f2320092600 2024-01-22T05:38:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f2325200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2320157670 0x7f2320066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231f400700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2320157290 0x7f2320094e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f231fe00700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320092600 0x7f2320153b70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2310009130 tx=0x7f2310017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f2317400700 1 -- 172.21.15.100:0/4205524262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000be90 con 0x7f2320092600 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f2317400700 1 -- 172.21.15.100:0/4205524262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000b7f0 con 0x7f2320092600 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320095d80 con 0x7f2320092600 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f2317400700 1 -- 172.21.15.100:0/4205524262 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231001c670 con 0x7f2320092600 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.620+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320096340 con 0x7f2320092600 2024-01-22T05:38:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.621+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232005fdb0 con 0x7f2320092600 2024-01-22T05:38:32.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.622+0000 7f2317400700 1 -- 172.21.15.100:0/4205524262 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f231001c9e0 con 0x7f2320092600 2024-01-22T05:38:32.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.623+0000 7f2317400700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f22f805f150 0x7f22f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:32.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.623+0000 7f2317400700 1 -- 172.21.15.100:0/4205524262 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f231007bf70 con 0x7f2320092600 2024-01-22T05:38:32.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.623+0000 7f231f400700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f22f805f150 0x7f22f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:32.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.624+0000 7f231f400700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f22f805f150 0x7f22f8061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2308006d80 tx=0x7f2308008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:32.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.627+0000 7f2317400700 1 -- 172.21.15.100:0/4205524262 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f231004d180 con 0x7f2320092600 2024-01-22T05:38:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.795+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f23200649b0 con 0x7f2320092600 2024-01-22T05:38:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.795+0000 7f2317400700 1 -- 172.21.15.100:0/4205524262 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f231002a030 con 0x7f2320092600 2024-01-22T05:38:32.797 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f22f805f150 msgr2=0x7f22f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f22f805f150 0x7f22f8061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2308006d80 tx=0x7f2308008040).stop 2024-01-22T05:38:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320092600 msgr2=0x7f2320153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320092600 0x7f2320153b70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2310009130 tx=0x7f2310017000).stop 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 shutdown_connections 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f22f805f150 0x7f22f8061610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2320157670 0x7f2320066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320092600 0x7f2320153b70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 --2- 172.21.15.100:0/4205524262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2320157290 0x7f2320094e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 >> 172.21.15.100:0/4205524262 conn(0x7f232005e9d0 msgr2=0x7f2320091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 shutdown_connections 2024-01-22T05:38:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:32.798+0000 7f2327200700 1 -- 172.21.15.100:0/4205524262 wait complete. 2024-01-22T05:38:32.815 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:33.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.002+0000 7f0b53600700 1 Processor -- start 2024-01-22T05:38:33.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.002+0000 7f0b53600700 1 -- start start 2024-01-22T05:38:33.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b53600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c05e900 0x7f0b4c0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b53600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0b4c0c1940 0x7f0b4c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b53600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c0c74b0 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b53600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c0cab90 con 0x7f0b4c0c1940 2024-01-22T05:38:33.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b53600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c158660 con 0x7f0b4c05e900 2024-01-22T05:38:33.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b4be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c05e900 0x7f0b4c0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b51600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0b4c0c1940 0x7f0b4c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.004+0000 7f0b4be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c05e900 0x7f0b4c0aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:38212/0 (socket says 172.21.15.100:38212) 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4be00700 1 -- 172.21.15.100:0/2783074834 learned_addr learned my addr 172.21.15.100:0/2783074834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b50c00700 1 --1- 172.21.15.100:0/2783074834 >> v1:172.21.15.169:6789/0 conn(0x7f0b4c0a9f60 0x7f0b4c05e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:41312/0 (socket says 172.21.15.100:41312) 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4be00700 1 -- 172.21.15.100:0/2783074834 >> v2:172.21.15.169:3300/0 conn(0x7f0b4c0c1940 msgr2=0x7f0b4c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4be00700 1 --2- 172.21.15.100:0/2783074834 >> v2:172.21.15.169:3300/0 conn(0x7f0b4c0c1940 0x7f0b4c0ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4be00700 1 -- 172.21.15.100:0/2783074834 >> v1:172.21.15.169:6789/0 conn(0x7f0b4c0a9f60 legacy=0x7f0b4c05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4be00700 1 -- 172.21.15.100:0/2783074834 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c158940 con 0x7f0b4c05e900 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4be00700 1 --2- 172.21.15.100:0/2783074834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c05e900 0x7f0b4c0aa340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b34006fd0 tx=0x7f0b340090f0).ready entity=mon.2 client_cookie=7bcfd31ba31c2157 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4b400700 1 -- 172.21.15.100:0/2783074834 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3400b580 con 0x7f0b4c05e900 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4b400700 1 -- 172.21.15.100:0/2783074834 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3400b6e0 con 0x7f0b4c05e900 2024-01-22T05:38:33.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b4b400700 1 -- 172.21.15.100:0/2783074834 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3400ba60 con 0x7f0b4c05e900 2024-01-22T05:38:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 -- 172.21.15.100:0/2783074834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c05e900 msgr2=0x7f0b4c0aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 --2- 172.21.15.100:0/2783074834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c05e900 0x7f0b4c0aa340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b34006fd0 tx=0x7f0b340090f0).stop 2024-01-22T05:38:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 -- 172.21.15.100:0/2783074834 shutdown_connections 2024-01-22T05:38:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 --2- 172.21.15.100:0/2783074834 >> v2:172.21.15.169:3300/0 conn(0x7f0b4c0c1940 0x7f0b4c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 --2- 172.21.15.100:0/2783074834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c05e900 0x7f0b4c0aa340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 -- 172.21.15.100:0/2783074834 >> 172.21.15.100:0/2783074834 conn(0x7f0b4c0cada0 msgr2=0x7f0b4c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:33.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 -- 172.21.15.100:0/2783074834 shutdown_connections 2024-01-22T05:38:33.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.005+0000 7f0b53600700 1 -- 172.21.15.100:0/2783074834 wait complete. 2024-01-22T05:38:33.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.008+0000 7f0b53600700 1 Processor -- start 2024-01-22T05:38:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.008+0000 7f0b53600700 1 -- start start 2024-01-22T05:38:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b53600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c05e900 0x7f0b4c063230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b53600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0a9f60 0x7f0b4c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b53600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c0c1940 0x7f0b4c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b53600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c1574e0 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b53600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0639a0 con 0x7f0b4c05e900 2024-01-22T05:38:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b53600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c063720 con 0x7f0b4c0c1940 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0a9f60 0x7f0b4c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0a9f60 0x7f0b4c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37248/0 (socket says 172.21.15.100:37248) 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 -- 172.21.15.100:0/3207994979 learned_addr learned my addr 172.21.15.100:0/3207994979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b51600700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c0c1940 0x7f0b4c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b50c00700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c05e900 0x7f0b4c063230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 -- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c0c1940 msgr2=0x7f0b4c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c0c1940 0x7f0b4c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 -- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c05e900 msgr2=0x7f0b4c063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c05e900 0x7f0b4c063230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.009+0000 7f0b4be00700 1 -- 172.21.15.100:0/3207994979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34009370 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.010+0000 7f0b4be00700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0a9f60 0x7f0b4c157a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0b4c1587a0 tx=0x7f0b34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.010+0000 7f0b43e00700 1 -- 172.21.15.100:0/3207994979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34000bc0 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.010+0000 7f0b43e00700 1 -- 172.21.15.100:0/3207994979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3400b850 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.010+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c0c3ae0 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.010+0000 7f0b43e00700 1 -- 172.21.15.100:0/3207994979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34000d20 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.010+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c0c40a0 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.011+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c0c4440 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.012+0000 7f0b43e00700 1 -- 172.21.15.100:0/3207994979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0b3401b8b0 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.013+0000 7f0b43e00700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b2405f150 0x7f0b24061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.013+0000 7f0b43e00700 1 -- 172.21.15.100:0/3207994979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b3407ba80 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.013+0000 7f0b50c00700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b2405f150 0x7f0b24061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.013+0000 7f0b50c00700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b2405f150 0x7f0b24061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0b3c000c00 tx=0x7f0b3c007cf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.017+0000 7f0b43e00700 1 -- 172.21.15.100:0/3207994979 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0b3404cd50 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.185+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b4c05fdb0 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.186+0000 7f0b43e00700 1 -- 172.21.15.100:0/3207994979 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b3401f070 con 0x7f0b4c0a9f60 2024-01-22T05:38:33.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b2405f150 msgr2=0x7f0b24061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b2405f150 0x7f0b24061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0b3c000c00 tx=0x7f0b3c007cf0).stop 2024-01-22T05:38:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0a9f60 msgr2=0x7f0b4c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0a9f60 0x7f0b4c157a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0b4c1587a0 tx=0x7f0b34017000).stop 2024-01-22T05:38:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 shutdown_connections 2024-01-22T05:38:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0b2405f150 0x7f0b24061610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c05e900 0x7f0b4c063230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c0c1940 0x7f0b4c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 --2- 172.21.15.100:0/3207994979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0a9f60 0x7f0b4c157a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 >> 172.21.15.100:0/3207994979 conn(0x7f0b4c0cada0 msgr2=0x7f0b4c0add30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 shutdown_connections 2024-01-22T05:38:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.188+0000 7f0b53600700 1 -- 172.21.15.100:0/3207994979 wait complete. 2024-01-22T05:38:33.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:38:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.393+0000 7fbe7dc00700 1 Processor -- start 2024-01-22T05:38:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.394+0000 7fbe7dc00700 1 -- start start 2024-01-22T05:38:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe7dc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe780aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe7dc00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe780c1940 0x7fbe780ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe7dc00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780c74b0 con 0x7fbe7805e1f0 2024-01-22T05:38:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe7dc00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780cab90 con 0x7fbe780c1940 2024-01-22T05:38:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe7dc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78158660 con 0x7fbe780a9f60 2024-01-22T05:38:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe76a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe780aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe76000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe780c1940 0x7fbe780ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe77400700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fbe7805e1f0 0x7fbe78098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:41326/0 (socket says 172.21.15.100:41326) 2024-01-22T05:38:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.395+0000 7fbe77400700 1 -- 172.21.15.100:0/1647561337 learned_addr learned my addr 172.21.15.100:0/1647561337 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe76000700 1 -- 172.21.15.100:0/1647561337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 msgr2=0x7fbe780aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe76000700 1 --2- 172.21.15.100:0/1647561337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe780aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe76000700 1 -- 172.21.15.100:0/1647561337 >> v1:172.21.15.169:6789/0 conn(0x7fbe7805e1f0 legacy=0x7fbe78098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe76000700 1 -- 172.21.15.100:0/1647561337 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78158940 con 0x7fbe780c1940 2024-01-22T05:38:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe76000700 1 --2- 172.21.15.100:0/1647561337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe780c1940 0x7fbe780ca6a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbe60009760 tx=0x7fbe60009060).ready entity=mon.1 client_cookie=7000adff393d83d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe75600700 1 -- 172.21.15.100:0/1647561337 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6000f510 con 0x7fbe780c1940 2024-01-22T05:38:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe75600700 1 -- 172.21.15.100:0/1647561337 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6000f670 con 0x7fbe780c1940 2024-01-22T05:38:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.396+0000 7fbe75600700 1 -- 172.21.15.100:0/1647561337 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6000f9f0 con 0x7fbe780c1940 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 -- 172.21.15.100:0/1647561337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe780c1940 msgr2=0x7fbe780ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/1647561337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe780c1940 0x7fbe780ca6a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbe60009760 tx=0x7fbe60009060).stop 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 -- 172.21.15.100:0/1647561337 shutdown_connections 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/1647561337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe780aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/1647561337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe780c1940 0x7fbe780ca6a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 -- 172.21.15.100:0/1647561337 >> 172.21.15.100:0/1647561337 conn(0x7fbe780cada0 msgr2=0x7fbe780cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 -- 172.21.15.100:0/1647561337 shutdown_connections 2024-01-22T05:38:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.397+0000 7fbe7dc00700 1 -- 172.21.15.100:0/1647561337 wait complete. 2024-01-22T05:38:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.399+0000 7fbe7dc00700 1 Processor -- start 2024-01-22T05:38:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.399+0000 7fbe7dc00700 1 -- start start 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.400+0000 7fbe7dc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7805e1f0 0x7fbe78164860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.400+0000 7fbe7dc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe78168800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.400+0000 7fbe7dc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe780c1940 0x7fbe780a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.400+0000 7fbe7dc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780989e0 con 0x7fbe780c1940 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.400+0000 7fbe7dc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78168cf0 con 0x7fbe7805e1f0 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe7dc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78164e90 con 0x7fbe780a9f60 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe77400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe780c1940 0x7fbe780a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7805e1f0 0x7fbe78164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7805e1f0 0x7fbe78164860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:40270/0 (socket says 172.21.15.100:40270) 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 -- 172.21.15.100:0/2366394072 learned_addr learned my addr 172.21.15.100:0/2366394072 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76000700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe78168800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 -- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 msgr2=0x7fbe78168800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe78168800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 -- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe780c1940 msgr2=0x7fbe780a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe780c1940 0x7fbe780a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 -- 172.21.15.100:0/2366394072 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600092a0 con 0x7fbe7805e1f0 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe77400700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe780c1940 0x7fbe780a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.401+0000 7fbe76a00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7805e1f0 0x7fbe78164860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fbe6800e930 tx=0x7fbe68009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.402+0000 7fbe6e000700 1 -- 172.21.15.100:0/2366394072 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68012600 con 0x7fbe7805e1f0 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.402+0000 7fbe6e000700 1 -- 172.21.15.100:0/2366394072 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68012760 con 0x7fbe7805e1f0 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.402+0000 7fbe6e000700 1 -- 172.21.15.100:0/2366394072 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68012ae0 con 0x7fbe7805e1f0 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.402+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe78165170 con 0x7fbe7805e1f0 2024-01-22T05:38:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.402+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe78165730 con 0x7fbe7805e1f0 2024-01-22T05:38:33.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.403+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe78155920 con 0x7fbe7805e1f0 2024-01-22T05:38:33.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.404+0000 7fbe6e000700 1 -- 172.21.15.100:0/2366394072 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbe6801b400 con 0x7fbe7805e1f0 2024-01-22T05:38:33.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.404+0000 7fbe6e000700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbe5005f150 0x7fbe50061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.404+0000 7fbe6e000700 1 -- 172.21.15.100:0/2366394072 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbe6807a700 con 0x7fbe7805e1f0 2024-01-22T05:38:33.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.405+0000 7fbe76000700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbe5005f150 0x7fbe50061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.405+0000 7fbe76000700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbe5005f150 0x7fbe50061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fbe60009760 tx=0x7fbe60017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.410+0000 7fbe6e000700 1 -- 172.21.15.100:0/2366394072 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe6804b8b0 con 0x7fbe7805e1f0 2024-01-22T05:38:33.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.579+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe780ca030 con 0x7fbe7805e1f0 2024-01-22T05:38:33.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.580+0000 7fbe6e000700 1 -- 172.21.15.100:0/2366394072 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe6804eed0 con 0x7fbe7805e1f0 2024-01-22T05:38:33.580 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.582+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbe5005f150 msgr2=0x7fbe50061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.582+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbe5005f150 0x7fbe50061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fbe60009760 tx=0x7fbe60017000).stop 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.582+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7805e1f0 msgr2=0x7fbe78164860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.582+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7805e1f0 0x7fbe78164860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fbe6800e930 tx=0x7fbe68009060).stop 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 shutdown_connections 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbe5005f150 0x7fbe50061610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7805e1f0 0x7fbe78164860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe780c1940 0x7fbe780a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 --2- 172.21.15.100:0/2366394072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe780a9f60 0x7fbe78168800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 >> 172.21.15.100:0/2366394072 conn(0x7fbe780cada0 msgr2=0x7fbe780c0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:33.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 shutdown_connections 2024-01-22T05:38:33.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.583+0000 7fbe7dc00700 1 -- 172.21.15.100:0/2366394072 wait complete. 2024-01-22T05:38:33.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:38:33.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.788+0000 7f6989800700 1 Processor -- start 2024-01-22T05:38:33.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.788+0000 7f6989800700 1 -- start start 2024-01-22T05:38:33.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.789+0000 7f6989800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6984154260 0x7f69840cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.789+0000 7f6989800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c5c80 0x7f69840c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.789+0000 7f6989800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840c1a40 con 0x7f69840c65f0 2024-01-22T05:38:33.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.789+0000 7f6989800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840cbd30 con 0x7f6984154260 2024-01-22T05:38:33.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.789+0000 7f6989800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c6a80 con 0x7f69840c5c80 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c5c80 0x7f69840c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c5c80 0x7f69840c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:38256/0 (socket says 172.21.15.100:38256) 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982000700 1 -- 172.21.15.100:0/3929559434 learned_addr learned my addr 172.21.15.100:0/3929559434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6983400700 1 --1- 172.21.15.100:0/3929559434 >> v1:172.21.15.169:6789/0 conn(0x7f69840c65f0 0x7f6984157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:41342/0 (socket says 172.21.15.100:41342) 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982a00700 1 --2- 172.21.15.100:0/3929559434 >> v2:172.21.15.169:3300/0 conn(0x7f6984154260 0x7f69840cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6981600700 1 -- 172.21.15.100:0/3929559434 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947831743 0 0) 0x7f69840c1a40 con 0x7f69840c65f0 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6981600700 1 -- 172.21.15.100:0/3929559434 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69640033f0 con 0x7f69840c65f0 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982000700 1 -- 172.21.15.100:0/3929559434 >> v2:172.21.15.169:3300/0 conn(0x7f6984154260 msgr2=0x7f69840cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982000700 1 --2- 172.21.15.100:0/3929559434 >> v2:172.21.15.169:3300/0 conn(0x7f6984154260 0x7f69840cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982000700 1 -- 172.21.15.100:0/3929559434 >> v1:172.21.15.169:6789/0 conn(0x7f69840c65f0 legacy=0x7f6984157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.790+0000 7f6982000700 1 -- 172.21.15.100:0/3929559434 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840c1110 con 0x7f69840c5c80 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6982000700 1 --2- 172.21.15.100:0/3929559434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c5c80 0x7f69840c6100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f696c009830 tx=0x7f696c0090f0).ready entity=mon.2 client_cookie=e12f1f7a34be4062 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6981600700 1 -- 172.21.15.100:0/3929559434 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00f510 con 0x7f69840c5c80 2024-01-22T05:38:33.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6981600700 1 -- 172.21.15.100:0/3929559434 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00f670 con 0x7f69840c5c80 2024-01-22T05:38:33.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6981600700 1 -- 172.21.15.100:0/3929559434 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00f9f0 con 0x7f69840c5c80 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6989800700 1 -- 172.21.15.100:0/3929559434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c5c80 msgr2=0x7f69840c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6989800700 1 --2- 172.21.15.100:0/3929559434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c5c80 0x7f69840c6100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f696c009830 tx=0x7f696c0090f0).stop 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6989800700 1 -- 172.21.15.100:0/3929559434 shutdown_connections 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6989800700 1 --2- 172.21.15.100:0/3929559434 >> v2:172.21.15.169:3300/0 conn(0x7f6984154260 0x7f69840cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6989800700 1 --2- 172.21.15.100:0/3929559434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c5c80 0x7f69840c6100 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6989800700 1 -- 172.21.15.100:0/3929559434 >> 172.21.15.100:0/3929559434 conn(0x7f698405e9d0 msgr2=0x7f69840cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.791+0000 7f6989800700 1 -- 172.21.15.100:0/3929559434 shutdown_connections 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.792+0000 7f6989800700 1 -- 172.21.15.100:0/3929559434 wait complete. 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.793+0000 7f6989800700 1 Processor -- start 2024-01-22T05:38:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.793+0000 7f6989800700 1 -- start start 2024-01-22T05:38:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6989800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69840c5c80 0x7f6984152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6989800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c65f0 0x7f69841591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6989800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6984154260 0x7f69840c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6989800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c3980 con 0x7f6984154260 2024-01-22T05:38:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6989800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c2ad0 con 0x7f69840c5c80 2024-01-22T05:38:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6989800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c3e10 con 0x7f69840c65f0 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6983400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6984154260 0x7f69840c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6983400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6984154260 0x7f69840c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37264/0 (socket says 172.21.15.100:37264) 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.794+0000 7f6983400700 1 -- 172.21.15.100:0/3777153328 learned_addr learned my addr 172.21.15.100:0/3777153328 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6982000700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c65f0 0x7f69841591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6982a00700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69840c5c80 0x7f6984152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6983400700 1 -- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c65f0 msgr2=0x7f69841591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6983400700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c65f0 0x7f69841591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6983400700 1 -- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69840c5c80 msgr2=0x7f6984152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6983400700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69840c5c80 0x7f6984152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6983400700 1 -- 172.21.15.100:0/3777153328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009370 con 0x7f6984154260 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6982000700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c65f0 0x7f69841591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6983400700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6984154260 0x7f69840c8c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f697c00c7c0 tx=0x7f697c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f697a000700 1 -- 172.21.15.100:0/3777153328 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c005c70 con 0x7f6984154260 2024-01-22T05:38:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f697a000700 1 -- 172.21.15.100:0/3777153328 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c005dd0 con 0x7f6984154260 2024-01-22T05:38:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69840c2d70 con 0x7f6984154260 2024-01-22T05:38:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f697a000700 1 -- 172.21.15.100:0/3777153328 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c007320 con 0x7f6984154260 2024-01-22T05:38:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.795+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69840c3330 con 0x7f6984154260 2024-01-22T05:38:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.796+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69840c3af0 con 0x7f6984154260 2024-01-22T05:38:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.797+0000 7f697a000700 1 -- 172.21.15.100:0/3777153328 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f697c007750 con 0x7f6984154260 2024-01-22T05:38:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.798+0000 7f697a000700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f695c05f120 0x7f695c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.798+0000 7f697a000700 1 -- 172.21.15.100:0/3777153328 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f697c07a190 con 0x7f6984154260 2024-01-22T05:38:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.798+0000 7f6982a00700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f695c05f120 0x7f695c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.799+0000 7f6982a00700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f695c05f120 0x7f695c0615e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6974006fd0 tx=0x7f6974006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.802+0000 7f697a000700 1 -- 172.21.15.100:0/3777153328 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f697c04b460 con 0x7f6984154260 2024-01-22T05:38:33.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.971+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69840c13f0 con 0x7f6984154260 2024-01-22T05:38:33.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.972+0000 7f697a000700 1 -- 172.21.15.100:0/3777153328 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f697c04ea80 con 0x7f6984154260 2024-01-22T05:38:33.972 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:33.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f695c05f120 msgr2=0x7f695c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f695c05f120 0x7f695c0615e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6974006fd0 tx=0x7f6974006f40).stop 2024-01-22T05:38:33.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6984154260 msgr2=0x7f69840c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6984154260 0x7f69840c8c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f697c00c7c0 tx=0x7f697c007f90).stop 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 shutdown_connections 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f695c05f120 0x7f695c0615e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69840c5c80 0x7f6984152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6984154260 0x7f69840c8c00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 --2- 172.21.15.100:0/3777153328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69840c65f0 0x7f69841591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 >> 172.21.15.100:0/3777153328 conn(0x7f698405e9d0 msgr2=0x7f69840ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 shutdown_connections 2024-01-22T05:38:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:33.974+0000 7f6989800700 1 -- 172.21.15.100:0/3777153328 wait complete. 2024-01-22T05:38:33.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.175+0000 7fc5b9800700 1 Processor -- start 2024-01-22T05:38:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.175+0000 7fc5b9800700 1 -- start start 2024-01-22T05:38:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.176+0000 7fc5b9800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc5b40a7c90 0x7fc5b40639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.176+0000 7fc5b9800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc5b4098920 0x7fc5b4063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.176+0000 7fc5b9800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b40c5d20 con 0x7fc5b4153fb0 2024-01-22T05:38:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.176+0000 7fc5b9800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40643c0 con 0x7fc5b4098920 2024-01-22T05:38:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.176+0000 7fc5b9800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40c57a0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc5b4098920 0x7fc5b4063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc5b4098920 0x7fc5b4063ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37278/0 (socket says 172.21.15.100:37278) 2024-01-22T05:38:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 -- 172.21.15.100:0/925457154 learned_addr learned my addr 172.21.15.100:0/925457154 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 -- 172.21.15.100:0/925457154 >> v2:172.21.15.169:3300/0 conn(0x7fc5b40a7c90 msgr2=0x7fc5b40639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 --2- 172.21.15.100:0/925457154 >> v2:172.21.15.169:3300/0 conn(0x7fc5b40a7c90 0x7fc5b40639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 -- 172.21.15.100:0/925457154 >> v1:172.21.15.169:6789/0 conn(0x7fc5b4153fb0 legacy=0x7fc5b40c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 -- 172.21.15.100:0/925457154 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40c16c0 con 0x7fc5b4098920 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b3400700 1 --2- 172.21.15.100:0/925457154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b4098920 0x7fc5b4063ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fc5b40c8c00 tx=0x7fc5ac009840).ready entity=mon.0 client_cookie=ff1626fb925e10a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.177+0000 7fc5b1600700 1 -- 172.21.15.100:0/925457154 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00e070 con 0x7fc5b4098920 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b1600700 1 -- 172.21.15.100:0/925457154 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac00ba10 con 0x7fc5b4098920 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b1600700 1 -- 172.21.15.100:0/925457154 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00bd90 con 0x7fc5b4098920 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 -- 172.21.15.100:0/925457154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b4098920 msgr2=0x7fc5b4063ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 --2- 172.21.15.100:0/925457154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b4098920 0x7fc5b4063ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fc5b40c8c00 tx=0x7fc5ac009840).stop 2024-01-22T05:38:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 -- 172.21.15.100:0/925457154 shutdown_connections 2024-01-22T05:38:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 --2- 172.21.15.100:0/925457154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b4098920 0x7fc5b4063ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 --2- 172.21.15.100:0/925457154 >> v2:172.21.15.169:3300/0 conn(0x7fc5b40a7c90 0x7fc5b40639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 -- 172.21.15.100:0/925457154 >> 172.21.15.100:0/925457154 conn(0x7fc5b40c78a0 msgr2=0x7fc5b40c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 -- 172.21.15.100:0/925457154 shutdown_connections 2024-01-22T05:38:34.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.178+0000 7fc5b9800700 1 -- 172.21.15.100:0/925457154 wait complete. 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.180+0000 7fc5b9800700 1 Processor -- start 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.180+0000 7fc5b9800700 1 -- start start 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b9800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b4098920 0x7fc5b40c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b9800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b40a7c90 0x7fc5b40c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b9800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5b4153fb0 0x7fc5b40c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b9800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b4151160 con 0x7fc5b40a7c90 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b9800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41504e0 con 0x7fc5b4098920 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b9800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41507c0 con 0x7fc5b4153fb0 2024-01-22T05:38:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b40a7c90 0x7fc5b40c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b40a7c90 0x7fc5b40c3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37292/0 (socket says 172.21.15.100:37292) 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 -- 172.21.15.100:0/3252702954 learned_addr learned my addr 172.21.15.100:0/3252702954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b3400700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5b4153fb0 0x7fc5b40c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2a00700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b4098920 0x7fc5b40c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 -- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5b4153fb0 msgr2=0x7fc5b40c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5b4153fb0 0x7fc5b40c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 -- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b4098920 msgr2=0x7fc5b40c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b4098920 0x7fc5b40c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 -- 172.21.15.100:0/3252702954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009ae0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2a00700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b4098920 0x7fc5b40c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b3400700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5b4153fb0 0x7fc5b40c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.181+0000 7fc5b2000700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b40a7c90 0x7fc5b40c3b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc59c00b530 tx=0x7fc59c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.182+0000 7fc5aa000700 1 -- 172.21.15.100:0/3252702954 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00d4a0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.182+0000 7fc5aa000700 1 -- 172.21.15.100:0/3252702954 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c00d620 con 0x7fc5b40a7c90 2024-01-22T05:38:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.182+0000 7fc5aa000700 1 -- 172.21.15.100:0/3252702954 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00d9e0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.182+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b4150aa0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.182+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b4150140 con 0x7fc5b40a7c90 2024-01-22T05:38:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.183+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b41512a0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.184+0000 7fc5aa000700 1 -- 172.21.15.100:0/3252702954 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc59c012410 con 0x7fc5b40a7c90 2024-01-22T05:38:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.184+0000 7fc5aa000700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc58c05f120 0x7fc58c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.184+0000 7fc5aa000700 1 -- 172.21.15.100:0/3252702954 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc59c07a220 con 0x7fc5b40a7c90 2024-01-22T05:38:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.185+0000 7fc5b2a00700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc58c05f120 0x7fc58c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.185+0000 7fc5b2a00700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc58c05f120 0x7fc58c0615e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc5a4006fd0 tx=0x7fc5a4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.188+0000 7fc5aa000700 1 -- 172.21.15.100:0/3252702954 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc5b41512a0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.359+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5b41512a0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.360+0000 7fc5aa000700 1 -- 172.21.15.100:0/3252702954 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fc5b41512a0 con 0x7fc5b40a7c90 2024-01-22T05:38:34.360 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:34.360 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:34.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc58c05f120 msgr2=0x7fc58c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc58c05f120 0x7fc58c0615e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc5a4006fd0 tx=0x7fc5a4008040).stop 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b40a7c90 msgr2=0x7fc5b40c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b40a7c90 0x7fc5b40c3b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc59c00b530 tx=0x7fc59c0090f0).stop 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 shutdown_connections 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc58c05f120 0x7fc58c0615e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b4098920 0x7fc5b40c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5b4153fb0 0x7fc5b40c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 --2- 172.21.15.100:0/3252702954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5b40a7c90 0x7fc5b40c3b20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 >> 172.21.15.100:0/3252702954 conn(0x7fc5b40c78a0 msgr2=0x7fc5b40a8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 shutdown_connections 2024-01-22T05:38:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.362+0000 7fc5b9800700 1 -- 172.21.15.100:0/3252702954 wait complete. 2024-01-22T05:38:34.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:37:56.837820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:37:57.667310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:38:34.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.566+0000 7f3e30800700 1 Processor -- start 2024-01-22T05:38:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.566+0000 7f3e30800700 1 -- start start 2024-01-22T05:38:34.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.567+0000 7f3e30800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 0x7f3e280cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.567+0000 7f3e30800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3e280c5c80 0x7f3e280c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.567+0000 7f3e30800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e280c1a40 con 0x7f3e280c65f0 2024-01-22T05:38:34.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.567+0000 7f3e30800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e280cbd30 con 0x7f3e280c5c80 2024-01-22T05:38:34.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.567+0000 7f3e30800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280c6aa0 con 0x7f3e28154260 2024-01-22T05:38:34.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2e800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3e280c65f0 0x7f3e28157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38848/0 (socket says 172.21.15.100:38848) 2024-01-22T05:38:34.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2e800700 1 -- 172.21.15.100:0/1197741673 learned_addr learned my addr 172.21.15.100:0/1197741673 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:34.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2d400700 1 --2- 172.21.15.100:0/1197741673 >> v2:172.21.15.169:3300/0 conn(0x7f3e280c5c80 0x7f3e280c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446513518 0 0) 0x7f3e280c1a40 con 0x7f3e280c65f0 2024-01-22T05:38:34.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2de00700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 0x7f3e280cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e080033f0 con 0x7f3e280c65f0 2024-01-22T05:38:34.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 382227471 0 0) 0x7f3e080033f0 con 0x7f3e280c65f0 2024-01-22T05:38:34.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 msgr2=0x7f3e280cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:34.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 0x7f3e280cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 >> v2:172.21.15.169:3300/0 conn(0x7f3e280c5c80 msgr2=0x7f3e280c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 --2- 172.21.15.100:0/1197741673 >> v2:172.21.15.169:3300/0 conn(0x7f3e280c5c80 0x7f3e280c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280c1110 con 0x7f3e280c65f0 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f3e200017f0 con 0x7f3e280c65f0 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 >> v1:172.21.15.100:6789/0 conn(0x7f3e280c65f0 legacy=0x7f3e28157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 0x7f3e080038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e08003e10 0x7f3e08004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e08004b80 0x7f3e08005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cbd30 con 0x7f3e08003e10 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280c6aa0 con 0x7f3e08004b80 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.568+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0800b8e0 con 0x7f3e28154260 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2d400700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e08003e10 0x7f3e08004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2de00700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 0x7f3e080038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2e800700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e08004b80 0x7f3e08005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2d400700 1 -- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 msgr2=0x7f3e080038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2d400700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e28154260 0x7f3e080038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2d400700 1 -- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e08004b80 msgr2=0x7f3e08005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2d400700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e08004b80 0x7f3e08005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2d400700 1 -- 172.21.15.100:0/1197741673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080033f0 con 0x7f3e08003e10 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2d400700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e08003e10 0x7f3e08004690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3e10009a80 tx=0x7f3e10009060).ready entity=mon.0 client_cookie=eba7dedb0593fe9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10009430 con 0x7f3e08003e10 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1000e640 con 0x7f3e08003e10 2024-01-22T05:38:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.569+0000 7f3e2ca00700 1 -- 172.21.15.100:0/1197741673 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000e9c0 con 0x7f3e08003e10 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.570+0000 7f3e30800700 1 -- 172.21.15.100:0/1197741673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e08003e10 msgr2=0x7f3e08004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.570+0000 7f3e30800700 1 --2- 172.21.15.100:0/1197741673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e08003e10 0x7f3e08004690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3e10009a80 tx=0x7f3e10009060).stop 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.570+0000 7f3e2e800700 1 -- 172.21.15.100:0/1197741673 reap_dead start 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.570+0000 7f3e30800700 1 -- 172.21.15.100:0/1197741673 shutdown_connections 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.570+0000 7f3e30800700 1 -- 172.21.15.100:0/1197741673 >> 172.21.15.100:0/1197741673 conn(0x7f3e2805e9d0 msgr2=0x7f3e280cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.570+0000 7f3e30800700 1 -- 172.21.15.100:0/1197741673 shutdown_connections 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.570+0000 7f3e30800700 1 -- 172.21.15.100:0/1197741673 wait complete. 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.572+0000 7f3e30800700 1 Processor -- start 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.572+0000 7f3e30800700 1 -- start start 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e30800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e08003e10 0x7f3e280b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e30800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e28156aa0 0x7f3e280ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e30800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e280aae30 0x7f3e280ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e30800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280b0070 con 0x7f3e280aae30 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e30800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28152ec0 con 0x7f3e28156aa0 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e30800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28157010 con 0x7f3e08003e10 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e280aae30 0x7f3e280ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e280aae30 0x7f3e280ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37302/0 (socket says 172.21.15.100:37302) 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 -- 172.21.15.100:0/1955743311 learned_addr learned my addr 172.21.15.100:0/1955743311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2de00700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e08003e10 0x7f3e280b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2d400700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e28156aa0 0x7f3e280ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 -- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e08003e10 msgr2=0x7f3e280b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e08003e10 0x7f3e280b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 -- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e28156aa0 msgr2=0x7f3e280ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e28156aa0 0x7f3e280ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 -- 172.21.15.100:0/1955743311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280afa20 con 0x7f3e280aae30 2024-01-22T05:38:34.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2d400700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e28156aa0 0x7f3e280ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2de00700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e08003e10 0x7f3e280b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.573+0000 7f3e2e800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e280aae30 0x7f3e280ab2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f3e2806be20 tx=0x7f3e20001350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.574+0000 7f3e25600700 1 -- 172.21.15.100:0/1955743311 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200079e0 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.574+0000 7f3e25600700 1 -- 172.21.15.100:0/1955743311 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2000e830 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.574+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e280afd00 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.574+0000 7f3e25600700 1 -- 172.21.15.100:0/1955743311 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000ebd0 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.574+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e280ad860 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.575+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e280afe90 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.576+0000 7f3e25600700 1 -- 172.21.15.100:0/1955743311 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3e20014430 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.576+0000 7f3e25600700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e0005f150 0x7f3e00061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.576+0000 7f3e25600700 1 -- 172.21.15.100:0/1955743311 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3e20079fc0 con 0x7f3e280aae30 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.577+0000 7f3e2de00700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e0005f150 0x7f3e00061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.577+0000 7f3e2de00700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e0005f150 0x7f3e00061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3e18006920 tx=0x7f3e18008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.580+0000 7f3e25600700 1 -- 172.21.15.100:0/1955743311 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3e20049b00 con 0x7f3e280aae30 2024-01-22T05:38:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.751+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3e280abbc0 con 0x7f3e280aae30 2024-01-22T05:38:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.751+0000 7f3e25600700 1 -- 172.21.15.100:0/1955743311 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3e2004b230 con 0x7f3e280aae30 2024-01-22T05:38:34.751 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:34.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e0005f150 msgr2=0x7f3e00061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e0005f150 0x7f3e00061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3e18006920 tx=0x7f3e18008040).stop 2024-01-22T05:38:34.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e280aae30 msgr2=0x7f3e280ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e280aae30 0x7f3e280ab2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f3e2806be20 tx=0x7f3e20001350).stop 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 shutdown_connections 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3e0005f150 0x7f3e00061610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e280aae30 0x7f3e280ab2b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e08003e10 0x7f3e280b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 --2- 172.21.15.100:0/1955743311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e28156aa0 0x7f3e280ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 >> 172.21.15.100:0/1955743311 conn(0x7f3e2805e9d0 msgr2=0x7f3e280c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 shutdown_connections 2024-01-22T05:38:34.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.753+0000 7f3e30800700 1 -- 172.21.15.100:0/1955743311 wait complete. 2024-01-22T05:38:34.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.957+0000 7f7993400700 1 Processor -- start 2024-01-22T05:38:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.957+0000 7f7993400700 1 -- start start 2024-01-22T05:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7993400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f798c154260 0x7f798c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7993400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f798c0c6810 0x7f798c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7993400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798c0c1a40 con 0x7f798c0c5c80 2024-01-22T05:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7993400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c0cbd30 con 0x7f798c0c6810 2024-01-22T05:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7993400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c0c1110 con 0x7f798c154260 2024-01-22T05:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7991400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f798c0c6810 0x7f798c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7991400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f798c0c6810 0x7f798c0c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37306/0 (socket says 172.21.15.100:37306) 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.958+0000 7f7991400700 1 -- 172.21.15.100:0/1367365519 learned_addr learned my addr 172.21.15.100:0/1367365519 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f7990a00700 1 --2- 172.21.15.100:0/1367365519 >> v2:172.21.15.169:3300/0 conn(0x7f798c154260 0x7f798c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f7991400700 1 -- 172.21.15.100:0/1367365519 >> v2:172.21.15.169:3300/0 conn(0x7f798c154260 msgr2=0x7f798c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f7991400700 1 --2- 172.21.15.100:0/1367365519 >> v2:172.21.15.169:3300/0 conn(0x7f798c154260 0x7f798c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f7991400700 1 -- 172.21.15.100:0/1367365519 >> v1:172.21.15.169:6789/0 conn(0x7f798c0c5c80 legacy=0x7f798c0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f7991400700 1 -- 172.21.15.100:0/1367365519 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0c13f0 con 0x7f798c0c6810 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f7991400700 1 --2- 172.21.15.100:0/1367365519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c6810 0x7f798c0c8c00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f798c083650 tx=0x7f7984009840).ready entity=mon.0 client_cookie=5d8e34f45035d2bd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f798b400700 1 -- 172.21.15.100:0/1367365519 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400e070 con 0x7f798c0c6810 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f798b400700 1 -- 172.21.15.100:0/1367365519 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400ba50 con 0x7f798c0c6810 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.959+0000 7f798b400700 1 -- 172.21.15.100:0/1367365519 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400bdd0 con 0x7f798c0c6810 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 -- 172.21.15.100:0/1367365519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c6810 msgr2=0x7f798c0c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 --2- 172.21.15.100:0/1367365519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c6810 0x7f798c0c8c00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f798c083650 tx=0x7f7984009840).stop 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 -- 172.21.15.100:0/1367365519 shutdown_connections 2024-01-22T05:38:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 --2- 172.21.15.100:0/1367365519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c6810 0x7f798c0c8c00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 --2- 172.21.15.100:0/1367365519 >> v2:172.21.15.169:3300/0 conn(0x7f798c154260 0x7f798c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 -- 172.21.15.100:0/1367365519 >> 172.21.15.100:0/1367365519 conn(0x7f798c05e9d0 msgr2=0x7f798c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 -- 172.21.15.100:0/1367365519 shutdown_connections 2024-01-22T05:38:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.960+0000 7f7993400700 1 -- 172.21.15.100:0/1367365519 wait complete. 2024-01-22T05:38:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.961+0000 7f7993400700 1 Processor -- start 2024-01-22T05:38:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.961+0000 7f7993400700 1 -- start start 2024-01-22T05:38:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.962+0000 7f7993400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c5c80 0x7f798c0985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.962+0000 7f7993400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f798c0c6810 0x7f798c152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.962+0000 7f7993400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f798c154260 0x7f798c0c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.962+0000 7f7993400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0ac1b0 con 0x7f798c0c5c80 2024-01-22T05:38:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.962+0000 7f7993400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0ab5a0 con 0x7f798c0c6810 2024-01-22T05:38:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.962+0000 7f7993400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0ab880 con 0x7f798c154260 2024-01-22T05:38:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c5c80 0x7f798c0985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c5c80 0x7f798c0985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37308/0 (socket says 172.21.15.100:37308) 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 -- 172.21.15.100:0/2214406088 learned_addr learned my addr 172.21.15.100:0/2214406088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f798be00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f798c0c6810 0x7f798c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7991400700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f798c154260 0x7f798c0c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 -- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f798c154260 msgr2=0x7f798c0c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f798c154260 0x7f798c0c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 -- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f798c0c6810 msgr2=0x7f798c152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f798c0c6810 0x7f798c152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 -- 172.21.15.100:0/2214406088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984009ae0 con 0x7f798c0c5c80 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f798be00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f798c0c6810 0x7f798c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7990a00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c5c80 0x7f798c0985c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f797c00d680 tx=0x7f797c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7983e00700 1 -- 172.21.15.100:0/2214406088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011590 con 0x7f798c0c5c80 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7983e00700 1 -- 172.21.15.100:0/2214406088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c0116f0 con 0x7f798c0c5c80 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7983e00700 1 -- 172.21.15.100:0/2214406088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011a70 con 0x7f798c0c5c80 2024-01-22T05:38:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.963+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c0abb60 con 0x7f798c0c5c80 2024-01-22T05:38:34.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.964+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c0ad5f0 con 0x7f798c0c5c80 2024-01-22T05:38:34.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.965+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c05fdb0 con 0x7f798c0c5c80 2024-01-22T05:38:34.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.965+0000 7f7983e00700 1 -- 172.21.15.100:0/2214406088 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f797c01c460 con 0x7f798c0c5c80 2024-01-22T05:38:34.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.966+0000 7f7983e00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f796405f150 0x7f7964061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:34.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.967+0000 7f7983e00700 1 -- 172.21.15.100:0/2214406088 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f797c07a280 con 0x7f798c0c5c80 2024-01-22T05:38:34.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.967+0000 7f798be00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f796405f150 0x7f7964061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:34.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.967+0000 7f798be00700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f796405f150 0x7f7964061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f798c0ad350 tx=0x7f7974009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:34.971+0000 7f7983e00700 1 -- 172.21.15.100:0/2214406088 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f797c04b4f0 con 0x7f798c0c5c80 2024-01-22T05:38:35.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.138+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f798c0ac000 con 0x7f798c0c5c80 2024-01-22T05:38:35.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.138+0000 7f7983e00700 1 -- 172.21.15.100:0/2214406088 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f797c04eb10 con 0x7f798c0c5c80 2024-01-22T05:38:35.138 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f796405f150 msgr2=0x7f7964061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f796405f150 0x7f7964061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f798c0ad350 tx=0x7f7974009040).stop 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c5c80 msgr2=0x7f798c0985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c5c80 0x7f798c0985c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f797c00d680 tx=0x7f797c008040).stop 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 shutdown_connections 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f796405f150 0x7f7964061610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f798c154260 0x7f798c0c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f798c0c5c80 0x7f798c0985c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 --2- 172.21.15.100:0/2214406088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f798c0c6810 0x7f798c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 >> 172.21.15.100:0/2214406088 conn(0x7f798c05e9d0 msgr2=0x7f798c0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 shutdown_connections 2024-01-22T05:38:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.140+0000 7f7993400700 1 -- 172.21.15.100:0/2214406088 wait complete. 2024-01-22T05:38:35.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:38:35.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.344+0000 7f6ec3600700 1 Processor -- start 2024-01-22T05:38:35.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.345+0000 7f6ec3600700 1 -- start start 2024-01-22T05:38:35.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.346+0000 7f6ec3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.346+0000 7f6ec3600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0c1a40 con 0x7f6ebc0c5c80 2024-01-22T05:38:35.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.346+0000 7f6ec3600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0cbd30 con 0x7f6ebc0c6810 2024-01-22T05:38:35.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.346+0000 7f6ec3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0c1110 con 0x7f6ebc154260 2024-01-22T05:38:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.346+0000 7f6ebbe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6ebc0c5c80 0x7f6ebc0c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38854/0 (socket says 172.21.15.100:38854) 2024-01-22T05:38:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.346+0000 7f6ebbe00700 1 -- 172.21.15.100:0/2372303082 learned_addr learned my addr 172.21.15.100:0/2372303082 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ec0c00700 1 --2- 172.21.15.100:0/2372303082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914506128 0 0) 0x7f6ebc0c1a40 con 0x7f6ebc0c5c80 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e9c0033f0 con 0x7f6ebc0c5c80 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720399326 0 0) 0x7f6ebc0cbd30 con 0x7f6ebc0c6810 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ebc0c1a40 con 0x7f6ebc0c6810 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ec0c00700 1 -- 172.21.15.100:0/2372303082 >> v1:172.21.15.169:6789/0 conn(0x7f6ebc0c6810 legacy=0x7f6ebc0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ec0c00700 1 -- 172.21.15.100:0/2372303082 >> v1:172.21.15.100:6789/0 conn(0x7f6ebc0c5c80 legacy=0x7f6ebc0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1523423683 0 0) 0x7f6e9c0033f0 con 0x7f6ebc0c5c80 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ec0c00700 1 -- 172.21.15.100:0/2372303082 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0c13f0 con 0x7f6ebc154260 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.347+0000 7f6ec0c00700 1 --2- 172.21.15.100:0/2372303082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0cb4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6eac009760 tx=0x7f6eac006f40).ready entity=mon.2 client_cookie=9cf43443d5585432 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4001470 con 0x7f6ebc154260 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac005880 con 0x7f6ebc154260 2024-01-22T05:38:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ebb400700 1 -- 172.21.15.100:0/2372303082 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac005c00 con 0x7f6ebc154260 2024-01-22T05:38:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ec3600700 1 -- 172.21.15.100:0/2372303082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 msgr2=0x7f6ebc0cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2372303082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0cb4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6eac009760 tx=0x7f6eac006f40).stop 2024-01-22T05:38:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ec3600700 1 -- 172.21.15.100:0/2372303082 shutdown_connections 2024-01-22T05:38:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2372303082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0cb4e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ec3600700 1 -- 172.21.15.100:0/2372303082 >> 172.21.15.100:0/2372303082 conn(0x7f6ebc05e9d0 msgr2=0x7f6ebc0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ec3600700 1 -- 172.21.15.100:0/2372303082 shutdown_connections 2024-01-22T05:38:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.348+0000 7f6ec3600700 1 -- 172.21.15.100:0/2372303082 wait complete. 2024-01-22T05:38:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.350+0000 7f6ec3600700 1 Processor -- start 2024-01-22T05:38:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.350+0000 7f6ec3600700 1 -- start start 2024-01-22T05:38:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec3600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ebc0c5c80 0x7f6ebc150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec3600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ebc0c6810 0x7f6ebc0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec3600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b0440 con 0x7f6ebc0c6810 2024-01-22T05:38:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec3600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0ad8c0 con 0x7f6ebc0c5c80 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0ab030 con 0x7f6ebc154260 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ebc0c6810 0x7f6ebc0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ebc0c6810 0x7f6ebc0acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37312/0 (socket says 172.21.15.100:37312) 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 -- 172.21.15.100:0/2903536114 learned_addr learned my addr 172.21.15.100:0/2903536114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec0c00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ebc0c5c80 0x7f6ebc150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ec1600700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 -- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 msgr2=0x7f6ebc0ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 -- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ebc0c5c80 msgr2=0x7f6ebc150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ebc0c5c80 0x7f6ebc150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.351+0000 7f6ebbe00700 1 -- 172.21.15.100:0/2903536114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009250 con 0x7f6ebc0c6810 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.352+0000 7f6ec0c00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ebc0c5c80 0x7f6ebc150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.352+0000 7f6ebbe00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ebc0c6810 0x7f6ebc0acb40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6ea400c810 tx=0x7f6ea4001a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.352+0000 7f6eb3e00700 1 -- 172.21.15.100:0/2903536114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4007320 con 0x7f6ebc0c6810 2024-01-22T05:38:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.352+0000 7f6eb3e00700 1 -- 172.21.15.100:0/2903536114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4007480 con 0x7f6ebc0c6810 2024-01-22T05:38:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.352+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc150710 con 0x7f6ebc0c6810 2024-01-22T05:38:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.352+0000 7f6eb3e00700 1 -- 172.21.15.100:0/2903536114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40059d0 con 0x7f6ebc0c6810 2024-01-22T05:38:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.352+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc0aaa60 con 0x7f6ebc0c6810 2024-01-22T05:38:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.353+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc0aade0 con 0x7f6ebc0c6810 2024-01-22T05:38:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.354+0000 7f6eb3e00700 1 -- 172.21.15.100:0/2903536114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6ea4013410 con 0x7f6ebc0c6810 2024-01-22T05:38:35.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.355+0000 7f6eb3e00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6e9405f150 0x7f6e94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.355+0000 7f6eb3e00700 1 -- 172.21.15.100:0/2903536114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ea407a1f0 con 0x7f6ebc0c6810 2024-01-22T05:38:35.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.355+0000 7f6ec0c00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6e9405f150 0x7f6e94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.356+0000 7f6ec0c00700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6e9405f150 0x7f6e94061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6eac006cd0 tx=0x7f6eac015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:35.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.359+0000 7f6eb3e00700 1 -- 172.21.15.100:0/2903536114 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6ea404b3a0 con 0x7f6ebc0c6810 2024-01-22T05:38:35.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.528+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ebc05fdb0 con 0x7f6ebc0c6810 2024-01-22T05:38:35.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.528+0000 7f6eb3e00700 1 -- 172.21.15.100:0/2903536114 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ea404e9c0 con 0x7f6ebc0c6810 2024-01-22T05:38:35.529 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6e9405f150 msgr2=0x7f6e94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6e9405f150 0x7f6e94061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6eac006cd0 tx=0x7f6eac015000).stop 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ebc0c6810 msgr2=0x7f6ebc0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ebc0c6810 0x7f6ebc0acb40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6ea400c810 tx=0x7f6ea4001a00).stop 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 shutdown_connections 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6e9405f150 0x7f6e94061610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ebc0c5c80 0x7f6ebc150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ebc154260 0x7f6ebc0ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 --2- 172.21.15.100:0/2903536114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ebc0c6810 0x7f6ebc0acb40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.530+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 >> 172.21.15.100:0/2903536114 conn(0x7f6ebc05e9d0 msgr2=0x7f6ebc0c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.531+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 shutdown_connections 2024-01-22T05:38:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.531+0000 7f6ec3600700 1 -- 172.21.15.100:0/2903536114 wait complete. 2024-01-22T05:38:35.548 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:38:35.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.734+0000 7f143d000700 1 Processor -- start 2024-01-22T05:38:35.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.735+0000 7f143d000700 1 -- start start 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f143d000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14380c5340 0x7f1438064c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f143d000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c6c00 0x7f14380c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f143d000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14380c7060 con 0x7f14380c5720 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f143d000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380c62c0 con 0x7f14380c5340 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f143d000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14380c2760 con 0x7f14380c6c00 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f1435e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14380c5340 0x7f1438064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f1435e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14380c5340 0x7f1438064c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37324/0 (socket says 172.21.15.100:37324) 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f1435e00700 1 -- 172.21.15.100:0/1479267390 learned_addr learned my addr 172.21.15.100:0/1479267390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f1435e00700 1 -- 172.21.15.100:0/1479267390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c6c00 msgr2=0x7f14380c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f1435e00700 1 --2- 172.21.15.100:0/1479267390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c6c00 0x7f14380c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f1435e00700 1 -- 172.21.15.100:0/1479267390 >> v1:172.21.15.169:6789/0 conn(0x7f14380c5720 legacy=0x7f14380c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.736+0000 7f1435e00700 1 -- 172.21.15.100:0/1479267390 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380c6820 con 0x7f14380c5340 2024-01-22T05:38:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.737+0000 7f1435e00700 1 --2- 172.21.15.100:0/1479267390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438064c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1428006fd0 tx=0x7f14280090f0).ready entity=mon.0 client_cookie=f3024112e5f753e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.737+0000 7f1434a00700 1 -- 172.21.15.100:0/1479267390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800b600 con 0x7f14380c5340 2024-01-22T05:38:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.737+0000 7f1434a00700 1 -- 172.21.15.100:0/1479267390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800b760 con 0x7f14380c5340 2024-01-22T05:38:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.737+0000 7f1434a00700 1 -- 172.21.15.100:0/1479267390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800bae0 con 0x7f14380c5340 2024-01-22T05:38:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.737+0000 7f143d000700 1 -- 172.21.15.100:0/1479267390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 msgr2=0x7f1438064c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.737+0000 7f143d000700 1 --2- 172.21.15.100:0/1479267390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438064c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1428006fd0 tx=0x7f14280090f0).stop 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.738+0000 7f143d000700 1 -- 172.21.15.100:0/1479267390 shutdown_connections 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.738+0000 7f143d000700 1 --2- 172.21.15.100:0/1479267390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438064c30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.738+0000 7f143d000700 1 --2- 172.21.15.100:0/1479267390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c6c00 0x7f14380c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.738+0000 7f143d000700 1 -- 172.21.15.100:0/1479267390 >> 172.21.15.100:0/1479267390 conn(0x7f14380c3ca0 msgr2=0x7f14380c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.738+0000 7f143d000700 1 -- 172.21.15.100:0/1479267390 shutdown_connections 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.738+0000 7f143d000700 1 -- 172.21.15.100:0/1479267390 wait complete. 2024-01-22T05:38:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.739+0000 7f143d000700 1 Processor -- start 2024-01-22T05:38:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.739+0000 7f143d000700 1 -- start start 2024-01-22T05:38:35.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.740+0000 7f143d000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.740+0000 7f143d000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c5720 0x7f1438163780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.740+0000 7f143d000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14380c6c00 0x7f14380a8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.740+0000 7f143d000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14381449b0 con 0x7f14380c5340 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.740+0000 7f143d000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1438143da0 con 0x7f14380c6c00 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.740+0000 7f143d000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1438144080 con 0x7f14380c5720 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.740+0000 7f1435e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37326/0 (socket says 172.21.15.100:37326) 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 -- 172.21.15.100:0/2803472459 learned_addr learned my addr 172.21.15.100:0/2803472459 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1436800700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14380c6c00 0x7f14380a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435400700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c5720 0x7f1438163780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 -- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c5720 msgr2=0x7f1438163780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c5720 0x7f1438163780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 -- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14380c6c00 msgr2=0x7f14380a8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14380c6c00 0x7f14380a8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 -- 172.21.15.100:0/2803472459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009370 con 0x7f14380c5340 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435400700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c5720 0x7f1438163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f1435e00700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438144e40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f14380641a0 tx=0x7f1428017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f142d600700 1 -- 172.21.15.100:0/2803472459 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800b8d0 con 0x7f14380c5340 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f142d600700 1 -- 172.21.15.100:0/2803472459 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800ba30 con 0x7f14380c5340 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f142d600700 1 -- 172.21.15.100:0/2803472459 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142801b660 con 0x7f14380c5340 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.741+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1438144360 con 0x7f14380c5340 2024-01-22T05:38:35.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.742+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1438145330 con 0x7f14380c5340 2024-01-22T05:38:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.743+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143805fdb0 con 0x7f14380c5340 2024-01-22T05:38:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.743+0000 7f142d600700 1 -- 172.21.15.100:0/2803472459 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f142801ba10 con 0x7f14380c5340 2024-01-22T05:38:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.744+0000 7f142d600700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f141005f150 0x7f1410061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.744+0000 7f142d600700 1 -- 172.21.15.100:0/2803472459 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f142807bb60 con 0x7f14380c5340 2024-01-22T05:38:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.744+0000 7f1435400700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f141005f150 0x7f1410061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:35.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.745+0000 7f1435400700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f141005f150 0x7f1410061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f14380a4dc0 tx=0x7f1420008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.748+0000 7f142d600700 1 -- 172.21.15.100:0/2803472459 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f142804ce30 con 0x7f14380c5340 2024-01-22T05:38:35.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.917+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14380c7060 con 0x7f14380c5340 2024-01-22T05:38:35.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.918+0000 7f142d600700 1 -- 172.21.15.100:0/2803472459 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14380c7060 con 0x7f14380c5340 2024-01-22T05:38:35.918 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f141005f150 msgr2=0x7f1410061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f141005f150 0x7f1410061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f14380a4dc0 tx=0x7f1420008040).stop 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 msgr2=0x7f1438144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438144e40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f14380641a0 tx=0x7f1428017000).stop 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 shutdown_connections 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f141005f150 0x7f1410061610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14380c6c00 0x7f14380a8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14380c5340 0x7f1438144e40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 --2- 172.21.15.100:0/2803472459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14380c5720 0x7f1438163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:35.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 >> 172.21.15.100:0/2803472459 conn(0x7f14380c3ca0 msgr2=0x7f14380663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:35.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 shutdown_connections 2024-01-22T05:38:35.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:35.920+0000 7f143d000700 1 -- 172.21.15.100:0/2803472459 wait complete. 2024-01-22T05:38:35.937 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:36.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.122+0000 7f2a6ec00700 1 Processor -- start 2024-01-22T05:38:36.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.122+0000 7f2a6ec00700 1 -- start start 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a6ec00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a680c64b0 0x7f2a68154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a6ec00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 0x7f2a680c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a6ec00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680c1530 con 0x7f2a68154060 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a6ec00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680cbb60 con 0x7f2a680c64b0 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a6ec00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680cb880 con 0x7f2a680aa3f0 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a67400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a680c64b0 0x7f2a68154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a67400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a680c64b0 0x7f2a68154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37334/0 (socket says 172.21.15.100:37334) 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a67400700 1 -- 172.21.15.100:0/810372286 learned_addr learned my addr 172.21.15.100:0/810372286 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.123+0000 7f2a67e00700 1 --1- 172.21.15.100:0/810372286 >> v1:172.21.15.100:6789/0 conn(0x7f2a68154060 0x7f2a680c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38866/0 (socket says 172.21.15.100:38866) 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a67400700 1 -- 172.21.15.100:0/810372286 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 msgr2=0x7f2a680c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a67400700 1 --2- 172.21.15.100:0/810372286 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 0x7f2a680c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a67400700 1 -- 172.21.15.100:0/810372286 >> v1:172.21.15.100:6789/0 conn(0x7f2a68154060 legacy=0x7f2a680c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a67400700 1 -- 172.21.15.100:0/810372286 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680c17d0 con 0x7f2a680c64b0 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a66a00700 1 -- 172.21.15.100:0/810372286 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285742712 0 0) 0x7f2a680c1530 con 0x7f2a68154060 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a67400700 1 --2- 172.21.15.100:0/810372286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a680c64b0 0x7f2a68154440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2a50006fd0 tx=0x7f2a500090f0).ready entity=mon.0 client_cookie=2dd9f9a2cbc14473 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a66a00700 1 -- 172.21.15.100:0/810372286 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000b600 con 0x7f2a680c64b0 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a66a00700 1 -- 172.21.15.100:0/810372286 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000b760 con 0x7f2a680c64b0 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.124+0000 7f2a66a00700 1 -- 172.21.15.100:0/810372286 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000bae0 con 0x7f2a680c64b0 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 -- 172.21.15.100:0/810372286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a680c64b0 msgr2=0x7f2a68154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/810372286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a680c64b0 0x7f2a68154440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2a50006fd0 tx=0x7f2a500090f0).stop 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 -- 172.21.15.100:0/810372286 shutdown_connections 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/810372286 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 0x7f2a680c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/810372286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a680c64b0 0x7f2a68154440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 -- 172.21.15.100:0/810372286 >> 172.21.15.100:0/810372286 conn(0x7f2a6805e9d0 msgr2=0x7f2a680cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 -- 172.21.15.100:0/810372286 shutdown_connections 2024-01-22T05:38:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.125+0000 7f2a6ec00700 1 -- 172.21.15.100:0/810372286 wait complete. 2024-01-22T05:38:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.127+0000 7f2a6ec00700 1 Processor -- start 2024-01-22T05:38:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.127+0000 7f2a6ec00700 1 -- start start 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.128+0000 7f2a6ec00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 0x7f2a68167060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.128+0000 7f2a6ec00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a680c64b0 0x7f2a680aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.128+0000 7f2a6ec00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a68154060 0x7f2a68152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.128+0000 7f2a6ec00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a681644a0 con 0x7f2a68154060 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.128+0000 7f2a6ec00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68164780 con 0x7f2a680c64b0 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.128+0000 7f2a6ec00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68164a60 con 0x7f2a680aa3f0 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a68154060 0x7f2a68152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a68154060 0x7f2a68152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37350/0 (socket says 172.21.15.100:37350) 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 -- 172.21.15.100:0/3136416435 learned_addr learned my addr 172.21.15.100:0/3136416435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a67e00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 0x7f2a68167060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a67400700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a680c64b0 0x7f2a680aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 -- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 msgr2=0x7f2a68167060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 0x7f2a68167060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 -- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a680c64b0 msgr2=0x7f2a680aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a680c64b0 0x7f2a680aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 -- 172.21.15.100:0/3136416435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009370 con 0x7f2a68154060 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.129+0000 7f2a6cc00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a68154060 0x7f2a68152460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f2a6000bb60 tx=0x7f2a60009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.130+0000 7f2a5f400700 1 -- 172.21.15.100:0/3136416435 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000c7e0 con 0x7f2a68154060 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.130+0000 7f2a5f400700 1 -- 172.21.15.100:0/3136416435 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000c960 con 0x7f2a68154060 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.130+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a68164d40 con 0x7f2a68154060 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.130+0000 7f2a5f400700 1 -- 172.21.15.100:0/3136416435 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000cb10 con 0x7f2a68154060 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.130+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a680af570 con 0x7f2a68154060 2024-01-22T05:38:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.131+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6805fdb0 con 0x7f2a68154060 2024-01-22T05:38:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.132+0000 7f2a5f400700 1 -- 172.21.15.100:0/3136416435 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2a60012020 con 0x7f2a68154060 2024-01-22T05:38:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.132+0000 7f2a5f400700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2a4005f150 0x7f2a40061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.132+0000 7f2a5f400700 1 -- 172.21.15.100:0/3136416435 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2a6007a1b0 con 0x7f2a68154060 2024-01-22T05:38:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.133+0000 7f2a67e00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2a4005f150 0x7f2a40061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.133+0000 7f2a67e00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2a4005f150 0x7f2a40061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2a58007fd0 tx=0x7f2a58007d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.136+0000 7f2a5f400700 1 -- 172.21.15.100:0/3136416435 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a6004b3c0 con 0x7f2a68154060 2024-01-22T05:38:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.308+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a6806abb0 con 0x7f2a68154060 2024-01-22T05:38:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.309+0000 7f2a5f400700 1 -- 172.21.15.100:0/3136416435 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f2a6004e9e0 con 0x7f2a68154060 2024-01-22T05:38:36.310 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:36.310 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2a4005f150 msgr2=0x7f2a40061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2a4005f150 0x7f2a40061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2a58007fd0 tx=0x7f2a58007d70).stop 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a68154060 msgr2=0x7f2a68152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a68154060 0x7f2a68152460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f2a6000bb60 tx=0x7f2a60009810).stop 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 shutdown_connections 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2a4005f150 0x7f2a40061610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a68154060 0x7f2a68152460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a680aa3f0 0x7f2a68167060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 --2- 172.21.15.100:0/3136416435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a680c64b0 0x7f2a680aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.311+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 >> 172.21.15.100:0/3136416435 conn(0x7f2a6805e9d0 msgr2=0x7f2a680c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.312+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 shutdown_connections 2024-01-22T05:38:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.312+0000 7f2a6ec00700 1 -- 172.21.15.100:0/3136416435 wait complete. 2024-01-22T05:38:36.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:37:56.837820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:37:57.667310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:38:36.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.515+0000 7f4401600700 1 Processor -- start 2024-01-22T05:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.516+0000 7f4401600700 1 -- start start 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f4401600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43fc157290 0x7f43fc092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f4401600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43fc0c5b80 0x7f43fc0c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f4401600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc065000 con 0x7f43fc092600 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f4401600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc0643f0 con 0x7f43fc0c5b80 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f4401600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc0646d0 con 0x7f43fc157290 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f43fb400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43fc0c5b80 0x7f43fc0c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f43fa000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f43fc092600 0x7f43fc0c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38882/0 (socket says 172.21.15.100:38882) 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f43fa000700 1 -- 172.21.15.100:0/2651945994 learned_addr learned my addr 172.21.15.100:0/2651945994 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.517+0000 7f43faa00700 1 --2- 172.21.15.100:0/2651945994 >> v2:172.21.15.169:3300/0 conn(0x7f43fc157290 0x7f43fc092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43fb400700 1 -- 172.21.15.100:0/2651945994 >> v2:172.21.15.169:3300/0 conn(0x7f43fc157290 msgr2=0x7f43fc092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43fb400700 1 --2- 172.21.15.100:0/2651945994 >> v2:172.21.15.169:3300/0 conn(0x7f43fc157290 0x7f43fc092110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43fb400700 1 -- 172.21.15.100:0/2651945994 >> v1:172.21.15.100:6789/0 conn(0x7f43fc092600 legacy=0x7f43fc0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43fb400700 1 -- 172.21.15.100:0/2651945994 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0649b0 con 0x7f43fc0c5b80 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43f9600700 1 -- 172.21.15.100:0/2651945994 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343659643 0 0) 0x7f43fc065000 con 0x7f43fc092600 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43fb400700 1 --2- 172.21.15.100:0/2651945994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc0c5b80 0x7f43fc0c3240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f43fc069ee0 tx=0x7f43f4009780).ready entity=mon.0 client_cookie=91f868d34f74e8e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43f9600700 1 -- 172.21.15.100:0/2651945994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f400e070 con 0x7f43fc0c5b80 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43f9600700 1 -- 172.21.15.100:0/2651945994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f400bb60 con 0x7f43fc0c5b80 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.518+0000 7f43f9600700 1 -- 172.21.15.100:0/2651945994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4012410 con 0x7f43fc0c5b80 2024-01-22T05:38:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 -- 172.21.15.100:0/2651945994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc0c5b80 msgr2=0x7f43fc0c3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 --2- 172.21.15.100:0/2651945994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc0c5b80 0x7f43fc0c3240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f43fc069ee0 tx=0x7f43f4009780).stop 2024-01-22T05:38:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 -- 172.21.15.100:0/2651945994 shutdown_connections 2024-01-22T05:38:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 --2- 172.21.15.100:0/2651945994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc0c5b80 0x7f43fc0c3240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 --2- 172.21.15.100:0/2651945994 >> v2:172.21.15.169:3300/0 conn(0x7f43fc157290 0x7f43fc092110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 -- 172.21.15.100:0/2651945994 >> 172.21.15.100:0/2651945994 conn(0x7f43fc05e9d0 msgr2=0x7f43fc091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 -- 172.21.15.100:0/2651945994 shutdown_connections 2024-01-22T05:38:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.519+0000 7f4401600700 1 -- 172.21.15.100:0/2651945994 wait complete. 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.520+0000 7f4401600700 1 Processor -- start 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.520+0000 7f4401600700 1 -- start start 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.521+0000 7f4401600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc092600 0x7f43fc155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.521+0000 7f4401600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43fc0c5b80 0x7f43fc092a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.521+0000 7f4401600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43fc157290 0x7f43fc0ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.521+0000 7f4401600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc095dd0 con 0x7f43fc092600 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.521+0000 7f4401600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc093f80 con 0x7f43fc157290 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.521+0000 7f4401600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc093370 con 0x7f43fc0c5b80 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc092600 0x7f43fc155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc092600 0x7f43fc155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37368/0 (socket says 172.21.15.100:37368) 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 -- 172.21.15.100:0/4237804912 learned_addr learned my addr 172.21.15.100:0/4237804912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 -- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43fc0c5b80 msgr2=0x7f43fc092a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43fa000700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43fc0c5b80 0x7f43fc092a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43fb400700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43fc157290 0x7f43fc0ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43fc0c5b80 0x7f43fc092a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 -- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43fc157290 msgr2=0x7f43fc0ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43fc157290 0x7f43fc0ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 -- 172.21.15.100:0/4237804912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4009a20 con 0x7f43fc092600 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43fa000700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43fc0c5b80 0x7f43fc092a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43fb400700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43fc157290 0x7f43fc0ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43faa00700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc092600 0x7f43fc155320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f43ec00e900 tx=0x7f43ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43f2000700 1 -- 172.21.15.100:0/4237804912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00c640 con 0x7f43fc092600 2024-01-22T05:38:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43f2000700 1 -- 172.21.15.100:0/4237804912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec00c7a0 con 0x7f43fc092600 2024-01-22T05:38:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc093650 con 0x7f43fc092600 2024-01-22T05:38:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.522+0000 7f43f2000700 1 -- 172.21.15.100:0/4237804912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00cb20 con 0x7f43fc092600 2024-01-22T05:38:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.523+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc093c10 con 0x7f43fc092600 2024-01-22T05:38:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.524+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc05fdb0 con 0x7f43fc092600 2024-01-22T05:38:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.524+0000 7f43f2000700 1 -- 172.21.15.100:0/4237804912 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f43ec01b400 con 0x7f43fc092600 2024-01-22T05:38:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.525+0000 7f43f2000700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43d405f150 0x7f43d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.525+0000 7f43f2000700 1 -- 172.21.15.100:0/4237804912 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f43ec07a600 con 0x7f43fc092600 2024-01-22T05:38:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.525+0000 7f43fa000700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43d405f150 0x7f43d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.526+0000 7f43fa000700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43d405f150 0x7f43d4061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f43fc096a10 tx=0x7f43e4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.529+0000 7f43f2000700 1 -- 172.21.15.100:0/4237804912 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f43ec04b870 con 0x7f43fc092600 2024-01-22T05:38:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.698+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f43fc064c90 con 0x7f43fc092600 2024-01-22T05:38:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.698+0000 7f43f2000700 1 -- 172.21.15.100:0/4237804912 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f43ec016070 con 0x7f43fc092600 2024-01-22T05:38:36.698 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.700+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43d405f150 msgr2=0x7f43d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.700+0000 7f4401600700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43d405f150 0x7f43d4061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f43fc096a10 tx=0x7f43e4009040).stop 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.700+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc092600 msgr2=0x7f43fc155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.700+0000 7f4401600700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc092600 0x7f43fc155320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f43ec00e900 tx=0x7f43ec009060).stop 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 shutdown_connections 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f43d405f150 0x7f43d4061610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43fc157290 0x7f43fc0ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43fc092600 0x7f43fc155320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 --2- 172.21.15.100:0/4237804912 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43fc0c5b80 0x7f43fc092a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 >> 172.21.15.100:0/4237804912 conn(0x7f43fc05e9d0 msgr2=0x7f43fc0c4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 shutdown_connections 2024-01-22T05:38:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.701+0000 7f4401600700 1 -- 172.21.15.100:0/4237804912 wait complete. 2024-01-22T05:38:36.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:36.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.905+0000 7f300c200700 1 Processor -- start 2024-01-22T05:38:36.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.905+0000 7f300c200700 1 -- start start 2024-01-22T05:38:36.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.906+0000 7f300c200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f300405e900 0x7f30040aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.906+0000 7f300c200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f30040ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.906+0000 7f300c200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040c74b0 con 0x7f30040a9f60 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.906+0000 7f300c200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30040cab90 con 0x7f300405e900 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.906+0000 7f300c200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3004158660 con 0x7f30040c1940 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f300405e900 0x7f30040aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f300405e900 0x7f30040aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37378/0 (socket says 172.21.15.100:37378) 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 -- 172.21.15.100:0/2994763852 learned_addr learned my addr 172.21.15.100:0/2994763852 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3009800700 1 --1- 172.21.15.100:0/2994763852 >> v1:172.21.15.100:6789/0 conn(0x7f30040a9f60 0x7f300405e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38894/0 (socket says 172.21.15.100:38894) 2024-01-22T05:38:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f300a200700 1 --2- 172.21.15.100:0/2994763852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f30040ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 -- 172.21.15.100:0/2994763852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 msgr2=0x7f30040ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 --2- 172.21.15.100:0/2994763852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f30040ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 -- 172.21.15.100:0/2994763852 >> v1:172.21.15.100:6789/0 conn(0x7f30040a9f60 legacy=0x7f300405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 -- 172.21.15.100:0/2994763852 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004158940 con 0x7f300405e900 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.907+0000 7f3008e00700 1 --2- 172.21.15.100:0/2994763852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f300405e900 0x7f30040aa340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2fec006fd0 tx=0x7f2fec0090f0).ready entity=mon.0 client_cookie=64d7519654ff070a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f3003e00700 1 -- 172.21.15.100:0/2994763852 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00b580 con 0x7f300405e900 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f3003e00700 1 -- 172.21.15.100:0/2994763852 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec00b6e0 con 0x7f300405e900 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f3003e00700 1 -- 172.21.15.100:0/2994763852 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00ba60 con 0x7f300405e900 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 -- 172.21.15.100:0/2994763852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f300405e900 msgr2=0x7f30040aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 --2- 172.21.15.100:0/2994763852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f300405e900 0x7f30040aa340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2fec006fd0 tx=0x7f2fec0090f0).stop 2024-01-22T05:38:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 -- 172.21.15.100:0/2994763852 shutdown_connections 2024-01-22T05:38:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 --2- 172.21.15.100:0/2994763852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f30040ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 --2- 172.21.15.100:0/2994763852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f300405e900 0x7f30040aa340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 -- 172.21.15.100:0/2994763852 >> 172.21.15.100:0/2994763852 conn(0x7f30040cada0 msgr2=0x7f30040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 -- 172.21.15.100:0/2994763852 shutdown_connections 2024-01-22T05:38:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.908+0000 7f300c200700 1 -- 172.21.15.100:0/2994763852 wait complete. 2024-01-22T05:38:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.910+0000 7f300c200700 1 Processor -- start 2024-01-22T05:38:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.910+0000 7f300c200700 1 -- start start 2024-01-22T05:38:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300c200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300405e900 0x7f3004156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300c200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30040a9f60 0x7f3004167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300c200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f3004164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300c200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c3860 con 0x7f30040a9f60 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300c200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c2fa0 con 0x7f300405e900 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300c200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c3210 con 0x7f30040c1940 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30040a9f60 0x7f3004167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30040a9f60 0x7f3004167450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37394/0 (socket says 172.21.15.100:37394) 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 -- 172.21.15.100:0/2574432718 learned_addr learned my addr 172.21.15.100:0/2574432718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3009800700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300405e900 0x7f3004156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300a200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f3004164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 -- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 msgr2=0x7f3004164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f3004164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 -- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300405e900 msgr2=0x7f3004156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300405e900 0x7f3004156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3008e00700 1 -- 172.21.15.100:0/2574432718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec009370 con 0x7f30040a9f60 2024-01-22T05:38:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f3009800700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300405e900 0x7f3004156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.911+0000 7f300a200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f3004164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.912+0000 7f3008e00700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30040a9f60 0x7f3004167450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2fec009130 tx=0x7f2fec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.912+0000 7f3000c00700 1 -- 172.21.15.100:0/2574432718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00b850 con 0x7f30040a9f60 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.912+0000 7f3000c00700 1 -- 172.21.15.100:0/2574432718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec00b9b0 con 0x7f30040a9f60 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.912+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30040c34f0 con 0x7f30040a9f60 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.912+0000 7f3000c00700 1 -- 172.21.15.100:0/2574432718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec01b660 con 0x7f30040a9f60 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.912+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3004157380 con 0x7f30040a9f60 2024-01-22T05:38:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.913+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300405fdb0 con 0x7f30040a9f60 2024-01-22T05:38:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.914+0000 7f3000c00700 1 -- 172.21.15.100:0/2574432718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2fec01ba50 con 0x7f30040a9f60 2024-01-22T05:38:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.915+0000 7f3000c00700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2fdc05f150 0x7f2fdc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.916+0000 7f3000c00700 1 -- 172.21.15.100:0/2574432718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2fec07ba80 con 0x7f30040a9f60 2024-01-22T05:38:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.916+0000 7f3009800700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2fdc05f150 0x7f2fdc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.916+0000 7f3009800700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2fdc05f150 0x7f2fdc061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2ff40016b0 tx=0x7f2ff4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:36.919+0000 7f3000c00700 1 -- 172.21.15.100:0/2574432718 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2fec04cc90 con 0x7f30040a9f60 2024-01-22T05:38:37.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.088+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f300406abb0 con 0x7f30040a9f60 2024-01-22T05:38:37.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.089+0000 7f3000c00700 1 -- 172.21.15.100:0/2574432718 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2fec0502b0 con 0x7f30040a9f60 2024-01-22T05:38:37.089 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2fdc05f150 msgr2=0x7f2fdc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2fdc05f150 0x7f2fdc061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2ff40016b0 tx=0x7f2ff4009040).stop 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30040a9f60 msgr2=0x7f3004167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30040a9f60 0x7f3004167450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2fec009130 tx=0x7f2fec017000).stop 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 shutdown_connections 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2fdc05f150 0x7f2fdc061610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300405e900 0x7f3004156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30040c1940 0x7f3004164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 --2- 172.21.15.100:0/2574432718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30040a9f60 0x7f3004167450 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 >> 172.21.15.100:0/2574432718 conn(0x7f30040cada0 msgr2=0x7f300405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 shutdown_connections 2024-01-22T05:38:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.091+0000 7f300c200700 1 -- 172.21.15.100:0/2574432718 wait complete. 2024-01-22T05:38:37.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:38:37.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.296+0000 7ff331000700 1 Processor -- start 2024-01-22T05:38:37.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.296+0000 7ff331000700 1 -- start start 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff331000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff32c157d80 0x7ff32c158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff331000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0c1a40 con 0x7ff32c1586f0 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff331000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0cbd30 con 0x7ff32c154260 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff331000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c158b80 con 0x7ff32c157d80 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff329400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff32c157d80 0x7ff32c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff32a800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff32c1586f0 0x7ff32c0c8c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38906/0 (socket says 172.21.15.100:38906) 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff32a800700 1 -- 172.21.15.100:0/3523395947 learned_addr learned my addr 172.21.15.100:0/3523395947 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:37.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff329400700 1 -- 172.21.15.100:0/3523395947 >> v1:172.21.15.169:6789/0 conn(0x7ff32c154260 legacy=0x7ff32c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff329400700 1 -- 172.21.15.100:0/3523395947 >> v1:172.21.15.100:6789/0 conn(0x7ff32c1586f0 legacy=0x7ff32c0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.298+0000 7ff329400700 1 -- 172.21.15.100:0/3523395947 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0c1110 con 0x7ff32c157d80 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.299+0000 7ff329400700 1 --2- 172.21.15.100:0/3523395947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c158200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7ff314009760 tx=0x7ff314009060).ready entity=mon.0 client_cookie=b791aa261a2f6a78 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.299+0000 7ff328a00700 1 -- 172.21.15.100:0/3523395947 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400b580 con 0x7ff32c157d80 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.299+0000 7ff328a00700 1 -- 172.21.15.100:0/3523395947 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400b6e0 con 0x7ff32c157d80 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.299+0000 7ff328a00700 1 -- 172.21.15.100:0/3523395947 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400ba60 con 0x7ff32c157d80 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.299+0000 7ff331000700 1 -- 172.21.15.100:0/3523395947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 msgr2=0x7ff32c158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.299+0000 7ff331000700 1 --2- 172.21.15.100:0/3523395947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c158200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7ff314009760 tx=0x7ff314009060).stop 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.300+0000 7ff331000700 1 -- 172.21.15.100:0/3523395947 shutdown_connections 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.300+0000 7ff331000700 1 --2- 172.21.15.100:0/3523395947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c158200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.300+0000 7ff331000700 1 -- 172.21.15.100:0/3523395947 >> 172.21.15.100:0/3523395947 conn(0x7ff32c05e9d0 msgr2=0x7ff32c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:37.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.300+0000 7ff331000700 1 -- 172.21.15.100:0/3523395947 shutdown_connections 2024-01-22T05:38:37.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.300+0000 7ff331000700 1 -- 172.21.15.100:0/3523395947 wait complete. 2024-01-22T05:38:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.301+0000 7ff331000700 1 Processor -- start 2024-01-22T05:38:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.301+0000 7ff331000700 1 -- start start 2024-01-22T05:38:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff331000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff32c154260 0x7ff32c0ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff331000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c1689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff331000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff32c1586f0 0x7ff32c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff331000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c157670 con 0x7ff32c157d80 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff331000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c151210 con 0x7ff32c154260 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff331000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c156e60 con 0x7ff32c1586f0 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff329400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c1689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff329400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c1689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37424/0 (socket says 172.21.15.100:37424) 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.302+0000 7ff329400700 1 -- 172.21.15.100:0/1425766066 learned_addr learned my addr 172.21.15.100:0/1425766066 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff329e00700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff32c154260 0x7ff32c0ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff32a800700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff32c1586f0 0x7ff32c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff329400700 1 -- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff32c1586f0 msgr2=0x7ff32c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff329400700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff32c1586f0 0x7ff32c1557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff329400700 1 -- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff32c154260 msgr2=0x7ff32c0ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff329400700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff32c154260 0x7ff32c0ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff329400700 1 -- 172.21.15.100:0/1425766066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140092a0 con 0x7ff32c157d80 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff329400700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c1689e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7ff314009eb0 tx=0x7ff314017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff321600700 1 -- 172.21.15.100:0/1425766066 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400ba60 con 0x7ff32c157d80 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff321600700 1 -- 172.21.15.100:0/1425766066 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314000c90 con 0x7ff32c157d80 2024-01-22T05:38:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff321600700 1 -- 172.21.15.100:0/1425766066 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31401b620 con 0x7ff32c157d80 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c155350 con 0x7ff32c157d80 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.303+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c1570b0 con 0x7ff32c157d80 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.304+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c05fdb0 con 0x7ff32c157d80 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.305+0000 7ff321600700 1 -- 172.21.15.100:0/1425766066 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff31401b9d0 con 0x7ff32c157d80 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.306+0000 7ff321600700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff30405f150 0x7ff304061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.306+0000 7ff321600700 1 -- 172.21.15.100:0/1425766066 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff31407bfd0 con 0x7ff32c157d80 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.306+0000 7ff329e00700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff30405f150 0x7ff304061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.306+0000 7ff329e00700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff30405f150 0x7ff304061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff31c003710 tx=0x7ff31c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:37.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.310+0000 7ff321600700 1 -- 172.21.15.100:0/1425766066 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff31404d1e0 con 0x7ff32c157d80 2024-01-22T05:38:37.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.480+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff32c05f210 con 0x7ff32c157d80 2024-01-22T05:38:37.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.481+0000 7ff321600700 1 -- 172.21.15.100:0/1425766066 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff314028020 con 0x7ff32c157d80 2024-01-22T05:38:37.481 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:37.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff30405f150 msgr2=0x7ff304061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff30405f150 0x7ff304061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff31c003710 tx=0x7ff31c009040).stop 2024-01-22T05:38:37.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 msgr2=0x7ff32c1689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c1689e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7ff314009eb0 tx=0x7ff314017000).stop 2024-01-22T05:38:37.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 shutdown_connections 2024-01-22T05:38:37.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff30405f150 0x7ff304061610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff32c154260 0x7ff32c0ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff32c1586f0 0x7ff32c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 --2- 172.21.15.100:0/1425766066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c157d80 0x7ff32c1689e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 >> 172.21.15.100:0/1425766066 conn(0x7ff32c05e9d0 msgr2=0x7ff32c064640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 shutdown_connections 2024-01-22T05:38:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.483+0000 7ff331000700 1 -- 172.21.15.100:0/1425766066 wait complete. 2024-01-22T05:38:37.500 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:38:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.685+0000 7f07c9c00700 1 Processor -- start 2024-01-22T05:38:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.685+0000 7f07c9c00700 1 -- start start 2024-01-22T05:38:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.686+0000 7f07c9c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f07c40a9f60 0x7f07c40aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.686+0000 7f07c9c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c40c74b0 con 0x7f07c40c1940 2024-01-22T05:38:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.686+0000 7f07c9c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c4158660 con 0x7f07c405e900 2024-01-22T05:38:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.686+0000 7f07c9c00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c4158940 con 0x7f07c40a9f60 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.686+0000 7f07c2000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f07c40c1940 0x7f07c405e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38920/0 (socket says 172.21.15.100:38920) 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.686+0000 7f07c2000700 1 -- 172.21.15.100:0/4131282268 learned_addr learned my addr 172.21.15.100:0/4131282268 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c2a00700 1 --2- 172.21.15.100:0/4131282268 >> v2:172.21.15.169:3300/0 conn(0x7f07c40a9f60 0x7f07c40aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370183323 0 0) 0x7f07c40c74b0 con 0x7f07c40c1940 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a40033f0 con 0x7f07c40c1940 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105481224 0 0) 0x7f07a40033f0 con 0x7f07c40c1940 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 >> v2:172.21.15.169:3300/0 conn(0x7f07c40a9f60 msgr2=0x7f07c40aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 --2- 172.21.15.100:0/4131282268 >> v2:172.21.15.169:3300/0 conn(0x7f07c40a9f60 0x7f07c40aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 >> v1:172.21.15.169:6789/0 conn(0x7f07c405e900 legacy=0x7f07c4098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40c7140 con 0x7f07c40c1940 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f07ac001470 con 0x7f07c40c1940 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 >> v1:172.21.15.100:6789/0 conn(0x7f07c40c1940 legacy=0x7f07c405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07a40038e0 0x7f07a4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a4005000 0x7f07a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c4158940 con 0x7f07a4004690 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a400be00 con 0x7f07a4005000 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.687+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a400bfc0 con 0x7f07a40038e0 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2000700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2a00700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07a40038e0 0x7f07a4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c3400700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a4005000 0x7f07a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2000700 1 -- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07a40038e0 msgr2=0x7f07a4003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2000700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07a40038e0 0x7f07a4003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2000700 1 -- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a4005000 msgr2=0x7f07a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2000700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a4005000 0x7f07a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2000700 1 -- 172.21.15.100:0/4131282268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40033f0 con 0x7f07a4004690 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c3400700 1 -- 172.21.15.100:0/4131282268 reap_dead start 2024-01-22T05:38:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c2000700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07a4004b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f07ac00c110 tx=0x7f07ac001df0).ready entity=mon.0 client_cookie=a139765d02308073 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00ca40 con 0x7f07a4004690 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac00cba0 con 0x7f07a4004690 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.688+0000 7f07c1600700 1 -- 172.21.15.100:0/4131282268 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac0070d0 con 0x7f07a4004690 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.689+0000 7f07c9c00700 1 -- 172.21.15.100:0/4131282268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 msgr2=0x7f07a4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.689+0000 7f07c9c00700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07a4004b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f07ac00c110 tx=0x7f07ac001df0).stop 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.689+0000 7f07c9c00700 1 -- 172.21.15.100:0/4131282268 shutdown_connections 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.689+0000 7f07c9c00700 1 --2- 172.21.15.100:0/4131282268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07a4004b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.689+0000 7f07c9c00700 1 -- 172.21.15.100:0/4131282268 >> 172.21.15.100:0/4131282268 conn(0x7f07c40cada0 msgr2=0x7f07c40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.689+0000 7f07c9c00700 1 -- 172.21.15.100:0/4131282268 shutdown_connections 2024-01-22T05:38:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.689+0000 7f07c9c00700 1 -- 172.21.15.100:0/4131282268 wait complete. 2024-01-22T05:38:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.690+0000 7f07c9c00700 1 Processor -- start 2024-01-22T05:38:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.691+0000 7f07c9c00700 1 -- start start 2024-01-22T05:38:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.691+0000 7f07c9c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07c40c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.691+0000 7f07c9c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4164750 0x7f07c40c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.691+0000 7f07c9c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07c40c3930 0x7f07c41568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.691+0000 7f07c9c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c2d10 con 0x7f07a4004690 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.691+0000 7f07c9c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c4be0 con 0x7f07c4164750 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.691+0000 7f07c9c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c2fb0 con 0x7f07c40c3930 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07c40c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07c40c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37440/0 (socket says 172.21.15.100:37440) 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 -- 172.21.15.100:0/1936021694 learned_addr learned my addr 172.21.15.100:0/1936021694 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2000700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4164750 0x7f07c40c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c3400700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07c40c3930 0x7f07c41568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 -- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07c40c3930 msgr2=0x7f07c41568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07c40c3930 0x7f07c41568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 -- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4164750 msgr2=0x7f07c40c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4164750 0x7f07c40c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 -- 172.21.15.100:0/1936021694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c4164ef0 con 0x7f07a4004690 2024-01-22T05:38:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2000700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4164750 0x7f07c40c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07c2a00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07c40c46f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f07b4011a00 tx=0x7f07b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.692+0000 7f07ba000700 1 -- 172.21.15.100:0/1936021694 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400f940 con 0x7f07a4004690 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.693+0000 7f07ba000700 1 -- 172.21.15.100:0/1936021694 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b400faa0 con 0x7f07a4004690 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.693+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c41651d0 con 0x7f07a4004690 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.693+0000 7f07ba000700 1 -- 172.21.15.100:0/1936021694 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400fe20 con 0x7f07a4004690 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.693+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c4164bd0 con 0x7f07a4004690 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.694+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c41656f0 con 0x7f07a4004690 2024-01-22T05:38:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.694+0000 7f07ba000700 1 -- 172.21.15.100:0/1936021694 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f07b4014650 con 0x7f07a4004690 2024-01-22T05:38:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.695+0000 7f07ba000700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f079c05f150 0x7f079c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.695+0000 7f07ba000700 1 -- 172.21.15.100:0/1936021694 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f07b407ad90 con 0x7f07a4004690 2024-01-22T05:38:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.695+0000 7f07c2000700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f079c05f150 0x7f079c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.696+0000 7f07c2000700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f079c05f150 0x7f079c061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f07c40643c0 tx=0x7f07ac015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.699+0000 7f07ba000700 1 -- 172.21.15.100:0/1936021694 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f07b404bfa0 con 0x7f07a4004690 2024-01-22T05:38:37.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.872+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07c405fdb0 con 0x7f07a4004690 2024-01-22T05:38:37.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.873+0000 7f07ba000700 1 -- 172.21.15.100:0/1936021694 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07b4018070 con 0x7f07a4004690 2024-01-22T05:38:37.873 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.874+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f079c05f150 msgr2=0x7f079c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.874+0000 7f07c9c00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f079c05f150 0x7f079c061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f07c40643c0 tx=0x7f07ac015000).stop 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.874+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 msgr2=0x7f07c40c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.874+0000 7f07c9c00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07c40c46f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f07b4011a00 tx=0x7f07b4009060).stop 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 shutdown_connections 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f079c05f150 0x7f079c061610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07c40c3930 0x7f07c41568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a4004690 0x7f07c40c46f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 --2- 172.21.15.100:0/1936021694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4164750 0x7f07c40c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 >> 172.21.15.100:0/1936021694 conn(0x7f07c40cada0 msgr2=0x7f07c40af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 shutdown_connections 2024-01-22T05:38:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:37.875+0000 7f07c9c00700 1 -- 172.21.15.100:0/1936021694 wait complete. 2024-01-22T05:38:37.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:38.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.077+0000 7f5d18c00700 1 Processor -- start 2024-01-22T05:38:38.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.077+0000 7f5d18c00700 1 -- start start 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d18c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d141543d0 0x7f5d140a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d18c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d140aa220 0x7f5d140c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d18c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d140c66e0 con 0x7f5d14153ff0 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d18c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d140c0750 con 0x7f5d140aa220 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d18c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140aa6b0 con 0x7f5d141543d0 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d12800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d140aa220 0x7f5d140c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d12800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d140aa220 0x7f5d140c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37446/0 (socket says 172.21.15.100:37446) 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d12800700 1 -- 172.21.15.100:0/4047045086 learned_addr learned my addr 172.21.15.100:0/4047045086 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d11400700 1 --2- 172.21.15.100:0/4047045086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d141543d0 0x7f5d140a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d12800700 1 -- 172.21.15.100:0/4047045086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d141543d0 msgr2=0x7f5d140a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d12800700 1 --2- 172.21.15.100:0/4047045086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d141543d0 0x7f5d140a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d12800700 1 -- 172.21.15.100:0/4047045086 >> v1:172.21.15.169:6789/0 conn(0x7f5d14153ff0 legacy=0x7f5d140c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.079+0000 7f5d12800700 1 -- 172.21.15.100:0/4047045086 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d140bfe20 con 0x7f5d140aa220 2024-01-22T05:38:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d12800700 1 --2- 172.21.15.100:0/4047045086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d140c0be0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f5d0c009f20 tx=0x7f5d0c009840).ready entity=mon.0 client_cookie=675f6c44b5fe0b94 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d10a00700 1 -- 172.21.15.100:0/4047045086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00e070 con 0x7f5d140aa220 2024-01-22T05:38:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d10a00700 1 -- 172.21.15.100:0/4047045086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c00ba40 con 0x7f5d140aa220 2024-01-22T05:38:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d10a00700 1 -- 172.21.15.100:0/4047045086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00bdc0 con 0x7f5d140aa220 2024-01-22T05:38:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d18c00700 1 -- 172.21.15.100:0/4047045086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 msgr2=0x7f5d140c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d18c00700 1 --2- 172.21.15.100:0/4047045086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d140c0be0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f5d0c009f20 tx=0x7f5d0c009840).stop 2024-01-22T05:38:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d18c00700 1 -- 172.21.15.100:0/4047045086 shutdown_connections 2024-01-22T05:38:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d18c00700 1 --2- 172.21.15.100:0/4047045086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d140c0be0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d18c00700 1 --2- 172.21.15.100:0/4047045086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d141543d0 0x7f5d140a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.080+0000 7f5d18c00700 1 -- 172.21.15.100:0/4047045086 >> 172.21.15.100:0/4047045086 conn(0x7f5d140c82a0 msgr2=0x7f5d1405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.081+0000 7f5d18c00700 1 -- 172.21.15.100:0/4047045086 shutdown_connections 2024-01-22T05:38:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.081+0000 7f5d18c00700 1 -- 172.21.15.100:0/4047045086 wait complete. 2024-01-22T05:38:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.082+0000 7f5d18c00700 1 Processor -- start 2024-01-22T05:38:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.082+0000 7f5d18c00700 1 -- start start 2024-01-22T05:38:38.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d18c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d14154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d18c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d14153ff0 0x7f5d140c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d18c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d141543d0 0x7f5d14156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d18c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14154d20 con 0x7f5d140aa220 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d18c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d141686d0 con 0x7f5d141543d0 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d18c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14155680 con 0x7f5d14153ff0 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d11e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d14154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d11e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d14154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37454/0 (socket says 172.21.15.100:37454) 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d11e00700 1 -- 172.21.15.100:0/262926460 learned_addr learned my addr 172.21.15.100:0/262926460 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d11400700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d14153ff0 0x7f5d140c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.083+0000 7f5d12800700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d141543d0 0x7f5d14156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d11e00700 1 -- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d14153ff0 msgr2=0x7f5d140c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d11e00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d14153ff0 0x7f5d140c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d11e00700 1 -- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d141543d0 msgr2=0x7f5d14156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d11e00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d141543d0 0x7f5d14156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d11e00700 1 -- 172.21.15.100:0/262926460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c009ae0 con 0x7f5d140aa220 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d11e00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d14154830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5d0400c440 tx=0x7f5d04007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d09600700 1 -- 172.21.15.100:0/262926460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04012400 con 0x7f5d140aa220 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d09600700 1 -- 172.21.15.100:0/262926460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d04012580 con 0x7f5d140aa220 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d14167da0 con 0x7f5d140aa220 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d09600700 1 -- 172.21.15.100:0/262926460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04012940 con 0x7f5d140aa220 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.084+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d14168360 con 0x7f5d140aa220 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.085+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1405fdb0 con 0x7f5d140aa220 2024-01-22T05:38:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.086+0000 7f5d09600700 1 -- 172.21.15.100:0/262926460 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5d04012d30 con 0x7f5d140aa220 2024-01-22T05:38:38.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.087+0000 7f5d09600700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5cec05f150 0x7f5cec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.087+0000 7f5d09600700 1 -- 172.21.15.100:0/262926460 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5d04079670 con 0x7f5d140aa220 2024-01-22T05:38:38.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.087+0000 7f5d11400700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5cec05f150 0x7f5cec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.088+0000 7f5d11400700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5cec05f150 0x7f5cec061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5d140c4e30 tx=0x7f5cfc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.091+0000 7f5d09600700 1 -- 172.21.15.100:0/262926460 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5d04048b00 con 0x7f5d140aa220 2024-01-22T05:38:38.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.268+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d140c0100 con 0x7f5d140aa220 2024-01-22T05:38:38.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.269+0000 7f5d09600700 1 -- 172.21.15.100:0/262926460 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f5d0404a930 con 0x7f5d140aa220 2024-01-22T05:38:38.269 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:38.269 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5cec05f150 msgr2=0x7f5cec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5cec05f150 0x7f5cec061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5d140c4e30 tx=0x7f5cfc008040).stop 2024-01-22T05:38:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 msgr2=0x7f5d14154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d14154830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5d0400c440 tx=0x7f5d04007de0).stop 2024-01-22T05:38:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 shutdown_connections 2024-01-22T05:38:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5cec05f150 0x7f5cec061610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d141543d0 0x7f5d14156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d140aa220 0x7f5d14154830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 --2- 172.21.15.100:0/262926460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d14153ff0 0x7f5d140c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 >> 172.21.15.100:0/262926460 conn(0x7f5d140c82a0 msgr2=0x7f5d14064550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 shutdown_connections 2024-01-22T05:38:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.271+0000 7f5d18c00700 1 -- 172.21.15.100:0/262926460 wait complete. 2024-01-22T05:38:38.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:37:56.837820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:37:57.667310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:38:38.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.475+0000 7ff5d5800700 1 Processor -- start 2024-01-22T05:38:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.475+0000 7ff5d5800700 1 -- start start 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5d5800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 0x7ff5d00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5d5800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff5d00c5c80 0x7ff5d00c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5d5800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00c1a40 con 0x7ff5d00c65f0 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5d5800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d00cbd30 con 0x7ff5d00c5c80 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5d5800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00c6aa0 con 0x7ff5d0154260 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5cf400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff5d00c65f0 0x7ff5d0157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38932/0 (socket says 172.21.15.100:38932) 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5cf400700 1 -- 172.21.15.100:0/1680841709 learned_addr learned my addr 172.21.15.100:0/1680841709 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5cea00700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 0x7ff5d00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292955755 0 0) 0x7ff5d00c1a40 con 0x7ff5d00c65f0 2024-01-22T05:38:38.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5ce000700 1 --2- 172.21.15.100:0/1680841709 >> v2:172.21.15.169:3300/0 conn(0x7ff5d00c5c80 0x7ff5d00c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.477+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b00033f0 con 0x7ff5d00c65f0 2024-01-22T05:38:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286587701 0 0) 0x7ff5b00033f0 con 0x7ff5d00c65f0 2024-01-22T05:38:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 msgr2=0x7ff5d00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 0x7ff5d00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 >> v2:172.21.15.169:3300/0 conn(0x7ff5d00c5c80 msgr2=0x7ff5d00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 --2- 172.21.15.100:0/1680841709 >> v2:172.21.15.169:3300/0 conn(0x7ff5d00c5c80 0x7ff5d00c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00c1110 con 0x7ff5d00c65f0 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7ff5c80017f0 con 0x7ff5d00c65f0 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 >> v1:172.21.15.100:6789/0 conn(0x7ff5d00c65f0 legacy=0x7ff5d0157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 0x7ff5b00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b0003e10 0x7ff5b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00cbd30 con 0x7ff5b0004b80 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00c6aa0 con 0x7ff5b0003e10 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b000b8e0 con 0x7ff5d0154260 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cf400700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cea00700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 0x7ff5b00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5ce000700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b0003e10 0x7ff5b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cf400700 1 -- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 msgr2=0x7ff5b00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cf400700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 0x7ff5b00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cf400700 1 -- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b0003e10 msgr2=0x7ff5b0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.478+0000 7ff5cf400700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b0003e10 0x7ff5b0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5cf400700 1 -- 172.21.15.100:0/1680841709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00033f0 con 0x7ff5b0004b80 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5ce000700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b0003e10 0x7ff5b0004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5cea00700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0154260 0x7ff5b00038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5cf400700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5b0005000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7ff5c800c4b0 tx=0x7ff5c800c7c0).ready entity=mon.0 client_cookie=1ab132cae436ecb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8002030 con 0x7ff5b0004b80 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800ce10 con 0x7ff5b0004b80 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5cd600700 1 -- 172.21.15.100:0/1680841709 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8005d30 con 0x7ff5b0004b80 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5d5800700 1 -- 172.21.15.100:0/1680841709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 msgr2=0x7ff5b0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5d5800700 1 --2- 172.21.15.100:0/1680841709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5b0005000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7ff5c800c4b0 tx=0x7ff5c800c7c0).stop 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5cf400700 1 -- 172.21.15.100:0/1680841709 reap_dead start 2024-01-22T05:38:38.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5d5800700 1 -- 172.21.15.100:0/1680841709 shutdown_connections 2024-01-22T05:38:38.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.479+0000 7ff5d5800700 1 -- 172.21.15.100:0/1680841709 >> 172.21.15.100:0/1680841709 conn(0x7ff5d005e9d0 msgr2=0x7ff5d00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:38.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.480+0000 7ff5d5800700 1 -- 172.21.15.100:0/1680841709 shutdown_connections 2024-01-22T05:38:38.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.480+0000 7ff5d5800700 1 -- 172.21.15.100:0/1680841709 wait complete. 2024-01-22T05:38:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.481+0000 7ff5d5800700 1 Processor -- start 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.481+0000 7ff5d5800700 1 -- start start 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5d5800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5d0156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5d5800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0159660 0x7ff5d0156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5d5800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d0150de0 0x7ff5d0151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5d5800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d014f360 con 0x7ff5b0004b80 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5d5800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0151730 con 0x7ff5d0150de0 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5d5800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d014b0f0 con 0x7ff5d0159660 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5cea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5d0156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5cea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5d0156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37482/0 (socket says 172.21.15.100:37482) 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.482+0000 7ff5cea00700 1 -- 172.21.15.100:0/799589615 learned_addr learned my addr 172.21.15.100:0/799589615 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5ce000700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0159660 0x7ff5d0156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5cf400700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d0150de0 0x7ff5d0151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5cea00700 1 -- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0159660 msgr2=0x7ff5d0156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5cea00700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0159660 0x7ff5d0156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5cea00700 1 -- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d0150de0 msgr2=0x7ff5d0151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5cea00700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d0150de0 0x7ff5d0151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5cea00700 1 -- 172.21.15.100:0/799589615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0157590 con 0x7ff5b0004b80 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5cea00700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5d0156a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7ff5c0011b10 tx=0x7ff5c0006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5c6000700 1 -- 172.21.15.100:0/799589615 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000f940 con 0x7ff5b0004b80 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5c6000700 1 -- 172.21.15.100:0/799589615 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000faa0 con 0x7ff5b0004b80 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d014ea30 con 0x7ff5b0004b80 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5c6000700 1 -- 172.21.15.100:0/799589615 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000fe60 con 0x7ff5b0004b80 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.483+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d014eff0 con 0x7ff5b0004b80 2024-01-22T05:38:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.484+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d014f640 con 0x7ff5b0004b80 2024-01-22T05:38:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.485+0000 7ff5c6000700 1 -- 172.21.15.100:0/799589615 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff5c0014650 con 0x7ff5b0004b80 2024-01-22T05:38:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.486+0000 7ff5c6000700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5a805f150 0x7ff5a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.486+0000 7ff5c6000700 1 -- 172.21.15.100:0/799589615 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff5c007ab40 con 0x7ff5b0004b80 2024-01-22T05:38:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.486+0000 7ff5ce000700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5a805f150 0x7ff5a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.487+0000 7ff5ce000700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5a805f150 0x7ff5a8061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff5d00b09e0 tx=0x7ff5b8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.490+0000 7ff5c6000700 1 -- 172.21.15.100:0/799589615 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5c004be10 con 0x7ff5b0004b80 2024-01-22T05:38:38.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.661+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff5d005fdb0 con 0x7ff5b0004b80 2024-01-22T05:38:38.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.661+0000 7ff5c6000700 1 -- 172.21.15.100:0/799589615 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff5c0022030 con 0x7ff5b0004b80 2024-01-22T05:38:38.662 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5a805f150 msgr2=0x7ff5a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5a805f150 0x7ff5a8061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff5d00b09e0 tx=0x7ff5b8008040).stop 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 msgr2=0x7ff5d0156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5d0156a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7ff5c0011b10 tx=0x7ff5c0006f40).stop 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 shutdown_connections 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5a805f150 0x7ff5a8061610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d0150de0 0x7ff5d0151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b0004b80 0x7ff5d0156a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 --2- 172.21.15.100:0/799589615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5d0159660 0x7ff5d0156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 >> 172.21.15.100:0/799589615 conn(0x7ff5d005e9d0 msgr2=0x7ff5d00c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 shutdown_connections 2024-01-22T05:38:38.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.663+0000 7ff5d5800700 1 -- 172.21.15.100:0/799589615 wait complete. 2024-01-22T05:38:38.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:38.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.869+0000 7fd6f3c00700 1 Processor -- start 2024-01-22T05:38:38.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.869+0000 7fd6f3c00700 1 -- start start 2024-01-22T05:38:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.870+0000 7fd6f3c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6ec138440 0x7fd6ec0681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.870+0000 7fd6f3c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd6ec138820 0x7fd6ec0686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.870+0000 7fd6f3c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec064520 con 0x7fd6ec0c5120 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.870+0000 7fd6f3c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec064e30 con 0x7fd6ec138440 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.870+0000 7fd6f3c00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec068bc0 con 0x7fd6ec138820 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6ec138440 0x7fd6ec0681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd6ec0c5120 0x7fd6ec0c5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38944/0 (socket says 172.21.15.100:38944) 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1c00700 1 -- 172.21.15.100:0/3391053775 learned_addr learned my addr 172.21.15.100:0/3391053775 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6ebe00700 1 --2- 172.21.15.100:0/3391053775 >> v2:172.21.15.169:3300/0 conn(0x7fd6ec138820 0x7fd6ec0686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1200700 1 -- 172.21.15.100:0/3391053775 >> v2:172.21.15.169:3300/0 conn(0x7fd6ec138820 msgr2=0x7fd6ec0686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1200700 1 --2- 172.21.15.100:0/3391053775 >> v2:172.21.15.169:3300/0 conn(0x7fd6ec138820 0x7fd6ec0686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1200700 1 -- 172.21.15.100:0/3391053775 >> v1:172.21.15.100:6789/0 conn(0x7fd6ec0c5120 legacy=0x7fd6ec0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1200700 1 -- 172.21.15.100:0/3391053775 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0c5e50 con 0x7fd6ec138440 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6eb400700 1 -- 172.21.15.100:0/3391053775 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288681274 0 0) 0x7fd6ec064520 con 0x7fd6ec0c5120 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.871+0000 7fd6f1200700 1 --2- 172.21.15.100:0/3391053775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0681e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fd6ec0a5fb0 tx=0x7fd6dc009060).ready entity=mon.0 client_cookie=a0b934c83b8e4bdd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6eb400700 1 -- 172.21.15.100:0/3391053775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0090d0 con 0x7fd6ec138440 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6eb400700 1 -- 172.21.15.100:0/3391053775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00f510 con 0x7fd6ec138440 2024-01-22T05:38:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6eb400700 1 -- 172.21.15.100:0/3391053775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00f890 con 0x7fd6ec138440 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 -- 172.21.15.100:0/3391053775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 msgr2=0x7fd6ec0681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/3391053775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0681e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fd6ec0a5fb0 tx=0x7fd6dc009060).stop 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 -- 172.21.15.100:0/3391053775 shutdown_connections 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/3391053775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0681e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/3391053775 >> v2:172.21.15.169:3300/0 conn(0x7fd6ec138820 0x7fd6ec0686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 -- 172.21.15.100:0/3391053775 >> 172.21.15.100:0/3391053775 conn(0x7fd6ec0630c0 msgr2=0x7fd6ec0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 -- 172.21.15.100:0/3391053775 shutdown_connections 2024-01-22T05:38:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.872+0000 7fd6f3c00700 1 -- 172.21.15.100:0/3391053775 wait complete. 2024-01-22T05:38:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.874+0000 7fd6f3c00700 1 Processor -- start 2024-01-22T05:38:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.874+0000 7fd6f3c00700 1 -- start start 2024-01-22T05:38:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f3c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec0c5120 0x7fd6ec137600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f3c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f3c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ec138820 0x7fd6ec0c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f3c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0c3030 con 0x7fd6ec138440 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f3c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0a7f60 con 0x7fd6ec0c5120 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f3c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0a7350 con 0x7fd6ec138820 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37494/0 (socket says 172.21.15.100:37494) 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 -- 172.21.15.100:0/1944501091 learned_addr learned my addr 172.21.15.100:0/1944501091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f1200700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec0c5120 0x7fd6ec137600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f1c00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ec138820 0x7fd6ec0c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 -- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ec138820 msgr2=0x7fd6ec0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ec138820 0x7fd6ec0c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 -- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec0c5120 msgr2=0x7fd6ec137600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec0c5120 0x7fd6ec137600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6ebe00700 1 -- 172.21.15.100:0/1944501091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0092a0 con 0x7fd6ec138440 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.875+0000 7fd6f1200700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec0c5120 0x7fd6ec137600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.876+0000 7fd6ebe00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0c2650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd6d400e930 tx=0x7fd6d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.876+0000 7fd6e3e00700 1 -- 172.21.15.100:0/1944501091 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400c640 con 0x7fd6ec138440 2024-01-22T05:38:38.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.876+0000 7fd6e3e00700 1 -- 172.21.15.100:0/1944501091 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400c7a0 con 0x7fd6ec138440 2024-01-22T05:38:38.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.876+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec0a7630 con 0x7fd6ec138440 2024-01-22T05:38:38.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.876+0000 7fd6e3e00700 1 -- 172.21.15.100:0/1944501091 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400cb20 con 0x7fd6ec138440 2024-01-22T05:38:38.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.876+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec0a7bf0 con 0x7fd6ec138440 2024-01-22T05:38:38.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.877+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec0a80f0 con 0x7fd6ec138440 2024-01-22T05:38:38.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.878+0000 7fd6e3e00700 1 -- 172.21.15.100:0/1944501091 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd6d401b400 con 0x7fd6ec138440 2024-01-22T05:38:38.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.879+0000 7fd6e3e00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd6c405f150 0x7fd6c4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:38.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.879+0000 7fd6e3e00700 1 -- 172.21.15.100:0/1944501091 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd6d407a6b0 con 0x7fd6ec138440 2024-01-22T05:38:38.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.879+0000 7fd6f1200700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd6c405f150 0x7fd6c4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:38.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.879+0000 7fd6f1200700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd6c405f150 0x7fd6c4061610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd6dc006f30 tx=0x7fd6dc017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:38.883+0000 7fd6e3e00700 1 -- 172.21.15.100:0/1944501091 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd6d404b860 con 0x7fd6ec138440 2024-01-22T05:38:39.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.053+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6ec05fdb0 con 0x7fd6ec138440 2024-01-22T05:38:39.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.053+0000 7fd6e3e00700 1 -- 172.21.15.100:0/1944501091 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6d4016070 con 0x7fd6ec138440 2024-01-22T05:38:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.055+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd6c405f150 msgr2=0x7fd6c4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.055+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd6c405f150 0x7fd6c4061610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd6dc006f30 tx=0x7fd6dc017000).stop 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.055+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 msgr2=0x7fd6ec0c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.055+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0c2650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd6d400e930 tx=0x7fd6d4009060).stop 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 shutdown_connections 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd6c405f150 0x7fd6c4061610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ec0c5120 0x7fd6ec137600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ec138820 0x7fd6ec0c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 --2- 172.21.15.100:0/1944501091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6ec138440 0x7fd6ec0c2650 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 >> 172.21.15.100:0/1944501091 conn(0x7fd6ec0630c0 msgr2=0x7fd6ec1517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:39.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 shutdown_connections 2024-01-22T05:38:39.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.056+0000 7fd6f3c00700 1 -- 172.21.15.100:0/1944501091 wait complete. 2024-01-22T05:38:39.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:38:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.261+0000 7f375ee00700 1 Processor -- start 2024-01-22T05:38:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.261+0000 7f375ee00700 1 -- start start 2024-01-22T05:38:39.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.262+0000 7f375ee00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3758154040 0x7f37580c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.262+0000 7f375ee00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154420 0x7f37580c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.262+0000 7f375ee00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3758064830 con 0x7f37580bbd80 2024-01-22T05:38:39.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.262+0000 7f375ee00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580c1e00 con 0x7f3758154040 2024-01-22T05:38:39.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.262+0000 7f375ee00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3758064b10 con 0x7f3758154420 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154420 0x7f37580c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154420 0x7f37580c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:38436/0 (socket says 172.21.15.100:38436) 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757400700 1 -- 172.21.15.100:0/3203990648 learned_addr learned my addr 172.21.15.100:0/3203990648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757e00700 1 --2- 172.21.15.100:0/3203990648 >> v2:172.21.15.169:3300/0 conn(0x7f3758154040 0x7f37580c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757400700 1 -- 172.21.15.100:0/3203990648 >> v2:172.21.15.169:3300/0 conn(0x7f3758154040 msgr2=0x7f37580c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757400700 1 --2- 172.21.15.100:0/3203990648 >> v2:172.21.15.169:3300/0 conn(0x7f3758154040 0x7f37580c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3756a00700 1 -- 172.21.15.100:0/3203990648 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201265143 0 0) 0x7f3758064830 con 0x7f37580bbd80 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757400700 1 -- 172.21.15.100:0/3203990648 >> v1:172.21.15.169:6789/0 conn(0x7f37580bbd80 legacy=0x7f3758157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.263+0000 7f3757400700 1 -- 172.21.15.100:0/3203990648 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37580bd010 con 0x7f3758154420 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f3757400700 1 --2- 172.21.15.100:0/3203990648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154420 0x7f37580c1910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3740006fd0 tx=0x7f37400090f0).ready entity=mon.2 client_cookie=a75d1e0d074d8c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f3756a00700 1 -- 172.21.15.100:0/3203990648 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000b580 con 0x7f3758154420 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f3756a00700 1 -- 172.21.15.100:0/3203990648 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374000b6e0 con 0x7f3758154420 2024-01-22T05:38:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f3756a00700 1 -- 172.21.15.100:0/3203990648 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000ba60 con 0x7f3758154420 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f375ee00700 1 -- 172.21.15.100:0/3203990648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154420 msgr2=0x7f37580c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f375ee00700 1 --2- 172.21.15.100:0/3203990648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154420 0x7f37580c1910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3740006fd0 tx=0x7f37400090f0).stop 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f375ee00700 1 -- 172.21.15.100:0/3203990648 shutdown_connections 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f375ee00700 1 --2- 172.21.15.100:0/3203990648 >> v2:172.21.15.169:3300/0 conn(0x7f3758154040 0x7f37580c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f375ee00700 1 --2- 172.21.15.100:0/3203990648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154420 0x7f37580c1910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f375ee00700 1 -- 172.21.15.100:0/3203990648 >> 172.21.15.100:0/3203990648 conn(0x7f37580c6e20 msgr2=0x7f37580c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.264+0000 7f375ee00700 1 -- 172.21.15.100:0/3203990648 shutdown_connections 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.265+0000 7f375ee00700 1 -- 172.21.15.100:0/3203990648 wait complete. 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.266+0000 7f375ee00700 1 Processor -- start 2024-01-22T05:38:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.266+0000 7f375ee00700 1 -- start start 2024-01-22T05:38:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f375ee00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37580bbd80 0x7f3758152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f375ee00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154040 0x7f3758154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f375ee00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3758154420 0x7f37581562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f375ee00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758155dc0 con 0x7f37580bbd80 2024-01-22T05:38:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f375ee00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37581551b0 con 0x7f3758154420 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f375ee00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3758155490 con 0x7f3758154040 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f3757e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37580bbd80 0x7f3758152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f3757e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37580bbd80 0x7f3758152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37510/0 (socket says 172.21.15.100:37510) 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f3757e00700 1 -- 172.21.15.100:0/2820588310 learned_addr learned my addr 172.21.15.100:0/2820588310 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.267+0000 7f3757400700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154040 0x7f3758154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f375ce00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3758154420 0x7f37581562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f3757e00700 1 -- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154040 msgr2=0x7f3758154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f3757e00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154040 0x7f3758154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f3757e00700 1 -- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3758154420 msgr2=0x7f37581562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f3757e00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3758154420 0x7f37581562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f3757e00700 1 -- 172.21.15.100:0/2820588310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009370 con 0x7f37580bbd80 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f3757e00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37580bbd80 0x7f3758152ac0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f374800e930 tx=0x7f3748009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f374f400700 1 -- 172.21.15.100:0/2820588310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800c670 con 0x7f37580bbd80 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f374f400700 1 -- 172.21.15.100:0/2820588310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374800c7d0 con 0x7f37580bbd80 2024-01-22T05:38:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3758155770 con 0x7f37580bbd80 2024-01-22T05:38:39.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f374f400700 1 -- 172.21.15.100:0/2820588310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800cb50 con 0x7f37580bbd80 2024-01-22T05:38:39.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.268+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3758152fb0 con 0x7f37580bbd80 2024-01-22T05:38:39.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.269+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375805fdb0 con 0x7f37580bbd80 2024-01-22T05:38:39.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.270+0000 7f374f400700 1 -- 172.21.15.100:0/2820588310 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f374801b400 con 0x7f37580bbd80 2024-01-22T05:38:39.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.271+0000 7f374f400700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f373005f150 0x7f3730061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.271+0000 7f374f400700 1 -- 172.21.15.100:0/2820588310 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f374807a670 con 0x7f37580bbd80 2024-01-22T05:38:39.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.271+0000 7f3757400700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f373005f150 0x7f3730061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.271+0000 7f3757400700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f373005f150 0x7f3730061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3740009130 tx=0x7f3740017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:39.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.275+0000 7f374f400700 1 -- 172.21.15.100:0/2820588310 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f374804b8e0 con 0x7f37580bbd80 2024-01-22T05:38:39.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.445+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37581560a0 con 0x7f37580bbd80 2024-01-22T05:38:39.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.445+0000 7f374f400700 1 -- 172.21.15.100:0/2820588310 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f374804ef00 con 0x7f37580bbd80 2024-01-22T05:38:39.445 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f373005f150 msgr2=0x7f3730061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f373005f150 0x7f3730061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3740009130 tx=0x7f3740017000).stop 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37580bbd80 msgr2=0x7f3758152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37580bbd80 0x7f3758152ac0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f374800e930 tx=0x7f3748009060).stop 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 shutdown_connections 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f373005f150 0x7f3730061610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3758154420 0x7f37581562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37580bbd80 0x7f3758152ac0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 --2- 172.21.15.100:0/2820588310 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3758154040 0x7f3758154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.447+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 >> 172.21.15.100:0/2820588310 conn(0x7f37580c6e20 msgr2=0x7f37580a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.448+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 shutdown_connections 2024-01-22T05:38:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.448+0000 7f375ee00700 1 -- 172.21.15.100:0/2820588310 wait complete. 2024-01-22T05:38:39.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:38:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.652+0000 7f6a2c200700 1 Processor -- start 2024-01-22T05:38:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.652+0000 7f6a2c200700 1 -- start start 2024-01-22T05:38:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.653+0000 7f6a2c200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 0x7f6a240cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.653+0000 7f6a2c200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6a240c5c80 0x7f6a240c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.653+0000 7f6a2c200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a240c1a40 con 0x7f6a240c65f0 2024-01-22T05:38:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.653+0000 7f6a2c200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a240cbd30 con 0x7f6a240c5c80 2024-01-22T05:38:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.653+0000 7f6a2c200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240c6aa0 con 0x7f6a24154260 2024-01-22T05:38:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a2a200700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6a240c65f0 0x7f6a24157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38950/0 (socket says 172.21.15.100:38950) 2024-01-22T05:38:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a2a200700 1 -- 172.21.15.100:0/19949630 learned_addr learned my addr 172.21.15.100:0/19949630 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a29800700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 0x7f6a240cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399051163 0 0) 0x7f6a240c1a40 con 0x7f6a240c65f0 2024-01-22T05:38:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a040033f0 con 0x7f6a240c65f0 2024-01-22T05:38:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a28e00700 1 --2- 172.21.15.100:0/19949630 >> v2:172.21.15.169:3300/0 conn(0x7f6a240c5c80 0x7f6a240c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057527521 0 0) 0x7f6a040033f0 con 0x7f6a240c65f0 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 msgr2=0x7f6a240cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 0x7f6a240cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 >> v2:172.21.15.169:3300/0 conn(0x7f6a240c5c80 msgr2=0x7f6a240c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 --2- 172.21.15.100:0/19949630 >> v2:172.21.15.169:3300/0 conn(0x7f6a240c5c80 0x7f6a240c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240c1110 con 0x7f6a240c65f0 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f6a1c0017f0 con 0x7f6a240c65f0 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 >> v1:172.21.15.100:6789/0 conn(0x7f6a240c65f0 legacy=0x7f6a24157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a040038e0 0x7f6a04003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 0x7f6a04004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a04005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240cbd30 con 0x7f6a04004b80 2024-01-22T05:38:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240c6aa0 con 0x7f6a040038e0 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.654+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0400b8e0 con 0x7f6a24154260 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a2a200700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a04005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a28e00700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 0x7f6a04004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a29800700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a040038e0 0x7f6a04003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a2a200700 1 -- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 msgr2=0x7f6a04004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a2a200700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24154260 0x7f6a04004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a2a200700 1 -- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a040038e0 msgr2=0x7f6a04003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a2a200700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a040038e0 0x7f6a04003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a2a200700 1 -- 172.21.15.100:0/19949630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040033f0 con 0x7f6a04004b80 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a2a200700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a04005000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f6a1c00c480 tx=0x7f6a1c00c790).ready entity=mon.0 client_cookie=51d06d6dce404651 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.655+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c002030 con 0x7f6a04004b80 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00ce20 con 0x7f6a04004b80 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a23e00700 1 -- 172.21.15.100:0/19949630 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c005d70 con 0x7f6a04004b80 2024-01-22T05:38:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a2c200700 1 -- 172.21.15.100:0/19949630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 msgr2=0x7f6a04005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a2c200700 1 --2- 172.21.15.100:0/19949630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a04005000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f6a1c00c480 tx=0x7f6a1c00c790).stop 2024-01-22T05:38:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a2a200700 1 -- 172.21.15.100:0/19949630 reap_dead start 2024-01-22T05:38:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a2c200700 1 -- 172.21.15.100:0/19949630 shutdown_connections 2024-01-22T05:38:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a2c200700 1 -- 172.21.15.100:0/19949630 >> 172.21.15.100:0/19949630 conn(0x7f6a2405e9d0 msgr2=0x7f6a240cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a2c200700 1 -- 172.21.15.100:0/19949630 shutdown_connections 2024-01-22T05:38:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.656+0000 7f6a2c200700 1 -- 172.21.15.100:0/19949630 wait complete. 2024-01-22T05:38:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.658+0000 7f6a2c200700 1 Processor -- start 2024-01-22T05:38:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.658+0000 7f6a2c200700 1 -- start start 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a2c200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a240c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a2c200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24152380 0x7f6a240aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a2c200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a240af170 0x7f6a240b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a2c200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240ae0c0 con 0x7f6a04004b80 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a2c200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240c4430 con 0x7f6a240af170 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a2c200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240c4db0 con 0x7f6a24152380 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a240c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a240c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37528/0 (socket says 172.21.15.100:37528) 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 -- 172.21.15.100:0/1285609870 learned_addr learned my addr 172.21.15.100:0/1285609870 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a28e00700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24152380 0x7f6a240aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 -- 172.21.15.100:0/1285609870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24152380 msgr2=0x7f6a240aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24152380 0x7f6a240aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 -- 172.21.15.100:0/1285609870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a240af170 msgr2=0x7f6a240b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a240af170 0x7f6a240b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.659+0000 7f6a29800700 1 -- 172.21.15.100:0/1285609870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240c3820 con 0x7f6a04004b80 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.660+0000 7f6a29800700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a240c48c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f6a14011a20 tx=0x7f6a14006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.660+0000 7f6a20c00700 1 -- 172.21.15.100:0/1285609870 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14011eb0 con 0x7f6a04004b80 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.660+0000 7f6a20c00700 1 -- 172.21.15.100:0/1285609870 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1400f940 con 0x7f6a04004b80 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.660+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a240c3b00 con 0x7f6a04004b80 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.660+0000 7f6a20c00700 1 -- 172.21.15.100:0/1285609870 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400fcc0 con 0x7f6a04004b80 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.660+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a240c40c0 con 0x7f6a04004b80 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.661+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a240c5840 con 0x7f6a04004b80 2024-01-22T05:38:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.662+0000 7f6a20c00700 1 -- 172.21.15.100:0/1285609870 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6a14014650 con 0x7f6a04004b80 2024-01-22T05:38:39.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.662+0000 7f6a20c00700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f69fc05f150 0x7f69fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:39.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.662+0000 7f6a20c00700 1 -- 172.21.15.100:0/1285609870 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a1407ae10 con 0x7f6a04004b80 2024-01-22T05:38:39.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.663+0000 7f6a28e00700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f69fc05f150 0x7f69fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:39.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.663+0000 7f6a28e00700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f69fc05f150 0x7f69fc061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6a240c9ac0 tx=0x7f6a0c009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:39.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.666+0000 7f6a20c00700 1 -- 172.21.15.100:0/1285609870 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6a1404c080 con 0x7f6a04004b80 2024-01-22T05:38:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.836+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a2405fdb0 con 0x7f6a04004b80 2024-01-22T05:38:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.836+0000 7f6a20c00700 1 -- 172.21.15.100:0/1285609870 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a14022030 con 0x7f6a04004b80 2024-01-22T05:38:39.837 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f69fc05f150 msgr2=0x7f69fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f69fc05f150 0x7f69fc061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6a240c9ac0 tx=0x7f6a0c009060).stop 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 msgr2=0x7f6a240c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a240c48c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f6a14011a20 tx=0x7f6a14006f40).stop 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 shutdown_connections 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f69fc05f150 0x7f69fc061610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a240af170 0x7f6a240b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a04004b80 0x7f6a240c48c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 --2- 172.21.15.100:0/1285609870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a24152380 0x7f6a240aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 >> 172.21.15.100:0/1285609870 conn(0x7f6a2405e9d0 msgr2=0x7f6a24063ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 shutdown_connections 2024-01-22T05:38:39.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:39.839+0000 7f6a2c200700 1 -- 172.21.15.100:0/1285609870 wait complete. 2024-01-22T05:38:39.873 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-01-22T05:38:39.874 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-22T05:38:39.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-01-22T05:38:40.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.057+0000 7ff01d200700 1 Processor -- start 2024-01-22T05:38:40.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.057+0000 7ff01d200700 1 -- start start 2024-01-22T05:38:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.058+0000 7ff01d200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff018154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.058+0000 7ff01d200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff0180aa3f0 0x7ff0180c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.058+0000 7ff01d200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180c1530 con 0x7ff018154060 2024-01-22T05:38:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.058+0000 7ff01d200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180cbb60 con 0x7ff0180aa3f0 2024-01-22T05:38:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.058+0000 7ff01d200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180cb880 con 0x7ff0180c64b0 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.059+0000 7ff015400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff018154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.059+0000 7ff015e00700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff018154060 0x7ff0180c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:41406/0 (socket says 172.21.15.100:41406) 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.059+0000 7ff015e00700 1 -- 172.21.15.100:0/246054785 learned_addr learned my addr 172.21.15.100:0/246054785 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.059+0000 7ff016800700 1 --2- 172.21.15.100:0/246054785 >> v2:172.21.15.169:3300/0 conn(0x7ff0180aa3f0 0x7ff0180c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.059+0000 7ff014a00700 1 -- 172.21.15.100:0/246054785 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082803168 0 0) 0x7ff0180c1530 con 0x7ff018154060 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.059+0000 7ff014a00700 1 -- 172.21.15.100:0/246054785 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff80033f0 con 0x7ff018154060 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff015400700 1 -- 172.21.15.100:0/246054785 >> v2:172.21.15.169:3300/0 conn(0x7ff0180aa3f0 msgr2=0x7ff0180c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:40.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff015400700 1 --2- 172.21.15.100:0/246054785 >> v2:172.21.15.169:3300/0 conn(0x7ff0180aa3f0 0x7ff0180c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff015400700 1 -- 172.21.15.100:0/246054785 >> v1:172.21.15.169:6789/0 conn(0x7ff018154060 legacy=0x7ff0180c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff015400700 1 -- 172.21.15.100:0/246054785 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180c17d0 con 0x7ff0180c64b0 2024-01-22T05:38:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff016800700 1 --2- 172.21.15.100:0/246054785 >> v2:172.21.15.169:3300/0 conn(0x7ff0180aa3f0 0x7ff0180c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff015400700 1 --2- 172.21.15.100:0/246054785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff018154440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff000009760 tx=0x7ff000009060).ready entity=mon.2 client_cookie=929ff3903be1bb37 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff014a00700 1 -- 172.21.15.100:0/246054785 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000d4a0 con 0x7ff0180c64b0 2024-01-22T05:38:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff014a00700 1 -- 172.21.15.100:0/246054785 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00000d600 con 0x7ff0180c64b0 2024-01-22T05:38:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.060+0000 7ff014a00700 1 -- 172.21.15.100:0/246054785 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000d980 con 0x7ff0180c64b0 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 -- 172.21.15.100:0/246054785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 msgr2=0x7ff018154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 --2- 172.21.15.100:0/246054785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff018154440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff000009760 tx=0x7ff000009060).stop 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 -- 172.21.15.100:0/246054785 shutdown_connections 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 --2- 172.21.15.100:0/246054785 >> v2:172.21.15.169:3300/0 conn(0x7ff0180aa3f0 0x7ff0180c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 --2- 172.21.15.100:0/246054785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff018154440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 -- 172.21.15.100:0/246054785 >> 172.21.15.100:0/246054785 conn(0x7ff01805e9d0 msgr2=0x7ff0180cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 -- 172.21.15.100:0/246054785 shutdown_connections 2024-01-22T05:38:40.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.061+0000 7ff01d200700 1 -- 172.21.15.100:0/246054785 wait complete. 2024-01-22T05:38:40.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.062+0000 7ff01d200700 1 Processor -- start 2024-01-22T05:38:40.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.062+0000 7ff01d200700 1 -- start start 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.063+0000 7ff01d200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0180aa3f0 0x7ff01814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.063+0000 7ff01d200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff0180b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.063+0000 7ff01d200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff018154060 0x7ff0181524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.063+0000 7ff01d200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180c2fb0 con 0x7ff018154060 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.063+0000 7ff01d200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180aeb60 con 0x7ff0180aa3f0 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.063+0000 7ff01d200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180c2960 con 0x7ff0180c64b0 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff018154060 0x7ff0181524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff018154060 0x7ff0181524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37542/0 (socket says 172.21.15.100:37542) 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 -- 172.21.15.100:0/3712618870 learned_addr learned my addr 172.21.15.100:0/3712618870 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff015400700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff0180b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff015e00700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0180aa3f0 0x7ff01814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 -- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 msgr2=0x7ff0180b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff0180b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 -- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0180aa3f0 msgr2=0x7ff01814e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0180aa3f0 0x7ff01814e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 -- 172.21.15.100:0/3712618870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010009a20 con 0x7ff018154060 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff016800700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff018154060 0x7ff0181524a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff01000ef90 tx=0x7ff01000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.064+0000 7ff00d600700 1 -- 172.21.15.100:0/3712618870 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000cc80 con 0x7ff018154060 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.065+0000 7ff00d600700 1 -- 172.21.15.100:0/3712618870 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000f040 con 0x7ff018154060 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.065+0000 7ff00d600700 1 -- 172.21.15.100:0/3712618870 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010013400 con 0x7ff018154060 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.065+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0000092a0 con 0x7ff018154060 2024-01-22T05:38:40.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.065+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0180aee40 con 0x7ff018154060 2024-01-22T05:38:40.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.066+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0180c3120 con 0x7ff018154060 2024-01-22T05:38:40.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.066+0000 7ff00d600700 1 -- 172.21.15.100:0/3712618870 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff010013830 con 0x7ff018154060 2024-01-22T05:38:40.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.067+0000 7ff00d600700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff005f150 0x7feff0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:40.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.067+0000 7ff00d600700 1 -- 172.21.15.100:0/3712618870 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff01007ac50 con 0x7ff018154060 2024-01-22T05:38:40.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.067+0000 7ff015e00700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff005f150 0x7feff0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:40.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.068+0000 7ff015e00700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff005f150 0x7feff0061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff0181505e0 tx=0x7ff008009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:40.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.071+0000 7ff00d600700 1 -- 172.21.15.100:0/3712618870 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff01004be60 con 0x7ff018154060 2024-01-22T05:38:40.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:40.309+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7ff01805fdb0 con 0x7ff018154060 2024-01-22T05:38:41.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.259+0000 7ff00d600700 1 -- 172.21.15.100:0/3712618870 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v57) v1 ==== 150+0+0 (secure 0 0 0) 0x7ff01004f480 con 0x7ff018154060 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff005f150 msgr2=0x7feff0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff005f150 0x7feff0061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff0181505e0 tx=0x7ff008009040).stop 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff018154060 msgr2=0x7ff0181524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff018154060 0x7ff0181524a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff01000ef90 tx=0x7ff01000b040).stop 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 shutdown_connections 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7feff005f150 0x7feff0061610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0180aa3f0 0x7ff01814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff018154060 0x7ff0181524a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 --2- 172.21.15.100:0/3712618870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0180c64b0 0x7ff0180b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 >> 172.21.15.100:0/3712618870 conn(0x7ff01805e9d0 msgr2=0x7ff018150920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:41.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 shutdown_connections 2024-01-22T05:38:41.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.262+0000 7ff01d200700 1 -- 172.21.15.100:0/3712618870 wait complete. 2024-01-22T05:38:41.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:38:41.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.473+0000 7f280e800700 1 Processor -- start 2024-01-22T05:38:41.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.473+0000 7f280e800700 1 -- start start 2024-01-22T05:38:41.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.474+0000 7f280e800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2808155100 0x7f28080650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:41.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.474+0000 7f280e800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f28080655b0 0x7f28080a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:41.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.474+0000 7f280e800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2808065a60 con 0x7f280814e430 2024-01-22T05:38:41.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.474+0000 7f280e800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080625f0 con 0x7f28080655b0 2024-01-22T05:38:41.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.474+0000 7f280e800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2808063170 con 0x7f2808155100 2024-01-22T05:38:41.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.475+0000 7f2806a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2808155100 0x7f28080650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:41.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.475+0000 7f2806a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2808155100 0x7f28080650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:38506/0 (socket says 172.21.15.100:38506) 2024-01-22T05:38:41.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.475+0000 7f2806a00700 1 -- 172.21.15.100:0/2728797554 learned_addr learned my addr 172.21.15.100:0/2728797554 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:41.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.475+0000 7f2807e00700 1 --2- 172.21.15.100:0/2728797554 >> v2:172.21.15.169:3300/0 conn(0x7f28080655b0 0x7f28080a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:41.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.475+0000 7f2807400700 1 --1- 172.21.15.100:0/2728797554 >> v1:172.21.15.169:6789/0 conn(0x7f280814e430 0x7f28080c4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:41422/0 (socket says 172.21.15.100:41422) 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.475+0000 7f2807e00700 1 -- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2808155100 msgr2=0x7f28080650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.475+0000 7f2807e00700 1 --2- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2808155100 0x7f28080650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.476+0000 7f2807e00700 1 -- 172.21.15.100:0/2728797554 >> v1:172.21.15.169:6789/0 conn(0x7f280814e430 legacy=0x7f28080c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.476+0000 7f2807e00700 1 -- 172.21.15.100:0/2728797554 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808063600 con 0x7f28080655b0 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.476+0000 7f2806a00700 1 --2- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2808155100 0x7f28080650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.476+0000 7f2807e00700 1 --2- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28080655b0 0x7f28080a4870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2800009e60 tx=0x7f2800009780).ready entity=mon.1 client_cookie=5f6888e192449fcb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.476+0000 7f2806000700 1 -- 172.21.15.100:0/2728797554 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280000e070 con 0x7f28080655b0 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.476+0000 7f2806000700 1 -- 172.21.15.100:0/2728797554 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280000bb60 con 0x7f28080655b0 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.476+0000 7f2806000700 1 -- 172.21.15.100:0/2728797554 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800012410 con 0x7f28080655b0 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 -- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28080655b0 msgr2=0x7f28080a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 --2- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28080655b0 0x7f28080a4870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2800009e60 tx=0x7f2800009780).stop 2024-01-22T05:38:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 -- 172.21.15.100:0/2728797554 shutdown_connections 2024-01-22T05:38:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 --2- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28080655b0 0x7f28080a4870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 --2- 172.21.15.100:0/2728797554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2808155100 0x7f28080650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 -- 172.21.15.100:0/2728797554 >> 172.21.15.100:0/2728797554 conn(0x7f28080c46e0 msgr2=0x7f28080649b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 -- 172.21.15.100:0/2728797554 shutdown_connections 2024-01-22T05:38:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.477+0000 7f280e800700 1 -- 172.21.15.100:0/2728797554 wait complete. 2024-01-22T05:38:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.478+0000 7f280e800700 1 Processor -- start 2024-01-22T05:38:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.478+0000 7f280e800700 1 -- start start 2024-01-22T05:38:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.479+0000 7f280e800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28080655b0 0x7f280814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.479+0000 7f280e800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280814e430 0x7f2808156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.479+0000 7f280e800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2808155100 0x7f2808156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.479+0000 7f280e800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808156f50 con 0x7f280814e430 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.479+0000 7f280e800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080a7470 con 0x7f2808155100 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.479+0000 7f280e800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080ac1f0 con 0x7f28080655b0 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280814e430 0x7f2808156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280814e430 0x7f2808156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37546/0 (socket says 172.21.15.100:37546) 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 -- 172.21.15.100:0/3615353239 learned_addr learned my addr 172.21.15.100:0/3615353239 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2807400700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28080655b0 0x7f280814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2807e00700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2808155100 0x7f2808156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 -- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28080655b0 msgr2=0x7f280814bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28080655b0 0x7f280814bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 -- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2808155100 msgr2=0x7f2808156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2808155100 0x7f2808156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 -- 172.21.15.100:0/3615353239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009370 con 0x7f280814e430 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f2806a00700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280814e430 0x7f2808156570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f27f000ea50 tx=0x7f27f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.480+0000 7f27fea00700 1 -- 172.21.15.100:0/3615353239 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000ee90 con 0x7f280814e430 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.481+0000 7f27fea00700 1 -- 172.21.15.100:0/3615353239 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000c7f0 con 0x7f280814e430 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.481+0000 7f27fea00700 1 -- 172.21.15.100:0/3615353239 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000cb70 con 0x7f280814e430 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.481+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2800009a20 con 0x7f280814e430 2024-01-22T05:38:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.481+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080ac7b0 con 0x7f280814e430 2024-01-22T05:38:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.482+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28080a7600 con 0x7f280814e430 2024-01-22T05:38:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.482+0000 7f27fea00700 1 -- 172.21.15.100:0/3615353239 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f27f001b400 con 0x7f280814e430 2024-01-22T05:38:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.483+0000 7f27fea00700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f27e005f150 0x7f27e0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.483+0000 7f27fea00700 1 -- 172.21.15.100:0/3615353239 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f27f007a7b0 con 0x7f280814e430 2024-01-22T05:38:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.483+0000 7f2807400700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f27e005f150 0x7f27e0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.484+0000 7f2807400700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f27e005f150 0x7f27e0061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f27f8007fd0 tx=0x7f27f8007d30).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:41.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.487+0000 7f27fea00700 1 -- 172.21.15.100:0/3615353239 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f27f004b960 con 0x7f280814e430 2024-01-22T05:38:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.658+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f280806c680 con 0x7f280814e430 2024-01-22T05:38:41.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.662+0000 7f27fea00700 1 -- 172.21.15.100:0/3615353239 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27f0016020 con 0x7f280814e430 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f27e005f150 msgr2=0x7f27e0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f27e005f150 0x7f27e0061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f27f8007fd0 tx=0x7f27f8007d30).stop 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280814e430 msgr2=0x7f2808156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280814e430 0x7f2808156570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f27f000ea50 tx=0x7f27f00090f0).stop 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 shutdown_connections 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f27e005f150 0x7f27e0061610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2808155100 0x7f2808156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28080655b0 0x7f280814bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 --2- 172.21.15.100:0/3615353239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280814e430 0x7f2808156570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:41.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 >> 172.21.15.100:0/3615353239 conn(0x7f28080c46e0 msgr2=0x7f28080c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:41.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 shutdown_connections 2024-01-22T05:38:41.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:41.665+0000 7f280e800700 1 -- 172.21.15.100:0/3615353239 wait complete. 2024-01-22T05:38:41.683 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:38:41.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:38:41.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:38:41.870 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:38:41.870 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:38:41.870 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:38:41.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-22T05:38:41.937 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:38:41.938 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:38:41.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:41.938 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:38:42.042 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi169.front.sepia.ceph.com... 2024-01-22T05:38:42.042 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:38:42.042 DEBUG:teuthology.orchestra.run.smithi169:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-01-22T05:38:42.114 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:38:42.115 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:38:42.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:42.115 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-22T05:38:42.171 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:38:42.172 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:38:42.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-01-22T05:38:42.238 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:38:42.238 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:38:42.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:42.238 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-22T05:38:42.283 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi169.front.sepia.ceph.com... 2024-01-22T05:38:42.283 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:38:42.283 DEBUG:teuthology.orchestra.run.smithi169:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-01-22T05:38:42.350 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:38:42.351 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:38:42.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:38:42.351 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-22T05:38:42.396 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:38:42.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.579+0000 7f46bbc00700 1 Processor -- start 2024-01-22T05:38:42.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.579+0000 7f46bbc00700 1 -- start start 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46bbc00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f46b4154060 0x7f46b4154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46bbc00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f46b40aa3f0 0x7f46b40c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46bbc00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b40cb880 con 0x7f46b40a9ec0 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46bbc00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b40cbb60 con 0x7f46b4154060 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46bbc00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b40c17d0 con 0x7f46b40aa3f0 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f46b4154060 0x7f46b4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f46b4154060 0x7f46b4154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37550/0 (socket says 172.21.15.100:37550) 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9200700 1 -- 172.21.15.100:0/1306933406 learned_addr learned my addr 172.21.15.100:0/1306933406 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f46b40a9ec0 0x7f46b40c0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38954/0 (socket says 172.21.15.100:38954) 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b3e00700 1 --2- 172.21.15.100:0/1306933406 >> v2:172.21.15.169:3300/0 conn(0x7f46b40aa3f0 0x7f46b40c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9200700 1 -- 172.21.15.100:0/1306933406 >> v2:172.21.15.169:3300/0 conn(0x7f46b40aa3f0 msgr2=0x7f46b40c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9200700 1 --2- 172.21.15.100:0/1306933406 >> v2:172.21.15.169:3300/0 conn(0x7f46b40aa3f0 0x7f46b40c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9200700 1 -- 172.21.15.100:0/1306933406 >> v1:172.21.15.100:6789/0 conn(0x7f46b40a9ec0 legacy=0x7f46b40c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.581+0000 7f46b9200700 1 -- 172.21.15.100:0/1306933406 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40c1ab0 con 0x7f46b4154060 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46b9200700 1 --2- 172.21.15.100:0/1306933406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b4154060 0x7f46b4154440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f46b40aa840 tx=0x7f46a40090f0).ready entity=mon.0 client_cookie=d2213db940352c27 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46b3400700 1 -- 172.21.15.100:0/1306933406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400b600 con 0x7f46b4154060 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46b3400700 1 -- 172.21.15.100:0/1306933406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a400b760 con 0x7f46b4154060 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46b3400700 1 -- 172.21.15.100:0/1306933406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400bae0 con 0x7f46b4154060 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46bbc00700 1 -- 172.21.15.100:0/1306933406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b4154060 msgr2=0x7f46b4154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46bbc00700 1 --2- 172.21.15.100:0/1306933406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b4154060 0x7f46b4154440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f46b40aa840 tx=0x7f46a40090f0).stop 2024-01-22T05:38:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46bbc00700 1 -- 172.21.15.100:0/1306933406 shutdown_connections 2024-01-22T05:38:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46bbc00700 1 --2- 172.21.15.100:0/1306933406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b4154060 0x7f46b4154440 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46bbc00700 1 --2- 172.21.15.100:0/1306933406 >> v2:172.21.15.169:3300/0 conn(0x7f46b40aa3f0 0x7f46b40c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.582+0000 7f46bbc00700 1 -- 172.21.15.100:0/1306933406 >> 172.21.15.100:0/1306933406 conn(0x7f46b405e9d0 msgr2=0x7f46b40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.583+0000 7f46bbc00700 1 -- 172.21.15.100:0/1306933406 shutdown_connections 2024-01-22T05:38:42.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.583+0000 7f46bbc00700 1 -- 172.21.15.100:0/1306933406 wait complete. 2024-01-22T05:38:42.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.584+0000 7f46bbc00700 1 Processor -- start 2024-01-22T05:38:42.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.584+0000 7f46bbc00700 1 -- start start 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46bbc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40a9ec0 0x7f46b40abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46bbc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46b40aa3f0 0x7f46b40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46bbc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46b4154060 0x7f46b4150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46bbc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4165410 con 0x7f46b40a9ec0 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46bbc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40ac020 con 0x7f46b40aa3f0 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46bbc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4164890 con 0x7f46b4154060 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46b9200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40a9ec0 0x7f46b40abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46b9200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40a9ec0 0x7f46b40abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37554/0 (socket says 172.21.15.100:37554) 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.585+0000 7f46b9200700 1 -- 172.21.15.100:0/131568183 learned_addr learned my addr 172.21.15.100:0/131568183 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b3e00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46b40aa3f0 0x7f46b40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b9c00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46b4154060 0x7f46b4150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b9200700 1 -- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46b4154060 msgr2=0x7f46b4150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b9200700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46b4154060 0x7f46b4150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b9200700 1 -- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46b40aa3f0 msgr2=0x7f46b40b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b9200700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46b40aa3f0 0x7f46b40b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b9200700 1 -- 172.21.15.100:0/131568183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009370 con 0x7f46b40a9ec0 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46b9200700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40a9ec0 0x7f46b40abb30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f46a4009130 tx=0x7f46a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46abe00700 1 -- 172.21.15.100:0/131568183 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400b8d0 con 0x7f46b40a9ec0 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46abe00700 1 -- 172.21.15.100:0/131568183 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a400ba30 con 0x7f46b40a9ec0 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b4164b70 con 0x7f46b40a9ec0 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46abe00700 1 -- 172.21.15.100:0/131568183 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a401b660 con 0x7f46b40a9ec0 2024-01-22T05:38:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.586+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b4165130 con 0x7f46b40a9ec0 2024-01-22T05:38:42.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.588+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b405fdb0 con 0x7f46b40a9ec0 2024-01-22T05:38:42.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.588+0000 7f46abe00700 1 -- 172.21.15.100:0/131568183 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f46a401b9d0 con 0x7f46b40a9ec0 2024-01-22T05:38:42.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.589+0000 7f46abe00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f468c05f150 0x7f468c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:42.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.589+0000 7f46abe00700 1 -- 172.21.15.100:0/131568183 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f46a407b6e0 con 0x7f46b40a9ec0 2024-01-22T05:38:42.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.589+0000 7f46b3e00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f468c05f150 0x7f468c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:42.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.590+0000 7f46b3e00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f468c05f150 0x7f468c061610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f46b4167990 tx=0x7f469c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:42.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.593+0000 7f46abe00700 1 -- 172.21.15.100:0/131568183 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f46a404c9b0 con 0x7f46b40a9ec0 2024-01-22T05:38:42.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.803+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46b406abb0 con 0x7f46b40a9ec0 2024-01-22T05:38:42.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.804+0000 7f46abe00700 1 -- 172.21.15.100:0/131568183 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f46a401f090 con 0x7f46b40a9ec0 2024-01-22T05:38:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:42.805 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:42.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f468c05f150 msgr2=0x7f468c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:42.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f468c05f150 0x7f468c061610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f46b4167990 tx=0x7f469c008040).stop 2024-01-22T05:38:42.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40a9ec0 msgr2=0x7f46b40abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:42.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40a9ec0 0x7f46b40abb30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f46a4009130 tx=0x7f46a4017000).stop 2024-01-22T05:38:42.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 shutdown_connections 2024-01-22T05:38:42.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f468c05f150 0x7f468c061610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46b4154060 0x7f46b4150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40a9ec0 0x7f46b40abb30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 --2- 172.21.15.100:0/131568183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46b40aa3f0 0x7f46b40b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:42.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 >> 172.21.15.100:0/131568183 conn(0x7f46b405e9d0 msgr2=0x7f46b4152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:42.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 shutdown_connections 2024-01-22T05:38:42.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:42.806+0000 7f46bbc00700 1 -- 172.21.15.100:0/131568183 wait complete. 2024-01-22T05:38:42.809 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:42.824 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:43.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.008+0000 7f056ca00700 1 Processor -- start 2024-01-22T05:38:43.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.008+0000 7f056ca00700 1 -- start start 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056ca00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640a5ab0 0x7f05640a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056ca00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f05640c0fc0 0x7f0564069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056ca00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0564065760 con 0x7f056406a070 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056ca00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640bc340 con 0x7f05640c0fc0 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056ca00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056406a520 con 0x7f05640a5ab0 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056aa00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f056406a070 0x7f0564153da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58986/0 (socket says 172.21.15.100:58986) 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056aa00700 1 -- 172.21.15.100:0/1010148175 learned_addr learned my addr 172.21.15.100:0/1010148175 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:43.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f0569600700 1 --2- 172.21.15.100:0/1010148175 >> v2:172.21.15.169:3300/0 conn(0x7f05640c0fc0 0x7f0564069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.009+0000 7f056a000700 1 --2- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640a5ab0 0x7f05640a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0568c00700 1 -- 172.21.15.100:0/1010148175 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441786887 0 0) 0x7f0564065760 con 0x7f056406a070 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0568c00700 1 -- 172.21.15.100:0/1010148175 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05440033f0 con 0x7f056406a070 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0569600700 1 -- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640a5ab0 msgr2=0x7f05640a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0569600700 1 --2- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640a5ab0 0x7f05640a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0569600700 1 -- 172.21.15.100:0/1010148175 >> v1:172.21.15.100:6789/0 conn(0x7f056406a070 legacy=0x7f0564153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0568c00700 1 -- 172.21.15.100:0/1010148175 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2732928458 0 0) 0x7f05440033f0 con 0x7f056406a070 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0569600700 1 -- 172.21.15.100:0/1010148175 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056406a780 con 0x7f05640c0fc0 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0569600700 1 --2- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05640c0fc0 0x7f0564069b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f054c009760 tx=0x7f054c009060).ready entity=mon.1 client_cookie=873941b9e3318404 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.010+0000 7f0568c00700 1 -- 172.21.15.100:0/1010148175 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0017f0 con 0x7f05640c0fc0 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f0568c00700 1 -- 172.21.15.100:0/1010148175 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0090d0 con 0x7f05640c0fc0 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f0568c00700 1 -- 172.21.15.100:0/1010148175 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c011610 con 0x7f05640c0fc0 2024-01-22T05:38:43.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 -- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05640c0fc0 msgr2=0x7f0564069b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 --2- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05640c0fc0 0x7f0564069b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f054c009760 tx=0x7f054c009060).stop 2024-01-22T05:38:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 -- 172.21.15.100:0/1010148175 shutdown_connections 2024-01-22T05:38:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 --2- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640a5ab0 0x7f05640a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 --2- 172.21.15.100:0/1010148175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05640c0fc0 0x7f0564069b80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 -- 172.21.15.100:0/1010148175 >> 172.21.15.100:0/1010148175 conn(0x7f0564063090 msgr2=0x7f05640c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 -- 172.21.15.100:0/1010148175 shutdown_connections 2024-01-22T05:38:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.011+0000 7f056ca00700 1 -- 172.21.15.100:0/1010148175 wait complete. 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.013+0000 7f056ca00700 1 Processor -- start 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.013+0000 7f056ca00700 1 -- start start 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056ca00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f056406a070 0x7f0564143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056ca00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05640a5ab0 0x7f05640bef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056ca00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640c0fc0 0x7f056413f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056ca00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640bf4f0 con 0x7f05640a5ab0 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056ca00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640bf7d0 con 0x7f056406a070 2024-01-22T05:38:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056ca00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640bfab0 con 0x7f05640c0fc0 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05640a5ab0 0x7f05640bef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05640a5ab0 0x7f05640bef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42420/0 (socket says 172.21.15.100:42420) 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 -- 172.21.15.100:0/4227931116 learned_addr learned my addr 172.21.15.100:0/4227931116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056a000700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f056406a070 0x7f0564143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056aa00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640c0fc0 0x7f056413f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 -- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640c0fc0 msgr2=0x7f056413f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640c0fc0 0x7f056413f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 -- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f056406a070 msgr2=0x7f0564143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f056406a070 0x7f0564143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f0569600700 1 -- 172.21.15.100:0/4227931116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0092a0 con 0x7f05640a5ab0 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.014+0000 7f056aa00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640c0fc0 0x7f056413f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.015+0000 7f0569600700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05640a5ab0 0x7f05640bef10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f056406c020 tx=0x7f054c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.015+0000 7f0561600700 1 -- 172.21.15.100:0/4227931116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c01c670 con 0x7f05640a5ab0 2024-01-22T05:38:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.015+0000 7f0561600700 1 -- 172.21.15.100:0/4227931116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c01c7d0 con 0x7f05640a5ab0 2024-01-22T05:38:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.015+0000 7f0561600700 1 -- 172.21.15.100:0/4227931116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c01cb90 con 0x7f05640a5ab0 2024-01-22T05:38:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.015+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05640bfd90 con 0x7f05640a5ab0 2024-01-22T05:38:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.015+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05640a9aa0 con 0x7f05640a5ab0 2024-01-22T05:38:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.016+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056405fdb0 con 0x7f05640a5ab0 2024-01-22T05:38:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.017+0000 7f0561600700 1 -- 172.21.15.100:0/4227931116 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f054c0263b0 con 0x7f05640a5ab0 2024-01-22T05:38:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.018+0000 7f0561600700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f053c05f150 0x7f053c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.018+0000 7f0561600700 1 -- 172.21.15.100:0/4227931116 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f054c07add0 con 0x7f05640a5ab0 2024-01-22T05:38:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.018+0000 7f056a000700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f053c05f150 0x7f053c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.018+0000 7f056a000700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f053c05f150 0x7f053c061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0554009c30 tx=0x7f0554009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.022+0000 7f0561600700 1 -- 172.21.15.100:0/4227931116 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f054c04bf80 con 0x7f05640a5ab0 2024-01-22T05:38:43.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.193+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0564065270 con 0x7f05640a5ab0 2024-01-22T05:38:43.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.194+0000 7f0561600700 1 -- 172.21.15.100:0/4227931116 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f054c022030 con 0x7f05640a5ab0 2024-01-22T05:38:43.195 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:43.196 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:37:59.686591+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:43.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.196+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f053c05f150 msgr2=0x7f053c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.196+0000 7f056ca00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f053c05f150 0x7f053c061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0554009c30 tx=0x7f0554009060).stop 2024-01-22T05:38:43.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.196+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05640a5ab0 msgr2=0x7f05640bef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.196+0000 7f056ca00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05640a5ab0 0x7f05640bef10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f056406c020 tx=0x7f054c016000).stop 2024-01-22T05:38:43.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 shutdown_connections 2024-01-22T05:38:43.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f053c05f150 0x7f053c061610 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f056406a070 0x7f0564143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05640c0fc0 0x7f056413f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 --2- 172.21.15.100:0/4227931116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05640a5ab0 0x7f05640bef10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 >> 172.21.15.100:0/4227931116 conn(0x7f0564063090 msgr2=0x7f0564146530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:43.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 shutdown_connections 2024-01-22T05:38:43.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.197+0000 7f056ca00700 1 -- 172.21.15.100:0/4227931116 wait complete. 2024-01-22T05:38:43.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:37:56.837820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:37:57.667310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:38:43.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:43.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.404+0000 7f0f7c600700 1 Processor -- start 2024-01-22T05:38:43.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.404+0000 7f0f7c600700 1 -- start start 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.405+0000 7f0f7c600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0f740a9f60 0x7f0f740aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.405+0000 7f0f7c600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0f740c1940 0x7f0f740ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.405+0000 7f0f7c600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f740c74b0 con 0x7f0f7405e1f0 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.405+0000 7f0f7c600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f740cab90 con 0x7f0f740c1940 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.405+0000 7f0f7c600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f74158660 con 0x7f0f740a9f60 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f79200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0f740c1940 0x7f0f740ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f7a600700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0f7405e1f0 0x7f0f74098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58988/0 (socket says 172.21.15.100:58988) 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f7a600700 1 -- 172.21.15.100:0/1605232753 learned_addr learned my addr 172.21.15.100:0/1605232753 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f79c00700 1 --2- 172.21.15.100:0/1605232753 >> v2:172.21.15.169:3300/0 conn(0x7f0f740a9f60 0x7f0f740aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f79200700 1 -- 172.21.15.100:0/1605232753 >> v2:172.21.15.169:3300/0 conn(0x7f0f740a9f60 msgr2=0x7f0f740aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:43.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f79200700 1 --2- 172.21.15.100:0/1605232753 >> v2:172.21.15.169:3300/0 conn(0x7f0f740a9f60 0x7f0f740aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f79200700 1 -- 172.21.15.100:0/1605232753 >> v1:172.21.15.100:6789/0 conn(0x7f0f7405e1f0 legacy=0x7f0f74098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f79200700 1 -- 172.21.15.100:0/1605232753 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74158940 con 0x7f0f740c1940 2024-01-22T05:38:43.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.406+0000 7f0f79200700 1 --2- 172.21.15.100:0/1605232753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f740c1940 0x7f0f740ca6a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f0f740c8850 tx=0x7f0f5c009060).ready entity=mon.0 client_cookie=1cfa03d1d039f014 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f73e00700 1 -- 172.21.15.100:0/1605232753 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00b580 con 0x7f0f740c1940 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f73e00700 1 -- 172.21.15.100:0/1605232753 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00b6e0 con 0x7f0f740c1940 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f73e00700 1 -- 172.21.15.100:0/1605232753 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00ba60 con 0x7f0f740c1940 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 -- 172.21.15.100:0/1605232753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f740c1940 msgr2=0x7f0f740ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 --2- 172.21.15.100:0/1605232753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f740c1940 0x7f0f740ca6a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f0f740c8850 tx=0x7f0f5c009060).stop 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 -- 172.21.15.100:0/1605232753 shutdown_connections 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 --2- 172.21.15.100:0/1605232753 >> v2:172.21.15.169:3300/0 conn(0x7f0f740a9f60 0x7f0f740aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 --2- 172.21.15.100:0/1605232753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f740c1940 0x7f0f740ca6a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 -- 172.21.15.100:0/1605232753 >> 172.21.15.100:0/1605232753 conn(0x7f0f740cada0 msgr2=0x7f0f740cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 -- 172.21.15.100:0/1605232753 shutdown_connections 2024-01-22T05:38:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.407+0000 7f0f7c600700 1 -- 172.21.15.100:0/1605232753 wait complete. 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.409+0000 7f0f7c600700 1 Processor -- start 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.409+0000 7f0f7c600700 1 -- start start 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f7c600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7405e1f0 0x7f0f740ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f7c600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f740a9f60 0x7f0f74152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f7c600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f740c1940 0x7f0f740ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f7c600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740c2a20 con 0x7f0f7405e1f0 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f7c600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f74153220 con 0x7f0f740c1940 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f7c600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740ab7e0 con 0x7f0f740a9f60 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7405e1f0 0x7f0f740ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7405e1f0 0x7f0f740ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42438/0 (socket says 172.21.15.100:42438) 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 -- 172.21.15.100:0/3711146575 learned_addr learned my addr 172.21.15.100:0/3711146575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f7a600700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f740c1940 0x7f0f740ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79200700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f740a9f60 0x7f0f74152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 -- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f740a9f60 msgr2=0x7f0f74152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f740a9f60 0x7f0f74152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 -- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f740c1940 msgr2=0x7f0f740ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f740c1940 0x7f0f740ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.410+0000 7f0f79c00700 1 -- 172.21.15.100:0/3711146575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0092a0 con 0x7f0f7405e1f0 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.411+0000 7f0f79c00700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7405e1f0 0x7f0f740ab230 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f0f6400d890 tx=0x7f0f64008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.411+0000 7f0f70c00700 1 -- 172.21.15.100:0/3711146575 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64011590 con 0x7f0f7405e1f0 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.411+0000 7f0f70c00700 1 -- 172.21.15.100:0/3711146575 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640116f0 con 0x7f0f7405e1f0 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.411+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f740abac0 con 0x7f0f7405e1f0 2024-01-22T05:38:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.411+0000 7f0f70c00700 1 -- 172.21.15.100:0/3711146575 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64011a70 con 0x7f0f7405e1f0 2024-01-22T05:38:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.411+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f74155650 con 0x7f0f7405e1f0 2024-01-22T05:38:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.412+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7405fdb0 con 0x7f0f7405e1f0 2024-01-22T05:38:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.413+0000 7f0f70c00700 1 -- 172.21.15.100:0/3711146575 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0f6401c460 con 0x7f0f7405e1f0 2024-01-22T05:38:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.413+0000 7f0f70c00700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0f4c05f1a0 0x7f0f4c061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.414+0000 7f0f70c00700 1 -- 172.21.15.100:0/3711146575 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0f64079f30 con 0x7f0f7405e1f0 2024-01-22T05:38:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.414+0000 7f0f79200700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0f4c05f1a0 0x7f0f4c061660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.414+0000 7f0f79200700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0f4c05f1a0 0x7f0f4c061660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f0f740ae0e0 tx=0x7f0f5c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.418+0000 7f0f70c00700 1 -- 172.21.15.100:0/3711146575 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0f6404b160 con 0x7f0f7405e1f0 2024-01-22T05:38:43.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.586+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0f7406abb0 con 0x7f0f7405e1f0 2024-01-22T05:38:43.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.587+0000 7f0f70c00700 1 -- 172.21.15.100:0/3711146575 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0f64011e60 con 0x7f0f7405e1f0 2024-01-22T05:38:43.588 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:43.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0f4c05f1a0 msgr2=0x7f0f4c061660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0f4c05f1a0 0x7f0f4c061660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f0f740ae0e0 tx=0x7f0f5c017000).stop 2024-01-22T05:38:43.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7405e1f0 msgr2=0x7f0f740ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7405e1f0 0x7f0f740ab230 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f0f6400d890 tx=0x7f0f64008040).stop 2024-01-22T05:38:43.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 shutdown_connections 2024-01-22T05:38:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0f4c05f1a0 0x7f0f4c061660 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f740c1940 0x7f0f740ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7405e1f0 0x7f0f740ab230 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 --2- 172.21.15.100:0/3711146575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f740a9f60 0x7f0f74152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 >> 172.21.15.100:0/3711146575 conn(0x7f0f740cada0 msgr2=0x7f0f74157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 shutdown_connections 2024-01-22T05:38:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.589+0000 7f0f7c600700 1 -- 172.21.15.100:0/3711146575 wait complete. 2024-01-22T05:38:43.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:43.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.791+0000 7f21bf200700 1 Processor -- start 2024-01-22T05:38:43.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.791+0000 7f21bf200700 1 -- start start 2024-01-22T05:38:43.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21bf200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f21b80c0e10 0x7f21b80aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21bf200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b80c74b0 con 0x7f21b805e900 2024-01-22T05:38:43.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21bf200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8158660 con 0x7f21b80a9f60 2024-01-22T05:38:43.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21bf200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b8158940 con 0x7f21b80c0e10 2024-01-22T05:38:43.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21b7400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f21b805e900 0x7f21b8098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59004/0 (socket says 172.21.15.100:59004) 2024-01-22T05:38:43.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21b7400700 1 -- 172.21.15.100:0/2144669925 learned_addr learned my addr 172.21.15.100:0/2144669925 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:43.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21bd200700 1 --2- 172.21.15.100:0/2144669925 >> v2:172.21.15.169:3300/0 conn(0x7f21b80c0e10 0x7f21b80aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21b6a00700 1 -- 172.21.15.100:0/2144669925 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388827718 0 0) 0x7f21b80c74b0 con 0x7f21b805e900 2024-01-22T05:38:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.793+0000 7f21b6a00700 1 -- 172.21.15.100:0/2144669925 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21980033f0 con 0x7f21b805e900 2024-01-22T05:38:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21b6a00700 1 -- 172.21.15.100:0/2144669925 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256128350 0 0) 0x7f21b8158660 con 0x7f21b80a9f60 2024-01-22T05:38:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21b6a00700 1 -- 172.21.15.100:0/2144669925 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b80c74b0 con 0x7f21b80a9f60 2024-01-22T05:38:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21bd200700 1 -- 172.21.15.100:0/2144669925 >> v1:172.21.15.169:6789/0 conn(0x7f21b80a9f60 legacy=0x7f21b805e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21bd200700 1 -- 172.21.15.100:0/2144669925 >> v1:172.21.15.100:6789/0 conn(0x7f21b805e900 legacy=0x7f21b8098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21bd200700 1 -- 172.21.15.100:0/2144669925 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b80c7140 con 0x7f21b80c0e10 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21bd200700 1 --2- 172.21.15.100:0/2144669925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b80c0e10 0x7f21b80aa340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f21b0009e60 tx=0x7f21b0009780).ready entity=mon.1 client_cookie=1929ea0eb8e3b0cd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21b6a00700 1 -- 172.21.15.100:0/2144669925 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000e070 con 0x7f21b80c0e10 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21b6a00700 1 -- 172.21.15.100:0/2144669925 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000bab0 con 0x7f21b80c0e10 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.794+0000 7f21b6a00700 1 -- 172.21.15.100:0/2144669925 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000be30 con 0x7f21b80c0e10 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.795+0000 7f21bf200700 1 -- 172.21.15.100:0/2144669925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b80c0e10 msgr2=0x7f21b80aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.795+0000 7f21bf200700 1 --2- 172.21.15.100:0/2144669925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b80c0e10 0x7f21b80aa340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f21b0009e60 tx=0x7f21b0009780).stop 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.795+0000 7f21bf200700 1 -- 172.21.15.100:0/2144669925 shutdown_connections 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.795+0000 7f21bf200700 1 --2- 172.21.15.100:0/2144669925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b80c0e10 0x7f21b80aa340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.795+0000 7f21bf200700 1 -- 172.21.15.100:0/2144669925 >> 172.21.15.100:0/2144669925 conn(0x7f21b80cada0 msgr2=0x7f21b80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.795+0000 7f21bf200700 1 -- 172.21.15.100:0/2144669925 shutdown_connections 2024-01-22T05:38:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.795+0000 7f21bf200700 1 -- 172.21.15.100:0/2144669925 wait complete. 2024-01-22T05:38:43.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.796+0000 7f21bf200700 1 Processor -- start 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.796+0000 7f21bf200700 1 -- start start 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.797+0000 7f21bf200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b805e900 0x7f21b81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.797+0000 7f21bf200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21b80a9f60 0x7f21b8144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.797+0000 7f21bf200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b80c0e10 0x7f21b80acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.797+0000 7f21bf200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8156ea0 con 0x7f21b80c0e10 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.797+0000 7f21bf200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8155e00 con 0x7f21b805e900 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.797+0000 7f21bf200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b81560e0 con 0x7f21b80a9f60 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.797+0000 7f21bd200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b80c0e10 0x7f21b80acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b80c0e10 0x7f21b80acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42440/0 (socket says 172.21.15.100:42440) 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 -- 172.21.15.100:0/890790783 learned_addr learned my addr 172.21.15.100:0/890790783 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21b7400700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21b80a9f60 0x7f21b8144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21b7e00700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b805e900 0x7f21b81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 -- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21b80a9f60 msgr2=0x7f21b8144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21b80a9f60 0x7f21b8144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 -- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b805e900 msgr2=0x7f21b81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b805e900 0x7f21b81555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 -- 172.21.15.100:0/890790783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009a20 con 0x7f21b80c0e10 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21b7e00700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b805e900 0x7f21b81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bd200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b80c0e10 0x7f21b80acce0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f21b80c8880 tx=0x7f21b0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21af400700 1 -- 172.21.15.100:0/890790783 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b001d630 con 0x7f21b80c0e10 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21af400700 1 -- 172.21.15.100:0/890790783 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b001d790 con 0x7f21b80c0e10 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b81563c0 con 0x7f21b80c0e10 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.798+0000 7f21af400700 1 -- 172.21.15.100:0/890790783 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b001db10 con 0x7f21b80c0e10 2024-01-22T05:38:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.799+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b8156980 con 0x7f21b80c0e10 2024-01-22T05:38:43.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.800+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b805fdb0 con 0x7f21b80c0e10 2024-01-22T05:38:43.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.800+0000 7f21af400700 1 -- 172.21.15.100:0/890790783 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f21b0026410 con 0x7f21b80c0e10 2024-01-22T05:38:43.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.801+0000 7f21af400700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f219005f150 0x7f2190061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:43.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.801+0000 7f21af400700 1 -- 172.21.15.100:0/890790783 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f21b007c0e0 con 0x7f21b80c0e10 2024-01-22T05:38:43.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.802+0000 7f21b7e00700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f219005f150 0x7f2190061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:43.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.802+0000 7f21b7e00700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f219005f150 0x7f2190061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f21a8002750 tx=0x7f21a8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:43.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.806+0000 7f21af400700 1 -- 172.21.15.100:0/890790783 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f21b004d270 con 0x7f21b80c0e10 2024-01-22T05:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.973+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21b8156b70 con 0x7f21b80c0e10 2024-01-22T05:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.974+0000 7f21af400700 1 -- 172.21.15.100:0/890790783 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f21b8156b70 con 0x7f21b80c0e10 2024-01-22T05:38:43.974 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f219005f150 msgr2=0x7f2190061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f219005f150 0x7f2190061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f21a8002750 tx=0x7f21a8009040).stop 2024-01-22T05:38:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b80c0e10 msgr2=0x7f21b80acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b80c0e10 0x7f21b80acce0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f21b80c8880 tx=0x7f21b0009780).stop 2024-01-22T05:38:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 shutdown_connections 2024-01-22T05:38:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f219005f150 0x7f2190061610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21b805e900 0x7f21b81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b80c0e10 0x7f21b80acce0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 --2- 172.21.15.100:0/890790783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21b80a9f60 0x7f21b8144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 >> 172.21.15.100:0/890790783 conn(0x7f21b80cada0 msgr2=0x7f21b80add30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 shutdown_connections 2024-01-22T05:38:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:43.976+0000 7f21bf200700 1 -- 172.21.15.100:0/890790783 wait complete. 2024-01-22T05:38:43.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:38:44.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.178+0000 7f9458800700 1 Processor -- start 2024-01-22T05:38:44.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.178+0000 7f9458800700 1 -- start start 2024-01-22T05:38:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9458800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9458800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f94500c1940 0x7f94500ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9458800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500c74b0 con 0x7f945005e1f0 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9458800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500cab90 con 0x7f94500c1940 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9458800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9450158660 con 0x7f94500a9f60 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f94500c1940 0x7f94500ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f94500c1940 0x7f94500ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42456/0 (socket says 172.21.15.100:42456) 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455400700 1 -- 172.21.15.100:0/2882192695 learned_addr learned my addr 172.21.15.100:0/2882192695 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455e00700 1 --2- 172.21.15.100:0/2882192695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455400700 1 -- 172.21.15.100:0/2882192695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 msgr2=0x7f94500aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455400700 1 --2- 172.21.15.100:0/2882192695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455400700 1 -- 172.21.15.100:0/2882192695 >> v1:172.21.15.100:6789/0 conn(0x7f945005e1f0 legacy=0x7f9450098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455400700 1 -- 172.21.15.100:0/2882192695 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450158940 con 0x7f94500c1940 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.180+0000 7f9455e00700 1 --2- 172.21.15.100:0/2882192695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.181+0000 7f9455400700 1 --2- 172.21.15.100:0/2882192695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94500c1940 0x7f94500ca6a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f9438006fd0 tx=0x7f94380090f0).ready entity=mon.0 client_cookie=e00515a25b8ddec0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.181+0000 7f9454a00700 1 -- 172.21.15.100:0/2882192695 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943800b600 con 0x7f94500c1940 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.181+0000 7f9454a00700 1 -- 172.21.15.100:0/2882192695 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943800b760 con 0x7f94500c1940 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.181+0000 7f9454a00700 1 -- 172.21.15.100:0/2882192695 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943800bae0 con 0x7f94500c1940 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.181+0000 7f9458800700 1 -- 172.21.15.100:0/2882192695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94500c1940 msgr2=0x7f94500ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.181+0000 7f9458800700 1 --2- 172.21.15.100:0/2882192695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94500c1940 0x7f94500ca6a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f9438006fd0 tx=0x7f94380090f0).stop 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.182+0000 7f9458800700 1 -- 172.21.15.100:0/2882192695 shutdown_connections 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.182+0000 7f9458800700 1 --2- 172.21.15.100:0/2882192695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.182+0000 7f9458800700 1 --2- 172.21.15.100:0/2882192695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94500c1940 0x7f94500ca6a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.182+0000 7f9458800700 1 -- 172.21.15.100:0/2882192695 >> 172.21.15.100:0/2882192695 conn(0x7f94500cada0 msgr2=0x7f94500cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.182+0000 7f9458800700 1 -- 172.21.15.100:0/2882192695 shutdown_connections 2024-01-22T05:38:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.182+0000 7f9458800700 1 -- 172.21.15.100:0/2882192695 wait complete. 2024-01-22T05:38:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.183+0000 7f9458800700 1 Processor -- start 2024-01-22T05:38:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.183+0000 7f9458800700 1 -- start start 2024-01-22T05:38:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9458800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945005e1f0 0x7f9450151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9458800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9458800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94500c1940 0x7f94500ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9458800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500ae910 con 0x7f945005e1f0 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9458800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500986d0 con 0x7f94500c1940 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9458800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94501561c0 con 0x7f94500a9f60 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9455e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945005e1f0 0x7f9450151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9455e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945005e1f0 0x7f9450151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42462/0 (socket says 172.21.15.100:42462) 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.184+0000 7f9455e00700 1 -- 172.21.15.100:0/3531341176 learned_addr learned my addr 172.21.15.100:0/3531341176 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9455400700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9456800700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94500c1940 0x7f94500ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9455e00700 1 -- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 msgr2=0x7f94500adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9455e00700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9455e00700 1 -- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94500c1940 msgr2=0x7f94500ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9455e00700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94500c1940 0x7f94500ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9455e00700 1 -- 172.21.15.100:0/3531341176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438009370 con 0x7f945005e1f0 2024-01-22T05:38:44.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9455e00700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945005e1f0 0x7f9450151a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f944000c880 tx=0x7f9440008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f944d600700 1 -- 172.21.15.100:0/3531341176 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440010580 con 0x7f945005e1f0 2024-01-22T05:38:44.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f944d600700 1 -- 172.21.15.100:0/3531341176 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94400106e0 con 0x7f945005e1f0 2024-01-22T05:38:44.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94501564a0 con 0x7f945005e1f0 2024-01-22T05:38:44.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f944d600700 1 -- 172.21.15.100:0/3531341176 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440010a60 con 0x7f945005e1f0 2024-01-22T05:38:44.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.185+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9450156a60 con 0x7f945005e1f0 2024-01-22T05:38:44.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.186+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94500aa860 con 0x7f945005e1f0 2024-01-22T05:38:44.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.187+0000 7f944d600700 1 -- 172.21.15.100:0/3531341176 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f944001b460 con 0x7f945005e1f0 2024-01-22T05:38:44.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.188+0000 7f944d600700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f942805f150 0x7f9428061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.188+0000 7f944d600700 1 -- 172.21.15.100:0/3531341176 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f944007a2b0 con 0x7f945005e1f0 2024-01-22T05:38:44.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.188+0000 7f9455400700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f942805f150 0x7f9428061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.189+0000 7f9455400700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f942805f150 0x7f9428061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9438006fd0 tx=0x7f9438017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.192+0000 7f944d600700 1 -- 172.21.15.100:0/3531341176 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f944004b460 con 0x7f945005e1f0 2024-01-22T05:38:44.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.362+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94500ca030 con 0x7f945005e1f0 2024-01-22T05:38:44.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.363+0000 7f944d600700 1 -- 172.21.15.100:0/3531341176 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f944004ea80 con 0x7f945005e1f0 2024-01-22T05:38:44.363 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f942805f150 msgr2=0x7f9428061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f942805f150 0x7f9428061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9438006fd0 tx=0x7f9438017000).stop 2024-01-22T05:38:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945005e1f0 msgr2=0x7f9450151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945005e1f0 0x7f9450151a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f944000c880 tx=0x7f9440008040).stop 2024-01-22T05:38:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 shutdown_connections 2024-01-22T05:38:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f942805f150 0x7f9428061610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94500c1940 0x7f94500ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945005e1f0 0x7f9450151a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 --2- 172.21.15.100:0/3531341176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94500a9f60 0x7f94500adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 >> 172.21.15.100:0/3531341176 conn(0x7f94500cada0 msgr2=0x7f9450152880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 shutdown_connections 2024-01-22T05:38:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.365+0000 7f9458800700 1 -- 172.21.15.100:0/3531341176 wait complete. 2024-01-22T05:38:44.383 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:38:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.569+0000 7f36c2200700 1 Processor -- start 2024-01-22T05:38:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.569+0000 7f36c2200700 1 -- start start 2024-01-22T05:38:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.570+0000 7f36c2200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f36bc0a9f60 0x7f36bc0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.570+0000 7f36c2200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc05e900 0x7f36bc0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.570+0000 7f36c2200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc0c74b0 con 0x7f36bc0c1940 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.570+0000 7f36c2200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0cab90 con 0x7f36bc0a9f60 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.570+0000 7f36c2200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc158660 con 0x7f36bc05e900 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bb400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f36bc0a9f60 0x7f36bc0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc05e900 0x7f36bc0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc05e900 0x7f36bc0ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:49288/0 (socket says 172.21.15.100:49288) 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 -- 172.21.15.100:0/3077090472 learned_addr learned my addr 172.21.15.100:0/3077090472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bb400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f36bc0a9f60 0x7f36bc0aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:33276/0 (socket says 172.21.15.100:33276) 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 -- 172.21.15.100:0/3077090472 >> v2:172.21.15.169:3300/0 conn(0x7f36bc0a9f60 msgr2=0x7f36bc0aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 --2- 172.21.15.100:0/3077090472 >> v2:172.21.15.169:3300/0 conn(0x7f36bc0a9f60 0x7f36bc0aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 -- 172.21.15.100:0/3077090472 >> v1:172.21.15.169:6789/0 conn(0x7f36bc0c1940 legacy=0x7f36bc05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 -- 172.21.15.100:0/3077090472 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc158940 con 0x7f36bc05e900 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bb400700 1 --2- 172.21.15.100:0/3077090472 >> v2:172.21.15.169:3300/0 conn(0x7f36bc0a9f60 0x7f36bc0aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.571+0000 7f36bbe00700 1 --2- 172.21.15.100:0/3077090472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc05e900 0x7f36bc0ca6a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f36b4009f20 tx=0x7f36b4009840).ready entity=mon.2 client_cookie=aefa731e3d506158 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36ba000700 1 -- 172.21.15.100:0/3077090472 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400e070 con 0x7f36bc05e900 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36ba000700 1 -- 172.21.15.100:0/3077090472 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b400b9d0 con 0x7f36bc05e900 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36ba000700 1 -- 172.21.15.100:0/3077090472 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400bd50 con 0x7f36bc05e900 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36c2200700 1 -- 172.21.15.100:0/3077090472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc05e900 msgr2=0x7f36bc0ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36c2200700 1 --2- 172.21.15.100:0/3077090472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc05e900 0x7f36bc0ca6a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f36b4009f20 tx=0x7f36b4009840).stop 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36c2200700 1 -- 172.21.15.100:0/3077090472 shutdown_connections 2024-01-22T05:38:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36c2200700 1 --2- 172.21.15.100:0/3077090472 >> v2:172.21.15.169:3300/0 conn(0x7f36bc0a9f60 0x7f36bc0aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36c2200700 1 --2- 172.21.15.100:0/3077090472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc05e900 0x7f36bc0ca6a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36c2200700 1 -- 172.21.15.100:0/3077090472 >> 172.21.15.100:0/3077090472 conn(0x7f36bc0cada0 msgr2=0x7f36bc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.572+0000 7f36c2200700 1 -- 172.21.15.100:0/3077090472 shutdown_connections 2024-01-22T05:38:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.573+0000 7f36c2200700 1 -- 172.21.15.100:0/3077090472 wait complete. 2024-01-22T05:38:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.574+0000 7f36c2200700 1 Processor -- start 2024-01-22T05:38:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.575+0000 7f36c2200700 1 -- start start 2024-01-22T05:38:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36c2200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36bc05e900 0x7f36bc155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36c2200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc0a9f60 0x7f36bc0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36c2200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc0c1940 0x7f36bc1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36c2200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc155d40 con 0x7f36bc05e900 2024-01-22T05:38:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36c2200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c3e60 con 0x7f36bc0c1940 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36c2200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c4110 con 0x7f36bc0a9f60 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36bb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36bc05e900 0x7f36bc155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36bb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36bc05e900 0x7f36bc155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42464/0 (socket says 172.21.15.100:42464) 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.576+0000 7f36bb400700 1 -- 172.21.15.100:0/4215024316 learned_addr learned my addr 172.21.15.100:0/4215024316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36baa00700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc0a9f60 0x7f36bc0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bbe00700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc0c1940 0x7f36bc1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bb400700 1 -- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc0a9f60 msgr2=0x7f36bc0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bb400700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc0a9f60 0x7f36bc0c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bb400700 1 -- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc0c1940 msgr2=0x7f36bc1537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bb400700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc0c1940 0x7f36bc1537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bb400700 1 -- 172.21.15.100:0/4215024316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0092a0 con 0x7f36bc05e900 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bbe00700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc0c1940 0x7f36bc1537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36baa00700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc0a9f60 0x7f36bc0c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36bb400700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36bc05e900 0x7f36bc155850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f36ac00ea20 tx=0x7f36ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36b2a00700 1 -- 172.21.15.100:0/4215024316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00c850 con 0x7f36bc05e900 2024-01-22T05:38:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36b2a00700 1 -- 172.21.15.100:0/4215024316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac00c9b0 con 0x7f36bc05e900 2024-01-22T05:38:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b4009ae0 con 0x7f36bc05e900 2024-01-22T05:38:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36b2a00700 1 -- 172.21.15.100:0/4215024316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00cd30 con 0x7f36bc05e900 2024-01-22T05:38:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.577+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc0c46d0 con 0x7f36bc05e900 2024-01-22T05:38:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.578+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc05fdb0 con 0x7f36bc05e900 2024-01-22T05:38:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.579+0000 7f36b2a00700 1 -- 172.21.15.100:0/4215024316 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f36ac012600 con 0x7f36bc05e900 2024-01-22T05:38:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.580+0000 7f36b2a00700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f369405f150 0x7f3694061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.580+0000 7f36b2a00700 1 -- 172.21.15.100:0/4215024316 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f36ac07a8f0 con 0x7f36bc05e900 2024-01-22T05:38:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.580+0000 7f36baa00700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f369405f150 0x7f3694061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.581+0000 7f36baa00700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f369405f150 0x7f3694061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f36bc154760 tx=0x7f36a4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.584+0000 7f36b2a00700 1 -- 172.21.15.100:0/4215024316 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f36ac04bb00 con 0x7f36bc05e900 2024-01-22T05:38:44.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.752+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36bc0ca030 con 0x7f36bc05e900 2024-01-22T05:38:44.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.753+0000 7f36b2a00700 1 -- 172.21.15.100:0/4215024316 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36ac04f120 con 0x7f36bc05e900 2024-01-22T05:38:44.753 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:38:44.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f369405f150 msgr2=0x7f3694061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f369405f150 0x7f3694061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f36bc154760 tx=0x7f36a4009040).stop 2024-01-22T05:38:44.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36bc05e900 msgr2=0x7f36bc155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36bc05e900 0x7f36bc155850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f36ac00ea20 tx=0x7f36ac009060).stop 2024-01-22T05:38:44.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 shutdown_connections 2024-01-22T05:38:44.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f369405f150 0x7f3694061610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc0c1940 0x7f36bc1537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36bc05e900 0x7f36bc155850 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 --2- 172.21.15.100:0/4215024316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36bc0a9f60 0x7f36bc0c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 >> 172.21.15.100:0/4215024316 conn(0x7f36bc0cada0 msgr2=0x7f36bc0ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:44.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 shutdown_connections 2024-01-22T05:38:44.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.755+0000 7f36c2200700 1 -- 172.21.15.100:0/4215024316 wait complete. 2024-01-22T05:38:44.772 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.956+0000 7f14ea400700 1 Processor -- start 2024-01-22T05:38:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.956+0000 7f14ea400700 1 -- start start 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.957+0000 7f14ea400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14e4153c60 0x7f14e4154040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.957+0000 7f14ea400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e4065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.957+0000 7f14ea400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e4065540 con 0x7f14e40c1900 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.957+0000 7f14ea400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e40bc510 con 0x7f14e4153c60 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.957+0000 7f14ea400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40bc7f0 con 0x7f14e4064c30 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14e4153c60 0x7f14e4154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e4065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e4065050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:49308/0 (socket says 172.21.15.100:49308) 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14e4153c60 0x7f14e4154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:33286/0 (socket says 172.21.15.100:33286) 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3e00700 1 -- 172.21.15.100:0/1389436740 learned_addr learned my addr 172.21.15.100:0/1389436740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e2a00700 1 --1- 172.21.15.100:0/1389436740 >> v1:172.21.15.169:6789/0 conn(0x7f14e40c1900 0x7f14e4066520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:40104/0 (socket says 172.21.15.100:40104) 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3e00700 1 -- 172.21.15.100:0/1389436740 >> v2:172.21.15.169:3300/0 conn(0x7f14e4153c60 msgr2=0x7f14e4154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3e00700 1 --2- 172.21.15.100:0/1389436740 >> v2:172.21.15.169:3300/0 conn(0x7f14e4153c60 0x7f14e4154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3e00700 1 -- 172.21.15.100:0/1389436740 >> v1:172.21.15.169:6789/0 conn(0x7f14e40c1900 legacy=0x7f14e4066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e3e00700 1 -- 172.21.15.100:0/1389436740 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e40c45b0 con 0x7f14e4064c30 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.958+0000 7f14e2000700 1 -- 172.21.15.100:0/1389436740 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924948270 0 0) 0x7f14e4065540 con 0x7f14e40c1900 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14e3e00700 1 --2- 172.21.15.100:0/1389436740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e4065050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f14dc009f20 tx=0x7f14dc009840).ready entity=mon.2 client_cookie=6a1e561a32d5e69c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14e2000700 1 -- 172.21.15.100:0/1389436740 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00e070 con 0x7f14e4064c30 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14e2000700 1 -- 172.21.15.100:0/1389436740 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc00b9d0 con 0x7f14e4064c30 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14e2000700 1 -- 172.21.15.100:0/1389436740 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00bd50 con 0x7f14e4064c30 2024-01-22T05:38:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 -- 172.21.15.100:0/1389436740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 msgr2=0x7f14e4065050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 --2- 172.21.15.100:0/1389436740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e4065050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f14dc009f20 tx=0x7f14dc009840).stop 2024-01-22T05:38:44.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 -- 172.21.15.100:0/1389436740 shutdown_connections 2024-01-22T05:38:44.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 --2- 172.21.15.100:0/1389436740 >> v2:172.21.15.169:3300/0 conn(0x7f14e4153c60 0x7f14e4154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 --2- 172.21.15.100:0/1389436740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e4065050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 -- 172.21.15.100:0/1389436740 >> 172.21.15.100:0/1389436740 conn(0x7f14e40c7d20 msgr2=0x7f14e40c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:44.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 -- 172.21.15.100:0/1389436740 shutdown_connections 2024-01-22T05:38:44.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.959+0000 7f14ea400700 1 -- 172.21.15.100:0/1389436740 wait complete. 2024-01-22T05:38:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.961+0000 7f14ea400700 1 Processor -- start 2024-01-22T05:38:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.961+0000 7f14ea400700 1 -- start start 2024-01-22T05:38:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14ea400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e40a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14ea400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14e40c1900 0x7f14e40a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14ea400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e4153c60 0x7f14e40a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14ea400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40a8040 con 0x7f14e40c1900 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14ea400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40aafc0 con 0x7f14e4153c60 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14ea400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40aa3b0 con 0x7f14e4064c30 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14e2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14e40c1900 0x7f14e40a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14e2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14e40c1900 0x7f14e40a7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42478/0 (socket says 172.21.15.100:42478) 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14e2a00700 1 -- 172.21.15.100:0/136761806 learned_addr learned my addr 172.21.15.100:0/136761806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14e3400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e40a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.962+0000 7f14e3e00700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e4153c60 0x7f14e40a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14e2a00700 1 -- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 msgr2=0x7f14e40a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14e2a00700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e40a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14e2a00700 1 -- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e4153c60 msgr2=0x7f14e40a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14e2a00700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e4153c60 0x7f14e40a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14e2a00700 1 -- 172.21.15.100:0/136761806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc009ae0 con 0x7f14e40c1900 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14e2a00700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14e40c1900 0x7f14e40a7660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f14cc00c560 tx=0x7f14cc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14daa00700 1 -- 172.21.15.100:0/136761806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0072e0 con 0x7f14e40c1900 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14daa00700 1 -- 172.21.15.100:0/136761806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc007440 con 0x7f14e40c1900 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e40aa690 con 0x7f14e40c1900 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14daa00700 1 -- 172.21.15.100:0/136761806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0058f0 con 0x7f14e40c1900 2024-01-22T05:38:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.963+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e40aac50 con 0x7f14e40c1900 2024-01-22T05:38:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.965+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e40ab150 con 0x7f14e40c1900 2024-01-22T05:38:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.965+0000 7f14daa00700 1 -- 172.21.15.100:0/136761806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f14cc005ce0 con 0x7f14e40c1900 2024-01-22T05:38:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.966+0000 7f14daa00700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f14bc05f150 0x7f14bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.966+0000 7f14daa00700 1 -- 172.21.15.100:0/136761806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f14cc079a20 con 0x7f14e40c1900 2024-01-22T05:38:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.966+0000 7f14e3400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f14bc05f150 0x7f14bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:44.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.967+0000 7f14e3400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f14bc05f150 0x7f14bc061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f14d4009b90 tx=0x7f14d4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:44.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:44.970+0000 7f14daa00700 1 -- 172.21.15.100:0/136761806 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f14cc04acb0 con 0x7f14e40c1900 2024-01-22T05:38:45.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.183+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14e405fdb0 con 0x7f14e40c1900 2024-01-22T05:38:45.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.184+0000 7f14daa00700 1 -- 172.21.15.100:0/136761806 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f14cc04e2d0 con 0x7f14e40c1900 2024-01-22T05:38:45.184 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:45.184 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f14bc05f150 msgr2=0x7f14bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f14bc05f150 0x7f14bc061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f14d4009b90 tx=0x7f14d4009060).stop 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14e40c1900 msgr2=0x7f14e40a7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14e40c1900 0x7f14e40a7660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f14cc00c560 tx=0x7f14cc007c90).stop 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 shutdown_connections 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f14bc05f150 0x7f14bc061610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e4153c60 0x7f14e40a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e4064c30 0x7f14e40a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 --2- 172.21.15.100:0/136761806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14e40c1900 0x7f14e40a7660 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 >> 172.21.15.100:0/136761806 conn(0x7f14e40c7d20 msgr2=0x7f14e40c0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:45.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.186+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 shutdown_connections 2024-01-22T05:38:45.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.187+0000 7f14ea400700 1 -- 172.21.15.100:0/136761806 wait complete. 2024-01-22T05:38:45.188 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:45.204 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:45.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.392+0000 7f6c31800700 1 Processor -- start 2024-01-22T05:38:45.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.392+0000 7f6c31800700 1 -- start start 2024-01-22T05:38:45.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.393+0000 7f6c31800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6c2c0a58a0 0x7f6c2c06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.393+0000 7f6c31800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0a5c80 0x7f6c2c064b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.393+0000 7f6c31800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c065c90 con 0x7f6c2c0681e0 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.393+0000 7f6c31800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c06a790 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.393+0000 7f6c31800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0bba50 con 0x7f6c2c0a5c80 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2b400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6c2c0681e0 0x7f6c2c155bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59020/0 (socket says 172.21.15.100:59020) 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2b400700 1 -- 172.21.15.100:0/3395858536 learned_addr learned my addr 172.21.15.100:0/3395858536 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2a000700 1 --2- 172.21.15.100:0/3395858536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0a5c80 0x7f6c2c064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2aa00700 1 --2- 172.21.15.100:0/3395858536 >> v2:172.21.15.169:3300/0 conn(0x7f6c2c0a58a0 0x7f6c2c06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c29600700 1 -- 172.21.15.100:0/3395858536 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376570972 0 0) 0x7f6c2c065c90 con 0x7f6c2c0681e0 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c29600700 1 -- 172.21.15.100:0/3395858536 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c0c0033f0 con 0x7f6c2c0681e0 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2a000700 1 -- 172.21.15.100:0/3395858536 >> v2:172.21.15.169:3300/0 conn(0x7f6c2c0a58a0 msgr2=0x7f6c2c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2a000700 1 --2- 172.21.15.100:0/3395858536 >> v2:172.21.15.169:3300/0 conn(0x7f6c2c0a58a0 0x7f6c2c06a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2a000700 1 -- 172.21.15.100:0/3395858536 >> v1:172.21.15.100:6789/0 conn(0x7f6c2c0681e0 legacy=0x7f6c2c155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2a000700 1 -- 172.21.15.100:0/3395858536 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0653f0 con 0x7f6c2c0a5c80 2024-01-22T05:38:45.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.394+0000 7f6c2aa00700 1 --2- 172.21.15.100:0/3395858536 >> v2:172.21.15.169:3300/0 conn(0x7f6c2c0a58a0 0x7f6c2c06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:45.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c2a000700 1 --2- 172.21.15.100:0/3395858536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0a5c80 0x7f6c2c064b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6c14009760 tx=0x7f6c14009060).ready entity=mon.2 client_cookie=73e888ed7f4adc4a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:45.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c29600700 1 -- 172.21.15.100:0/3395858536 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400d4a0 con 0x7f6c2c0a5c80 2024-01-22T05:38:45.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c29600700 1 -- 172.21.15.100:0/3395858536 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1400d600 con 0x7f6c2c0a5c80 2024-01-22T05:38:45.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c29600700 1 -- 172.21.15.100:0/3395858536 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400d980 con 0x7f6c2c0a5c80 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 -- 172.21.15.100:0/3395858536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0a5c80 msgr2=0x7f6c2c064b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 --2- 172.21.15.100:0/3395858536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0a5c80 0x7f6c2c064b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6c14009760 tx=0x7f6c14009060).stop 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 -- 172.21.15.100:0/3395858536 shutdown_connections 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 --2- 172.21.15.100:0/3395858536 >> v2:172.21.15.169:3300/0 conn(0x7f6c2c0a58a0 0x7f6c2c06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 --2- 172.21.15.100:0/3395858536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0a5c80 0x7f6c2c064b90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 -- 172.21.15.100:0/3395858536 >> 172.21.15.100:0/3395858536 conn(0x7f6c2c063090 msgr2=0x7f6c2c0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 -- 172.21.15.100:0/3395858536 shutdown_connections 2024-01-22T05:38:45.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.395+0000 7f6c31800700 1 -- 172.21.15.100:0/3395858536 wait complete. 2024-01-22T05:38:45.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.397+0000 7f6c31800700 1 Processor -- start 2024-01-22T05:38:45.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.397+0000 7f6c31800700 1 -- start start 2024-01-22T05:38:45.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c31800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0681e0 0x7f6c2c0a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c31800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c2c0a58a0 0x7f6c2c0c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c31800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c2c0a5c80 0x7f6c2c0c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c31800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c2040 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c31800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0aa690 con 0x7f6c2c0a5c80 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c31800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c1a80 con 0x7f6c2c0681e0 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2a000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c2c0a58a0 0x7f6c2c0c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2a000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c2c0a58a0 0x7f6c2c0c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42486/0 (socket says 172.21.15.100:42486) 2024-01-22T05:38:45.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2a000700 1 -- 172.21.15.100:0/2433847781 learned_addr learned my addr 172.21.15.100:0/2433847781 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2aa00700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0681e0 0x7f6c2c0a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2b400700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c2c0a5c80 0x7f6c2c0c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2a000700 1 -- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0681e0 msgr2=0x7f6c2c0a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2a000700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0681e0 0x7f6c2c0a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2a000700 1 -- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c2c0a5c80 msgr2=0x7f6c2c0c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.398+0000 7f6c2a000700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c2c0a5c80 0x7f6c2c0c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c2a000700 1 -- 172.21.15.100:0/2433847781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c0092a0 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c2aa00700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0681e0 0x7f6c2c0a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c2a000700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c2c0a58a0 0x7f6c2c0c0fc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f6c2c0bbb90 tx=0x7f6c14016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c22000700 1 -- 172.21.15.100:0/2433847781 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14000c90 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c22000700 1 -- 172.21.15.100:0/2433847781 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1400d770 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c22000700 1 -- 172.21.15.100:0/2433847781 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1401d640 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c140092a0 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.399+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c0aa320 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.400+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c0aa840 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.401+0000 7f6c22000700 1 -- 172.21.15.100:0/2433847781 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6c1401da70 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.402+0000 7f6c22000700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6c0405f150 0x7f6c04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.402+0000 7f6c22000700 1 -- 172.21.15.100:0/2433847781 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f6c1407b9c0 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.402+0000 7f6c2aa00700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6c0405f150 0x7f6c04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.402+0000 7f6c2aa00700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6c0405f150 0x7f6c04061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6c1c009270 tx=0x7f6c1c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:45.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.406+0000 7f6c22000700 1 -- 172.21.15.100:0/2433847781 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6c2c0aa840 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.576+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c2c1559a0 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.577+0000 7f6c22000700 1 -- 172.21.15.100:0/2433847781 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17025 (secure 0 0 0) 0x7f6c1404cc70 con 0x7f6c2c0a58a0 2024-01-22T05:38:45.578 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:45.578 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:38:45.268189+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:45.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6c0405f150 msgr2=0x7f6c04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6c0405f150 0x7f6c04061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6c1c009270 tx=0x7f6c1c008040).stop 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c2c0a58a0 msgr2=0x7f6c2c0c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c2c0a58a0 0x7f6c2c0c0fc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f6c2c0bbb90 tx=0x7f6c14016000).stop 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 shutdown_connections 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6c0405f150 0x7f6c04061610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c2c0a5c80 0x7f6c2c0c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c2c0681e0 0x7f6c2c0a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 --2- 172.21.15.100:0/2433847781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c2c0a58a0 0x7f6c2c0c0fc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.579+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 >> 172.21.15.100:0/2433847781 conn(0x7f6c2c063090 msgr2=0x7f6c2c139e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.580+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 shutdown_connections 2024-01-22T05:38:45.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.580+0000 7f6c31800700 1 -- 172.21.15.100:0/2433847781 wait complete. 2024-01-22T05:38:45.598 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:38:45.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.782+0000 7f800a400700 1 Processor -- start 2024-01-22T05:38:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.782+0000 7f800a400700 1 -- start start 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.783+0000 7f800a400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041543d0 0x7f80040a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.783+0000 7f800a400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f80040aa220 0x7f80040c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.783+0000 7f800a400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80040c66e0 con 0x7f8004153ff0 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.783+0000 7f800a400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80040c0750 con 0x7f80040aa220 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.783+0000 7f800a400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040aa6b0 con 0x7f80041543d0 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8002a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041543d0 0x7f80040a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8003e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f80040aa220 0x7f80040c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8003e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f80040aa220 0x7f80040c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:33316/0 (socket says 172.21.15.100:33316) 2024-01-22T05:38:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8003e00700 1 -- 172.21.15.100:0/3850272435 learned_addr learned my addr 172.21.15.100:0/3850272435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8002a00700 1 -- 172.21.15.100:0/3850272435 >> v2:172.21.15.169:3300/0 conn(0x7f80040aa220 msgr2=0x7f80040c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8002a00700 1 --2- 172.21.15.100:0/3850272435 >> v2:172.21.15.169:3300/0 conn(0x7f80040aa220 0x7f80040c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8002a00700 1 -- 172.21.15.100:0/3850272435 >> v1:172.21.15.169:6789/0 conn(0x7f8004153ff0 legacy=0x7f80040c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.784+0000 7f8002a00700 1 -- 172.21.15.100:0/3850272435 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040bfe20 con 0x7f80041543d0 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f8002a00700 1 --2- 172.21.15.100:0/3850272435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041543d0 0x7f80040a9d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7fec009760 tx=0x7f7fec009060).ready entity=mon.2 client_cookie=54c9383cf9f2d633 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f8002000700 1 -- 172.21.15.100:0/3850272435 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00f510 con 0x7f80041543d0 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f8002000700 1 -- 172.21.15.100:0/3850272435 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec00f670 con 0x7f80041543d0 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f8002000700 1 -- 172.21.15.100:0/3850272435 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00f9f0 con 0x7f80041543d0 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f800a400700 1 -- 172.21.15.100:0/3850272435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041543d0 msgr2=0x7f80040a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f800a400700 1 --2- 172.21.15.100:0/3850272435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041543d0 0x7f80040a9d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7fec009760 tx=0x7f7fec009060).stop 2024-01-22T05:38:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f800a400700 1 -- 172.21.15.100:0/3850272435 shutdown_connections 2024-01-22T05:38:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f800a400700 1 --2- 172.21.15.100:0/3850272435 >> v2:172.21.15.169:3300/0 conn(0x7f80040aa220 0x7f80040c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f800a400700 1 --2- 172.21.15.100:0/3850272435 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041543d0 0x7f80040a9d30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f800a400700 1 -- 172.21.15.100:0/3850272435 >> 172.21.15.100:0/3850272435 conn(0x7f80040c82a0 msgr2=0x7f800405e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.785+0000 7f800a400700 1 -- 172.21.15.100:0/3850272435 shutdown_connections 2024-01-22T05:38:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.786+0000 7f800a400700 1 -- 172.21.15.100:0/3850272435 wait complete. 2024-01-22T05:38:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.787+0000 7f800a400700 1 Processor -- start 2024-01-22T05:38:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.787+0000 7f800a400700 1 -- start start 2024-01-22T05:38:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f800a400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040aa220 0x7f80040c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f800a400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8004153ff0 0x7f80040afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f800a400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80041543d0 0x7f800414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f800a400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040af9e0 con 0x7f80041543d0 2024-01-22T05:38:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f800a400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040aeb60 con 0x7f80040aa220 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f800a400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040aedd0 con 0x7f8004153ff0 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f8003e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80041543d0 0x7f800414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f8003e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80041543d0 0x7f800414c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42500/0 (socket says 172.21.15.100:42500) 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f8003e00700 1 -- 172.21.15.100:0/3119757505 learned_addr learned my addr 172.21.15.100:0/3119757505 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f8002a00700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8004153ff0 0x7f80040afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.788+0000 7f8003400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040aa220 0x7f80040c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f8003e00700 1 -- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8004153ff0 msgr2=0x7f80040afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f8003e00700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8004153ff0 0x7f80040afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f8003e00700 1 -- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040aa220 msgr2=0x7f80040c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f8003e00700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040aa220 0x7f80040c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f8003e00700 1 -- 172.21.15.100:0/3119757505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec0092a0 con 0x7f80041543d0 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f8003e00700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80041543d0 0x7f800414c9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f7ffc009de0 tx=0x7f7ffc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f7ffaa00700 1 -- 172.21.15.100:0/3119757505 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00c890 con 0x7f80041543d0 2024-01-22T05:38:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f7ffaa00700 1 -- 172.21.15.100:0/3119757505 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00f040 con 0x7f80041543d0 2024-01-22T05:38:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040af0b0 con 0x7f80041543d0 2024-01-22T05:38:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f7ffaa00700 1 -- 172.21.15.100:0/3119757505 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00cc20 con 0x7f80041543d0 2024-01-22T05:38:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.789+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80040af670 con 0x7f80041543d0 2024-01-22T05:38:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.790+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800405fdb0 con 0x7f80041543d0 2024-01-22T05:38:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.791+0000 7f7ffaa00700 1 -- 172.21.15.100:0/3119757505 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7ffc014410 con 0x7f80041543d0 2024-01-22T05:38:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.792+0000 7f7ffaa00700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fdc05f150 0x7f7fdc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.792+0000 7f7ffaa00700 1 -- 172.21.15.100:0/3119757505 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f7ffc07a2d0 con 0x7f80041543d0 2024-01-22T05:38:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.792+0000 7f8003400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fdc05f150 0x7f7fdc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.793+0000 7f8003400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fdc05f150 0x7f7fdc061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8004156c40 tx=0x7f7ff4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:45.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:45.796+0000 7f7ffaa00700 1 -- 172.21.15.100:0/3119757505 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ffc049b00 con 0x7f80041543d0 2024-01-22T05:38:46.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.007+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80040c0100 con 0x7f80041543d0 2024-01-22T05:38:46.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.008+0000 7f7ffaa00700 1 -- 172.21.15.100:0/3119757505 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f7ffc04b460 con 0x7f80041543d0 2024-01-22T05:38:46.008 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:46.008 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fdc05f150 msgr2=0x7f7fdc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fdc05f150 0x7f7fdc061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8004156c40 tx=0x7f7ff4009040).stop 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80041543d0 msgr2=0x7f800414c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80041543d0 0x7f800414c9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f7ffc009de0 tx=0x7f7ffc00b040).stop 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 shutdown_connections 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fdc05f150 0x7f7fdc061610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80040aa220 0x7f80040c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80041543d0 0x7f800414c9e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 --2- 172.21.15.100:0/3119757505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8004153ff0 0x7f80040afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 >> 172.21.15.100:0/3119757505 conn(0x7f80040c82a0 msgr2=0x7f80040ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:46.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 shutdown_connections 2024-01-22T05:38:46.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.010+0000 7f800a400700 1 -- 172.21.15.100:0/3119757505 wait complete. 2024-01-22T05:38:46.011 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:46.027 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:38:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.211+0000 7fcab5c00700 1 Processor -- start 2024-01-22T05:38:46.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.212+0000 7fcab5c00700 1 -- start start 2024-01-22T05:38:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.213+0000 7fcab5c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcab00a96e0 0x7fcab00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.213+0000 7fcab5c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00a9250 con 0x7fcab00aa4d0 2024-01-22T05:38:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.213+0000 7fcab5c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00a8640 con 0x7fcab0153fd0 2024-01-22T05:38:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.213+0000 7fcab5c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab00a8920 con 0x7fcab00a96e0 2024-01-22T05:38:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.213+0000 7fcaae000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcab00aa4d0 0x7fcab00c07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59024/0 (socket says 172.21.15.100:59024) 2024-01-22T05:38:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.213+0000 7fcaae000700 1 -- 172.21.15.100:0/1766144954 learned_addr learned my addr 172.21.15.100:0/1766144954 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.213+0000 7fcaaf400700 1 --2- 172.21.15.100:0/1766144954 >> v2:172.21.15.100:3300/0 conn(0x7fcab00a96e0 0x7fcab00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcaaf400700 1 -- 172.21.15.100:0/1766144954 >> v1:172.21.15.169:6789/0 conn(0x7fcab0153fd0 legacy=0x7fcab00a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcaaf400700 1 -- 172.21.15.100:0/1766144954 >> v1:172.21.15.100:6789/0 conn(0x7fcab00aa4d0 legacy=0x7fcab00c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcaaf400700 1 -- 172.21.15.100:0/1766144954 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00a8c00 con 0x7fcab00a96e0 2024-01-22T05:38:46.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcaaf400700 1 --2- 172.21.15.100:0/1766144954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab00c0ef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fcaa8009e60 tx=0x7fcaa8009780).ready entity=mon.0 client_cookie=5daff0c41d118d00 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:46.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcaad600700 1 -- 172.21.15.100:0/1766144954 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800e070 con 0x7fcab00a96e0 2024-01-22T05:38:46.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcaad600700 1 -- 172.21.15.100:0/1766144954 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800bc30 con 0x7fcab00a96e0 2024-01-22T05:38:46.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcaad600700 1 -- 172.21.15.100:0/1766144954 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8012410 con 0x7fcab00a96e0 2024-01-22T05:38:46.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcab5c00700 1 -- 172.21.15.100:0/1766144954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 msgr2=0x7fcab00c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.214+0000 7fcab5c00700 1 --2- 172.21.15.100:0/1766144954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab00c0ef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fcaa8009e60 tx=0x7fcaa8009780).stop 2024-01-22T05:38:46.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.215+0000 7fcab5c00700 1 -- 172.21.15.100:0/1766144954 shutdown_connections 2024-01-22T05:38:46.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.215+0000 7fcab5c00700 1 --2- 172.21.15.100:0/1766144954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab00c0ef0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.215+0000 7fcab5c00700 1 -- 172.21.15.100:0/1766144954 >> 172.21.15.100:0/1766144954 conn(0x7fcab00944d0 msgr2=0x7fcab005e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:46.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.215+0000 7fcab5c00700 1 -- 172.21.15.100:0/1766144954 shutdown_connections 2024-01-22T05:38:46.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.215+0000 7fcab5c00700 1 -- 172.21.15.100:0/1766144954 wait complete. 2024-01-22T05:38:46.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.216+0000 7fcab5c00700 1 Processor -- start 2024-01-22T05:38:46.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.216+0000 7fcab5c00700 1 -- start start 2024-01-22T05:38:46.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcab5c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcab5c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcab00aa4d0 0x7fcab01543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcab5c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcab0153fd0 0x7fcab0159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcab5c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab01556a0 con 0x7fcab00a96e0 2024-01-22T05:38:46.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcab5c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00abe50 con 0x7fcab00aa4d0 2024-01-22T05:38:46.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcab5c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0154e00 con 0x7fcab0153fd0 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcaaea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcaaea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab014dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42510/0 (socket says 172.21.15.100:42510) 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.217+0000 7fcaaea00700 1 -- 172.21.15.100:0/975492126 learned_addr learned my addr 172.21.15.100:0/975492126 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaae000700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcab00aa4d0 0x7fcab01543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaf400700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcab0153fd0 0x7fcab0159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaea00700 1 -- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcab0153fd0 msgr2=0x7fcab0159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaea00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcab0153fd0 0x7fcab0159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaea00700 1 -- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcab00aa4d0 msgr2=0x7fcab01543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaea00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcab00aa4d0 0x7fcab01543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaea00700 1 -- 172.21.15.100:0/975492126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8009a20 con 0x7fcab00a96e0 2024-01-22T05:38:46.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaf400700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcab0153fd0 0x7fcab0159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:46.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaae000700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcab00aa4d0 0x7fcab01543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:46.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaaea00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab014dac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcaa000c440 tx=0x7fcaa0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:46.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaa6000700 1 -- 172.21.15.100:0/975492126 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0007020 con 0x7fcab00a96e0 2024-01-22T05:38:46.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaa6000700 1 -- 172.21.15.100:0/975492126 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa0007180 con 0x7fcab00a96e0 2024-01-22T05:38:46.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab01550e0 con 0x7fcab00a96e0 2024-01-22T05:38:46.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcaa6000700 1 -- 172.21.15.100:0/975492126 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0007520 con 0x7fcab00a96e0 2024-01-22T05:38:46.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.218+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab00b0940 con 0x7fcab00a96e0 2024-01-22T05:38:46.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.220+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab00abc20 con 0x7fcab00a96e0 2024-01-22T05:38:46.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.220+0000 7fcaa6000700 1 -- 172.21.15.100:0/975492126 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcaa00068b0 con 0x7fcab00a96e0 2024-01-22T05:38:46.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.221+0000 7fcaa6000700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fca8805f150 0x7fca88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.221+0000 7fcaa6000700 1 -- 172.21.15.100:0/975492126 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fcaa00795e0 con 0x7fcab00a96e0 2024-01-22T05:38:46.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.221+0000 7fcaae000700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fca8805f150 0x7fca88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.222+0000 7fcaae000700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fca8805f150 0x7fca88061610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fca98007fd0 tx=0x7fca98009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:46.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.225+0000 7fcaa6000700 1 -- 172.21.15.100:0/975492126 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcaa0047b00 con 0x7fcab00a96e0 2024-01-22T05:38:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.448+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcab005fdb0 con 0x7fcab00a96e0 2024-01-22T05:38:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.449+0000 7fcaa6000700 1 -- 172.21.15.100:0/975492126 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7fcab00abc20 con 0x7fcab00a96e0 2024-01-22T05:38:46.450 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:46.450 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1490140396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1490140396},{"type":"v1","addr":"172.21.15.169:6835","nonce":1490140396}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1252144239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1252144239},{"type":"v1","addr":"172.21.15.100:6837","nonce":1252144239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3140978496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3140978496},{"type":"v1","addr":"172.21.15.169:6833","nonce":3140978496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:37:58.683906+0000","modified":"2024-01-22T05:38:01.694679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/1564330749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1564330749},{"type":"v1","addr":"172.21.15.100:6836","nonce":1564330749}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-22T05:38:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fca8805f150 msgr2=0x7fca88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fca8805f150 0x7fca88061610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fca98007fd0 tx=0x7fca98009040).stop 2024-01-22T05:38:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 msgr2=0x7fcab014dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab014dac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcaa000c440 tx=0x7fcaa0007e00).stop 2024-01-22T05:38:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 shutdown_connections 2024-01-22T05:38:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fca8805f150 0x7fca88061610 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcab0153fd0 0x7fcab0159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab00a96e0 0x7fcab014dac0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 --2- 172.21.15.100:0/975492126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcab00aa4d0 0x7fcab01543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 >> 172.21.15.100:0/975492126 conn(0x7fcab00944d0 msgr2=0x7fcab00c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 shutdown_connections 2024-01-22T05:38:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.451+0000 7fcab5c00700 1 -- 172.21.15.100:0/975492126 wait complete. 2024-01-22T05:38:46.457 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-01-22T05:38:46.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:46.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.652+0000 7f90e6200700 1 Processor -- start 2024-01-22T05:38:46.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.652+0000 7f90e6200700 1 -- start start 2024-01-22T05:38:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90e6200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f90e006a290 0x7f90e0153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90e6200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e0065760 con 0x7f90e00a5e90 2024-01-22T05:38:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90e6200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e00bc340 con 0x7f90e00a5ab0 2024-01-22T05:38:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90e6200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e006a780 con 0x7f90e006a290 2024-01-22T05:38:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90d7e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f90e00a5e90 0x7f90e0069b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59032/0 (socket says 172.21.15.100:59032) 2024-01-22T05:38:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90d7e00700 1 -- 172.21.15.100:0/786043338 learned_addr learned my addr 172.21.15.100:0/786043338 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90dfe00700 1 --2- 172.21.15.100:0/786043338 >> v2:172.21.15.169:3300/0 conn(0x7f90e006a290 0x7f90e0153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958864992 0 0) 0x7f90e0065760 con 0x7f90e00a5e90 2024-01-22T05:38:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.654+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90c00033f0 con 0x7f90e00a5e90 2024-01-22T05:38:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019195660 0 0) 0x7f90c00033f0 con 0x7f90e00a5e90 2024-01-22T05:38:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 >> v2:172.21.15.169:3300/0 conn(0x7f90e006a290 msgr2=0x7f90e0153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 --2- 172.21.15.100:0/786043338 >> v2:172.21.15.169:3300/0 conn(0x7f90e006a290 0x7f90e0153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 >> v1:172.21.15.169:6789/0 conn(0x7f90e00a5ab0 legacy=0x7f90e00c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00bba50 con 0x7f90e00a5e90 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f90c8001470 con 0x7f90e00a5e90 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 >> v1:172.21.15.100:6789/0 conn(0x7f90e00a5e90 legacy=0x7f90e0069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90c0004690 0x7f90c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c0005050 0x7f90c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e006a780 con 0x7f90c00038e0 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c000bfe0 con 0x7f90c0005050 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c000c1a0 con 0x7f90c0004690 2024-01-22T05:38:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90df400700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90d7e00700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90c0004690 0x7f90c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dfe00700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c0005050 0x7f90c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90df400700 1 -- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90c0004690 msgr2=0x7f90c0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90df400700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90c0004690 0x7f90c0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90df400700 1 -- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c0005050 msgr2=0x7f90c000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90df400700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c0005050 0x7f90c000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90df400700 1 -- 172.21.15.100:0/786043338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00033f0 con 0x7f90c00038e0 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.655+0000 7f90dfe00700 1 -- 172.21.15.100:0/786043338 reap_dead start 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90df400700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90c0003d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f90d0001700 tx=0x7f90d0007bb0).ready entity=mon.0 client_cookie=57b5aab9d0e1e855 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0007020 con 0x7f90c00038e0 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d0007180 con 0x7f90c00038e0 2024-01-22T05:38:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90dea00700 1 -- 172.21.15.100:0/786043338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0007520 con 0x7f90c00038e0 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90e6200700 1 -- 172.21.15.100:0/786043338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 msgr2=0x7f90c0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90e6200700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90c0003d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f90d0001700 tx=0x7f90d0007bb0).stop 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90e6200700 1 -- 172.21.15.100:0/786043338 shutdown_connections 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90e6200700 1 --2- 172.21.15.100:0/786043338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90c0003d00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90e6200700 1 -- 172.21.15.100:0/786043338 >> 172.21.15.100:0/786043338 conn(0x7f90e0063090 msgr2=0x7f90e00c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90e6200700 1 -- 172.21.15.100:0/786043338 shutdown_connections 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.656+0000 7f90e6200700 1 -- 172.21.15.100:0/786043338 wait complete. 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.658+0000 7f90e6200700 1 Processor -- start 2024-01-22T05:38:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.658+0000 7f90e6200700 1 -- start start 2024-01-22T05:38:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90e6200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90e0161560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90e6200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90e01603b0 0x7f90e00a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90e6200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90e0163110 0x7f90e00c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90e6200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00a9a80 con 0x7f90c00038e0 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90e6200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00a8d20 con 0x7f90e0163110 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90e6200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e01609e0 con 0x7f90e01603b0 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90e0161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90e0161560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42524/0 (socket says 172.21.15.100:42524) 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 -- 172.21.15.100:0/290162575 learned_addr learned my addr 172.21.15.100:0/290162575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 -- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90e01603b0 msgr2=0x7f90e00a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90e01603b0 0x7f90e00a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90dfe00700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90e0163110 0x7f90e00c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 -- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90e0163110 msgr2=0x7f90e00c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90e0163110 0x7f90e00c0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90df400700 1 -- 172.21.15.100:0/290162575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0160cc0 con 0x7f90c00038e0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.659+0000 7f90dfe00700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90e0163110 0x7f90e00c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.660+0000 7f90df400700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90e0161560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f90d0001cf0 tx=0x7f90d0018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.660+0000 7f90d6a00700 1 -- 172.21.15.100:0/290162575 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00104a0 con 0x7f90c00038e0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.660+0000 7f90d6a00700 1 -- 172.21.15.100:0/290162575 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d0010600 con 0x7f90c00038e0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.660+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e00a9a80 con 0x7f90c00038e0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.660+0000 7f90d6a00700 1 -- 172.21.15.100:0/290162575 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00109c0 con 0x7f90c00038e0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.660+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e0161280 con 0x7f90c00038e0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.661+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e005fdb0 con 0x7f90c00038e0 2024-01-22T05:38:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.662+0000 7f90d6a00700 1 -- 172.21.15.100:0/290162575 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f90d0011470 con 0x7f90c00038e0 2024-01-22T05:38:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.663+0000 7f90d6a00700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f90b805f120 0x7f90b80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.663+0000 7f90d6a00700 1 -- 172.21.15.100:0/290162575 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f90d007cf80 con 0x7f90c00038e0 2024-01-22T05:38:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.663+0000 7f90d7e00700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f90b805f120 0x7f90b80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.663+0000 7f90d7e00700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f90b805f120 0x7f90b80615e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f90c80015a0 tx=0x7f90e00bbbe0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.667+0000 7f90d6a00700 1 -- 172.21.15.100:0/290162575 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f90d004e110 con 0x7f90c00038e0 2024-01-22T05:38:46.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.841+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e00656c0 con 0x7f90c00038e0 2024-01-22T05:38:46.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.842+0000 7f90d6a00700 1 -- 172.21.15.100:0/290162575 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17025 (secure 0 0 0) 0x7f90d002a020 con 0x7f90c00038e0 2024-01-22T05:38:46.842 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:46.843 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:38:46.273432+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:37:56.837820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-22T05:37:57.667310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f90b805f120 msgr2=0x7f90b80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f90b805f120 0x7f90b80615e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f90c80015a0 tx=0x7f90e00bbbe0).stop 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 msgr2=0x7f90e0161560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90e0161560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f90d0001cf0 tx=0x7f90d0018000).stop 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 shutdown_connections 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f90b805f120 0x7f90b80615e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90e0163110 0x7f90e00c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c00038e0 0x7f90e0161560 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 --2- 172.21.15.100:0/290162575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90e01603b0 0x7f90e00a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.844+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 >> 172.21.15.100:0/290162575 conn(0x7f90e0063090 msgr2=0x7f90e014e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.845+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 shutdown_connections 2024-01-22T05:38:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:46.845+0000 7f90e6200700 1 -- 172.21.15.100:0/290162575 wait complete. 2024-01-22T05:38:46.863 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:38:47.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.047+0000 7fbda6e00700 1 Processor -- start 2024-01-22T05:38:47.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.047+0000 7fbda6e00700 1 -- start start 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbda6e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbda0154260 0x7fbda00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbda6e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbda00c5c80 0x7fbda00c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbda6e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 0x7fbda0157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbda6e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda00c1a40 con 0x7fbda0154260 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbda6e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda00cbd30 con 0x7fbda00c5c80 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbda6e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00c6a80 con 0x7fbda00c65f0 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbd9fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbda0154260 0x7fbda00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbd9fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbda0154260 0x7fbda00cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42532/0 (socket says 172.21.15.100:42532) 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbd9fe00700 1 -- 172.21.15.100:0/2809282647 learned_addr learned my addr 172.21.15.100:0/2809282647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.048+0000 7fbda4e00700 1 --2- 172.21.15.100:0/2809282647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 0x7fbda0157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9f400700 1 --2- 172.21.15.100:0/2809282647 >> v2:172.21.15.169:3300/0 conn(0x7fbda00c5c80 0x7fbda00c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9fe00700 1 -- 172.21.15.100:0/2809282647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 msgr2=0x7fbda0157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9fe00700 1 --2- 172.21.15.100:0/2809282647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 0x7fbda0157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9fe00700 1 -- 172.21.15.100:0/2809282647 >> v2:172.21.15.169:3300/0 conn(0x7fbda00c5c80 msgr2=0x7fbda00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9fe00700 1 --2- 172.21.15.100:0/2809282647 >> v2:172.21.15.169:3300/0 conn(0x7fbda00c5c80 0x7fbda00c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9fe00700 1 -- 172.21.15.100:0/2809282647 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00c1110 con 0x7fbda0154260 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9fe00700 1 --2- 172.21.15.100:0/2809282647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda0154260 0x7fbda00cb4e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fbda0083230 tx=0x7fbd90009060).ready entity=mon.0 client_cookie=d1b503443f01a20 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9ea00700 1 -- 172.21.15.100:0/2809282647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90005880 con 0x7fbda0154260 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9ea00700 1 -- 172.21.15.100:0/2809282647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd900059e0 con 0x7fbda0154260 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.049+0000 7fbd9ea00700 1 -- 172.21.15.100:0/2809282647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90005d60 con 0x7fbda0154260 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 -- 172.21.15.100:0/2809282647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda0154260 msgr2=0x7fbda00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 --2- 172.21.15.100:0/2809282647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda0154260 0x7fbda00cb4e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fbda0083230 tx=0x7fbd90009060).stop 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 -- 172.21.15.100:0/2809282647 shutdown_connections 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 --2- 172.21.15.100:0/2809282647 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 0x7fbda0157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 --2- 172.21.15.100:0/2809282647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda0154260 0x7fbda00cb4e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 --2- 172.21.15.100:0/2809282647 >> v2:172.21.15.169:3300/0 conn(0x7fbda00c5c80 0x7fbda00c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 -- 172.21.15.100:0/2809282647 >> 172.21.15.100:0/2809282647 conn(0x7fbda005e9d0 msgr2=0x7fbda00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:47.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 -- 172.21.15.100:0/2809282647 shutdown_connections 2024-01-22T05:38:47.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.050+0000 7fbda6e00700 1 -- 172.21.15.100:0/2809282647 wait complete. 2024-01-22T05:38:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.051+0000 7fbda6e00700 1 Processor -- start 2024-01-22T05:38:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.051+0000 7fbda6e00700 1 -- start start 2024-01-22T05:38:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.052+0000 7fbda6e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda00c5c80 0x7fbda01492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.052+0000 7fbda6e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 0x7fbda014be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.052+0000 7fbda6e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda0154260 0x7fbda00c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.052+0000 7fbda6e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda014c2f0 con 0x7fbda00c5c80 2024-01-22T05:38:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.052+0000 7fbda6e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00c34d0 con 0x7fbda0154260 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.052+0000 7fbda6e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00aa950 con 0x7fbda00c65f0 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda00c5c80 0x7fbda01492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda00c5c80 0x7fbda01492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42542/0 (socket says 172.21.15.100:42542) 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 -- 172.21.15.100:0/717503363 learned_addr learned my addr 172.21.15.100:0/717503363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 -- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 msgr2=0x7fbda014be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 0x7fbda014be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 -- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda0154260 msgr2=0x7fbda00c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbda4e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda0154260 0x7fbda00c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda0154260 0x7fbda00c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 -- 172.21.15.100:0/717503363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90009300 con 0x7fbda00c5c80 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbda4e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda0154260 0x7fbda00c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd9fe00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda00c5c80 0x7fbda01492f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fbda0083620 tx=0x7fbd90016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd97400700 1 -- 172.21.15.100:0/717503363 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90005880 con 0x7fbda00c5c80 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd97400700 1 -- 172.21.15.100:0/717503363 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9000b810 con 0x7fbda00c5c80 2024-01-22T05:38:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda00aac30 con 0x7fbda00c5c80 2024-01-22T05:38:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.053+0000 7fbd97400700 1 -- 172.21.15.100:0/717503363 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9000bb90 con 0x7fbda00c5c80 2024-01-22T05:38:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.054+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda00ab1f0 con 0x7fbda00c5c80 2024-01-22T05:38:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.055+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda005fdb0 con 0x7fbda00c5c80 2024-01-22T05:38:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.055+0000 7fbd97400700 1 -- 172.21.15.100:0/717503363 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbd90026460 con 0x7fbda00c5c80 2024-01-22T05:38:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.056+0000 7fbd97400700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd7805f150 0x7fbd78061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.056+0000 7fbd97400700 1 -- 172.21.15.100:0/717503363 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fbd9007b7f0 con 0x7fbda00c5c80 2024-01-22T05:38:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.056+0000 7fbd9f400700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd7805f150 0x7fbd78061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.057+0000 7fbd9f400700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd7805f150 0x7fbd78061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fbda00ca790 tx=0x7fbd88008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:47.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.060+0000 7fbd97400700 1 -- 172.21.15.100:0/717503363 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbd9004c980 con 0x7fbda00c5c80 2024-01-22T05:38:47.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.272+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbda00c13f0 con 0x7fbda00c5c80 2024-01-22T05:38:47.280 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-22T05:38:47.278+0000 7f8b0ae00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:38:47.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.288+0000 7fbd97400700 1 -- 172.21.15.100:0/717503363 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbd9004ffa0 con 0x7fbda00c5c80 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.290+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd7805f150 msgr2=0x7fbd78061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.290+0000 7fbda6e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd7805f150 0x7fbd78061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fbda00ca790 tx=0x7fbd88008040).stop 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda00c5c80 msgr2=0x7fbda01492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda00c5c80 0x7fbda01492f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fbda0083620 tx=0x7fbd90016000).stop 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 shutdown_connections 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd7805f150 0x7fbd78061610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda0154260 0x7fbda00c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbda00c5c80 0x7fbda01492f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 --2- 172.21.15.100:0/717503363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbda00c65f0 0x7fbda014be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 >> 172.21.15.100:0/717503363 conn(0x7fbda005e9d0 msgr2=0x7fbda0063dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 shutdown_connections 2024-01-22T05:38:47.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.291+0000 7fbda6e00700 1 -- 172.21.15.100:0/717503363 wait complete. 2024-01-22T05:38:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:38:47.295 INFO:tasks.ceph.mds.a.smithi100.stderr: -2752> 2024-01-22T05:37:59.383+0000 7f2277800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:38:47.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:38:47.336 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-22T05:38:47.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.496+0000 7f3318e00700 1 Processor -- start 2024-01-22T05:38:47.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.496+0000 7f3318e00700 1 -- start start 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3318e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3314154040 0x7f33140c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3318e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3314154420 0x7f33140c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3318e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3314064830 con 0x7f33140bbd80 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3318e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140c1e00 con 0x7f3314154040 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3318e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3314064b10 con 0x7f3314154420 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3311e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3314154040 0x7f33140c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3312800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f33140bbd80 0x7f3314157d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59036/0 (socket says 172.21.15.100:59036) 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3312800700 1 -- 172.21.15.100:0/3970333109 learned_addr learned my addr 172.21.15.100:0/3970333109 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3311400700 1 --2- 172.21.15.100:0/3970333109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3314154420 0x7f33140c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3311e00700 1 -- 172.21.15.100:0/3970333109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3314154420 msgr2=0x7f33140c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3311e00700 1 --2- 172.21.15.100:0/3970333109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3314154420 0x7f33140c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3311e00700 1 -- 172.21.15.100:0/3970333109 >> v1:172.21.15.100:6789/0 conn(0x7f33140bbd80 legacy=0x7f3314157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.498+0000 7f3310a00700 1 -- 172.21.15.100:0/3970333109 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085785655 0 0) 0x7f3314064830 con 0x7f33140bbd80 2024-01-22T05:38:47.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.499+0000 7f3311e00700 1 -- 172.21.15.100:0/3970333109 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140bd010 con 0x7f3314154040 2024-01-22T05:38:47.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.499+0000 7f3311e00700 1 --2- 172.21.15.100:0/3970333109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f33140c1420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f3304009760 tx=0x7f3304009060).ready entity=mon.0 client_cookie=e8678423268ddba4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:47.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.499+0000 7f3310a00700 1 -- 172.21.15.100:0/3970333109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400b580 con 0x7f3314154040 2024-01-22T05:38:47.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.499+0000 7f3310a00700 1 -- 172.21.15.100:0/3970333109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400b6e0 con 0x7f3314154040 2024-01-22T05:38:47.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.499+0000 7f3310a00700 1 -- 172.21.15.100:0/3970333109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400ba60 con 0x7f3314154040 2024-01-22T05:38:47.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.499+0000 7f3318e00700 1 -- 172.21.15.100:0/3970333109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 msgr2=0x7f33140c1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.499+0000 7f3318e00700 1 --2- 172.21.15.100:0/3970333109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f33140c1420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f3304009760 tx=0x7f3304009060).stop 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.500+0000 7f3318e00700 1 -- 172.21.15.100:0/3970333109 shutdown_connections 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.500+0000 7f3318e00700 1 --2- 172.21.15.100:0/3970333109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f33140c1420 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.500+0000 7f3318e00700 1 --2- 172.21.15.100:0/3970333109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3314154420 0x7f33140c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.500+0000 7f3318e00700 1 -- 172.21.15.100:0/3970333109 >> 172.21.15.100:0/3970333109 conn(0x7f33140c6e20 msgr2=0x7f33140c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.500+0000 7f3318e00700 1 -- 172.21.15.100:0/3970333109 shutdown_connections 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.500+0000 7f3318e00700 1 -- 172.21.15.100:0/3970333109 wait complete. 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.501+0000 7f3318e00700 1 Processor -- start 2024-01-22T05:38:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.501+0000 7f3318e00700 1 -- start start 2024-01-22T05:38:47.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.502+0000 7f3318e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33140bbd80 0x7f33140a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.502+0000 7f3318e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f3314152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.502+0000 7f3318e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3314154420 0x7f33140c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.502+0000 7f3318e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314153540 con 0x7f3314154040 2024-01-22T05:38:47.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.502+0000 7f3318e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33141565d0 con 0x7f3314154420 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.502+0000 7f3318e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3314152fd0 con 0x7f33140bbd80 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.502+0000 7f3311400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f3314152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f3314152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42576/0 (socket says 172.21.15.100:42576) 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 -- 172.21.15.100:0/5820553 learned_addr learned my addr 172.21.15.100:0/5820553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33140bbd80 0x7f33140a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3312800700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3314154420 0x7f33140c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 -- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33140bbd80 msgr2=0x7f33140a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33140bbd80 0x7f33140a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 -- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3314154420 msgr2=0x7f33140c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:47.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3314154420 0x7f33140c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 -- 172.21.15.100:0/5820553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040092a0 con 0x7f3314154040 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3312800700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3314154420 0x7f33140c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3311400700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f3314152ae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f32fc00d890 tx=0x7f32fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3309600700 1 -- 172.21.15.100:0/5820553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0125f0 con 0x7f3314154040 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3309600700 1 -- 172.21.15.100:0/5820553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc012750 con 0x7f3314154040 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3314155ce0 con 0x7f3314154040 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.503+0000 7f3309600700 1 -- 172.21.15.100:0/5820553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc012ad0 con 0x7f3314154040 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.504+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3314155f80 con 0x7f3314154040 2024-01-22T05:38:47.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.504+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3314156780 con 0x7f3314154040 2024-01-22T05:38:47.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.505+0000 7f3309600700 1 -- 172.21.15.100:0/5820553 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f32fc013480 con 0x7f3314154040 2024-01-22T05:38:47.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.506+0000 7f3309600700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f32ec05f180 0x7f32ec061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:47.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.506+0000 7f3309600700 1 -- 172.21.15.100:0/5820553 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6236+0+0 (secure 0 0 0) 0x7f32fc07a650 con 0x7f3314154040 2024-01-22T05:38:47.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.506+0000 7f3311e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f32ec05f180 0x7f32ec061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:47.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.507+0000 7f3311e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f32ec05f180 0x7f32ec061640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f330400b340 tx=0x7f3304017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:47.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.510+0000 7f3309600700 1 -- 172.21.15.100:0/5820553 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3314156780 con 0x7f3314154040 2024-01-22T05:38:47.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:47.719+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3314156780 con 0x7f3314154040 2024-01-22T05:38:48.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.289+0000 7f3309600700 1 -- 172.21.15.100:0/5820553 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3314156780 con 0x7f3314154040 2024-01-22T05:38:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.291+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f32ec05f180 msgr2=0x7f32ec061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.291+0000 7f3318e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f32ec05f180 0x7f32ec061640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f330400b340 tx=0x7f3304017000).stop 2024-01-22T05:38:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.291+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 msgr2=0x7f3314152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.291+0000 7f3318e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f3314152ae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f32fc00d890 tx=0x7f32fc008040).stop 2024-01-22T05:38:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 shutdown_connections 2024-01-22T05:38:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f32ec05f180 0x7f32ec061640 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3314154420 0x7f33140c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33140bbd80 0x7f33140a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 --2- 172.21.15.100:0/5820553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3314154040 0x7f3314152ae0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 >> 172.21.15.100:0/5820553 conn(0x7f33140c6e20 msgr2=0x7f33140a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 shutdown_connections 2024-01-22T05:38:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.292+0000 7f3318e00700 1 -- 172.21.15.100:0/5820553 wait complete. 2024-01-22T05:38:48.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:38:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.539+0000 7fcef1800700 1 Processor -- start 2024-01-22T05:38:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.540+0000 7fcef1800700 1 -- start start 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fcef1800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fceec0a9f60 0x7fceec0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fcef1800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec0c1940 0x7fceec0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fcef1800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fceec05e1f0 0x7fceec05e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fcef1800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0c74b0 con 0x7fceec05e1f0 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fcef1800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0cab90 con 0x7fceec0a9f60 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fcef1800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec05eb70 con 0x7fceec0c1940 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fceeb400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fceec05e1f0 0x7fceec05e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fceeb400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fceec05e1f0 0x7fceec05e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42580/0 (socket says 172.21.15.100:42580) 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fceeb400700 1 -- 172.21.15.100:0/725907465 learned_addr learned my addr 172.21.15.100:0/725907465 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fceeaa00700 1 --2- 172.21.15.100:0/725907465 >> v2:172.21.15.169:3300/0 conn(0x7fceec0a9f60 0x7fceec0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.541+0000 7fceea000700 1 --2- 172.21.15.100:0/725907465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec0c1940 0x7fceec0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fceeb400700 1 -- 172.21.15.100:0/725907465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec0c1940 msgr2=0x7fceec0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fceeb400700 1 --2- 172.21.15.100:0/725907465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec0c1940 0x7fceec0ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fceeb400700 1 -- 172.21.15.100:0/725907465 >> v2:172.21.15.169:3300/0 conn(0x7fceec0a9f60 msgr2=0x7fceec0aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fceeb400700 1 --2- 172.21.15.100:0/725907465 >> v2:172.21.15.169:3300/0 conn(0x7fceec0a9f60 0x7fceec0aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fceeb400700 1 -- 172.21.15.100:0/725907465 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec158660 con 0x7fceec05e1f0 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fceeaa00700 1 --2- 172.21.15.100:0/725907465 >> v2:172.21.15.169:3300/0 conn(0x7fceec0a9f60 0x7fceec0aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fceeb400700 1 --2- 172.21.15.100:0/725907465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec05e1f0 0x7fceec05e680 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fceec0c8850 tx=0x7fcee4009840).ready entity=mon.0 client_cookie=d7585ea277fbefda server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fcee9600700 1 -- 172.21.15.100:0/725907465 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400e070 con 0x7fceec05e1f0 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fcee9600700 1 -- 172.21.15.100:0/725907465 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee400ba20 con 0x7fceec05e1f0 2024-01-22T05:38:48.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.542+0000 7fcee9600700 1 -- 172.21.15.100:0/725907465 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400bda0 con 0x7fceec05e1f0 2024-01-22T05:38:48.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 -- 172.21.15.100:0/725907465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec05e1f0 msgr2=0x7fceec05e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:48.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 --2- 172.21.15.100:0/725907465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec05e1f0 0x7fceec05e680 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fceec0c8850 tx=0x7fcee4009840).stop 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 -- 172.21.15.100:0/725907465 shutdown_connections 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 --2- 172.21.15.100:0/725907465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec05e1f0 0x7fceec05e680 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 --2- 172.21.15.100:0/725907465 >> v2:172.21.15.169:3300/0 conn(0x7fceec0a9f60 0x7fceec0aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 --2- 172.21.15.100:0/725907465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec0c1940 0x7fceec0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 -- 172.21.15.100:0/725907465 >> 172.21.15.100:0/725907465 conn(0x7fceec0cada0 msgr2=0x7fceec0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 -- 172.21.15.100:0/725907465 shutdown_connections 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.543+0000 7fcef1800700 1 -- 172.21.15.100:0/725907465 wait complete. 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.544+0000 7fcef1800700 1 Processor -- start 2024-01-22T05:38:48.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.544+0000 7fcef1800700 1 -- start start 2024-01-22T05:38:48.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.545+0000 7fcef1800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec05e1f0 0x7fceec158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.545+0000 7fcef1800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceec0a9f60 0x7fceec1681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.545+0000 7fcef1800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0c1940 0x7fceec152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.545+0000 7fcef1800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec098a70 con 0x7fceec0c1940 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.545+0000 7fcef1800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec159f20 con 0x7fceec0a9f60 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.545+0000 7fcef1800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec1686c0 con 0x7fceec05e1f0 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0c1940 0x7fceec152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0c1940 0x7fceec152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42594/0 (socket says 172.21.15.100:42594) 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 -- 172.21.15.100:0/326923500 learned_addr learned my addr 172.21.15.100:0/326923500 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceea000700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceec0a9f60 0x7fceec1681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 -- 172.21.15.100:0/326923500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec05e1f0 msgr2=0x7fceec158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec05e1f0 0x7fceec158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 -- 172.21.15.100:0/326923500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceec0a9f60 msgr2=0x7fceec1681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceec0a9f60 0x7fceec1681d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 -- 172.21.15.100:0/326923500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4009ae0 con 0x7fceec0c1940 2024-01-22T05:38:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fceeb400700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0c1940 0x7fceec152210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fcee400b6c0 tx=0x7fcee4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fcee2000700 1 -- 172.21.15.100:0/326923500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400bda0 con 0x7fceec0c1940 2024-01-22T05:38:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fcee2000700 1 -- 172.21.15.100:0/326923500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee40032f0 con 0x7fceec0c1940 2024-01-22T05:38:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec159310 con 0x7fceec0c1940 2024-01-22T05:38:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.546+0000 7fcee2000700 1 -- 172.21.15.100:0/326923500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee401d6b0 con 0x7fceec0c1940 2024-01-22T05:38:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.547+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec1598d0 con 0x7fceec0c1940 2024-01-22T05:38:48.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.548+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec0cbd60 con 0x7fceec0c1940 2024-01-22T05:38:48.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.548+0000 7fcee2000700 1 -- 172.21.15.100:0/326923500 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcee4003040 con 0x7fceec0c1940 2024-01-22T05:38:48.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.549+0000 7fcee2000700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcec405f150 0x7fcec4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:48.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.549+0000 7fcee2000700 1 -- 172.21.15.100:0/326923500 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6236+0+0 (secure 0 0 0) 0x7fcee407b620 con 0x7fceec0c1940 2024-01-22T05:38:48.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.549+0000 7fceeaa00700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcec405f150 0x7fcec4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:48.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.550+0000 7fceeaa00700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcec405f150 0x7fcec4061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fcedc006d80 tx=0x7fcedc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:48.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.553+0000 7fcee2000700 1 -- 172.21.15.100:0/326923500 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fceec0cbd60 con 0x7fceec0c1940 2024-01-22T05:38:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:48.725+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fceec0cbd60 con 0x7fceec0c1940 2024-01-22T05:38:49.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.299+0000 7fcee2000700 1 -- 172.21.15.100:0/326923500 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fceec0cbd60 con 0x7fceec0c1940 2024-01-22T05:38:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcec405f150 msgr2=0x7fcec4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcec405f150 0x7fcec4061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fcedc006d80 tx=0x7fcedc008040).stop 2024-01-22T05:38:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0c1940 msgr2=0x7fceec152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0c1940 0x7fceec152210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fcee400b6c0 tx=0x7fcee4009840).stop 2024-01-22T05:38:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 shutdown_connections 2024-01-22T05:38:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcec405f150 0x7fcec4061610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0c1940 0x7fceec152210 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceec05e1f0 0x7fceec158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 --2- 172.21.15.100:0/326923500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceec0a9f60 0x7fceec1681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.302+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 >> 172.21.15.100:0/326923500 conn(0x7fceec0cada0 msgr2=0x7fceec157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.303+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 shutdown_connections 2024-01-22T05:38:49.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.303+0000 7fcef1800700 1 -- 172.21.15.100:0/326923500 wait complete. 2024-01-22T05:38:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:38:49.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:38:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.520+0000 7f7630c00700 1 Processor -- start 2024-01-22T05:38:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.520+0000 7f7630c00700 1 -- start start 2024-01-22T05:38:49.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.521+0000 7f7630c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f762c157670 0x7f762c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:49.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.521+0000 7f7630c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f762c0c5960 0x7f762c0c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:49.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.521+0000 7f7630c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c065000 con 0x7f762c157290 2024-01-22T05:38:49.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.521+0000 7f7630c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c0c5df0 con 0x7f762c157670 2024-01-22T05:38:49.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.521+0000 7f7630c00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c092820 con 0x7f762c0c5960 2024-01-22T05:38:49.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f762c157290 0x7f762c092110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59048/0 (socket says 172.21.15.100:59048) 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629e00700 1 -- 172.21.15.100:0/2628160243 learned_addr learned my addr 172.21.15.100:0/2628160243 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629400700 1 --2- 172.21.15.100:0/2628160243 >> v2:172.21.15.100:3300/0 conn(0x7f762c157670 0x7f762c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f762a800700 1 --2- 172.21.15.100:0/2628160243 >> v2:172.21.15.169:3300/0 conn(0x7f762c0c5960 0x7f762c0c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7628a00700 1 -- 172.21.15.100:0/2628160243 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125794382 0 0) 0x7f762c065000 con 0x7f762c157290 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7628a00700 1 -- 172.21.15.100:0/2628160243 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f760c0033f0 con 0x7f762c157290 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629400700 1 -- 172.21.15.100:0/2628160243 >> v2:172.21.15.169:3300/0 conn(0x7f762c0c5960 msgr2=0x7f762c0c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629400700 1 --2- 172.21.15.100:0/2628160243 >> v2:172.21.15.169:3300/0 conn(0x7f762c0c5960 0x7f762c0c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629400700 1 -- 172.21.15.100:0/2628160243 >> v1:172.21.15.100:6789/0 conn(0x7f762c157290 legacy=0x7f762c092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:49.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629400700 1 -- 172.21.15.100:0/2628160243 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0643f0 con 0x7f762c157670 2024-01-22T05:38:49.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.522+0000 7f7629400700 1 --2- 172.21.15.100:0/2628160243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c0c5470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f762c0c8b50 tx=0x7f7614009060).ready entity=mon.0 client_cookie=5fe5163f729c55d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:49.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7628a00700 1 -- 172.21.15.100:0/2628160243 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761400d4a0 con 0x7f762c157670 2024-01-22T05:38:49.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7628a00700 1 -- 172.21.15.100:0/2628160243 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761400d600 con 0x7f762c157670 2024-01-22T05:38:49.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7628a00700 1 -- 172.21.15.100:0/2628160243 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761400d980 con 0x7f762c157670 2024-01-22T05:38:49.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 -- 172.21.15.100:0/2628160243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 msgr2=0x7f762c0c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:49.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 --2- 172.21.15.100:0/2628160243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c0c5470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f762c0c8b50 tx=0x7f7614009060).stop 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 -- 172.21.15.100:0/2628160243 shutdown_connections 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 --2- 172.21.15.100:0/2628160243 >> v2:172.21.15.169:3300/0 conn(0x7f762c0c5960 0x7f762c0c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 --2- 172.21.15.100:0/2628160243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c0c5470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 -- 172.21.15.100:0/2628160243 >> 172.21.15.100:0/2628160243 conn(0x7f762c05e9d0 msgr2=0x7f762c091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 -- 172.21.15.100:0/2628160243 shutdown_connections 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.523+0000 7f7630c00700 1 -- 172.21.15.100:0/2628160243 wait complete. 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.525+0000 7f7630c00700 1 Processor -- start 2024-01-22T05:38:49.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.525+0000 7f7630c00700 1 -- start start 2024-01-22T05:38:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7630c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f762c0c5960 0x7f762c145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:49.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7630c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f762c157290 0x7f762c0bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7630c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7630c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0aae20 con 0x7f762c157670 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7630c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ab100 con 0x7f762c157290 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7630c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ab3e0 con 0x7f762c0c5960 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f762a800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f762a800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c067ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42612/0 (socket says 172.21.15.100:42612) 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f762a800700 1 -- 172.21.15.100:0/2463913738 learned_addr learned my addr 172.21.15.100:0/2463913738 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7629e00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f762c0c5960 0x7f762c145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f7629400700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f762c157290 0x7f762c0bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f762a800700 1 -- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f762c0c5960 msgr2=0x7f762c145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:49.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.526+0000 7f762a800700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f762c0c5960 0x7f762c145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f762a800700 1 -- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f762c157290 msgr2=0x7f762c0bfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f762a800700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f762c157290 0x7f762c0bfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f762a800700 1 -- 172.21.15.100:0/2463913738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140092a0 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f7629400700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f762c157290 0x7f762c0bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f762a800700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c067ad0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7624009e90 tx=0x7f762400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f7621600700 1 -- 172.21.15.100:0/2463913738 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762400cc20 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f7621600700 1 -- 172.21.15.100:0/2463913738 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762400f040 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c0c0530 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f7621600700 1 -- 172.21.15.100:0/2463913738 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624013400 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.527+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c145f10 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.528+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c05fdb0 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.529+0000 7f7621600700 1 -- 172.21.15.100:0/2463913738 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f76240137b0 con 0x7f762c157670 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.530+0000 7f7621600700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f760405f180 0x7f7604061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:49.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.530+0000 7f7621600700 1 -- 172.21.15.100:0/2463913738 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f762407a920 con 0x7f762c157670 2024-01-22T05:38:49.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.530+0000 7f7629e00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f760405f180 0x7f7604061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:49.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.530+0000 7f7629e00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f760405f180 0x7f7604061640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f761c005750 tx=0x7f761c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:49.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.535+0000 7f7621600700 1 -- 172.21.15.100:0/2463913738 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f762404bd50 con 0x7f762c157670 2024-01-22T05:38:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:49.704+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f762c0646d0 con 0x7f762c157670 2024-01-22T05:38:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.305+0000 7f7621600700 1 -- 172.21.15.100:0/2463913738 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f762404f370 con 0x7f762c157670 2024-01-22T05:38:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f760405f180 msgr2=0x7f7604061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f760405f180 0x7f7604061640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f761c005750 tx=0x7f761c009040).stop 2024-01-22T05:38:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 msgr2=0x7f762c067ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c067ad0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7624009e90 tx=0x7f762400b040).stop 2024-01-22T05:38:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 shutdown_connections 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f760405f180 0x7f7604061640 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f762c157670 0x7f762c067ad0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f762c0c5960 0x7f762c145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 --2- 172.21.15.100:0/2463913738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f762c157290 0x7f762c0bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 >> 172.21.15.100:0/2463913738 conn(0x7f762c05e9d0 msgr2=0x7f762c1548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 shutdown_connections 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.307+0000 7f7630c00700 1 -- 172.21.15.100:0/2463913738 wait complete. 2024-01-22T05:38:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-01-22T05:38:50.327 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:38:50.327 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:38:50.328 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:38:50.328 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:38:50.328 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:38:50.328 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:38:50.328 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:38:50.328 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:38:50.328 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:38:50.329 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:38:50.329 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:38:50.329 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:38:50.329 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:38:50.329 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:38:50.329 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:38:50.329 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:38:50.344 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:38:50.344 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:38:50.345 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:38:50.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:38:50.348 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:38:50.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:38:50.349 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:38:50.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:38:50.388 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:38:50.388 DEBUG:teuthology.parallel:result is None 2024-01-22T05:38:50.390 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:38:50.390 DEBUG:teuthology.parallel:result is None 2024-01-22T05:38:50.393 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:38:50.393 DEBUG:teuthology.parallel:result is None 2024-01-22T05:38:50.395 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:38:50.395 DEBUG:teuthology.parallel:result is None 2024-01-22T05:38:50.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:38:50.530 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-22T05:38:50.530 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-22T05:38:50.535 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-01-22T05:38:50.535 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-01-22T05:38:50.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.605+0000 7f2707c00700 1 Processor -- start 2024-01-22T05:38:50.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.605+0000 7f2707c00700 1 -- start start 2024-01-22T05:38:50.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2707c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2700138440 0x7f27000681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2707c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138820 0x7f27000686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2707c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2700064520 con 0x7f27000c5120 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2707c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2700064e30 con 0x7f2700138440 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2707c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2700068bc0 con 0x7f2700138820 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2705200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2700138440 0x7f27000681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2705c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f27000c5120 0x7f27000c5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59058/0 (socket says 172.21.15.100:59058) 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2705c00700 1 -- 172.21.15.100:0/3174990159 learned_addr learned my addr 172.21.15.100:0/3174990159 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2705200700 1 -- 172.21.15.100:0/3174990159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138820 msgr2=0x7f27000686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f26ffe00700 1 --2- 172.21.15.100:0/3174990159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138820 0x7f27000686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2705200700 1 --2- 172.21.15.100:0/3174990159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138820 0x7f27000686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f26ff400700 1 -- 172.21.15.100:0/3174990159 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816235519 0 0) 0x7f2700064520 con 0x7f27000c5120 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2705200700 1 -- 172.21.15.100:0/3174990159 >> v1:172.21.15.100:6789/0 conn(0x7f27000c5120 legacy=0x7f27000c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f2705200700 1 -- 172.21.15.100:0/3174990159 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000c5e50 con 0x7f2700138440 2024-01-22T05:38:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.607+0000 7f26ffe00700 1 --2- 172.21.15.100:0/3174990159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138820 0x7f27000686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2705200700 1 --2- 172.21.15.100:0/3174990159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2700138440 0x7f27000681e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f26f0009760 tx=0x7f26f0009060).ready entity=mon.0 client_cookie=a79b80dd05e68cc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f26ff400700 1 -- 172.21.15.100:0/3174990159 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00090d0 con 0x7f2700138440 2024-01-22T05:38:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f26ff400700 1 -- 172.21.15.100:0/3174990159 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000b580 con 0x7f2700138440 2024-01-22T05:38:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f26ff400700 1 -- 172.21.15.100:0/3174990159 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000b900 con 0x7f2700138440 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 -- 172.21.15.100:0/3174990159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2700138440 msgr2=0x7f27000681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 --2- 172.21.15.100:0/3174990159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2700138440 0x7f27000681e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f26f0009760 tx=0x7f26f0009060).stop 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 -- 172.21.15.100:0/3174990159 shutdown_connections 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 --2- 172.21.15.100:0/3174990159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2700138440 0x7f27000681e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 --2- 172.21.15.100:0/3174990159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138820 0x7f27000686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 -- 172.21.15.100:0/3174990159 >> 172.21.15.100:0/3174990159 conn(0x7f27000630c0 msgr2=0x7f27000c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 -- 172.21.15.100:0/3174990159 shutdown_connections 2024-01-22T05:38:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.608+0000 7f2707c00700 1 -- 172.21.15.100:0/3174990159 wait complete. 2024-01-22T05:38:50.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.610+0000 7f2707c00700 1 Processor -- start 2024-01-22T05:38:50.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.610+0000 7f2707c00700 1 -- start start 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2707c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c5120 0x7f27000a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2707c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138440 0x7f2700137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2707c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2700138820 0x7f27001672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2707c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000a5270 con 0x7f27000c5120 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2707c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000c3000 con 0x7f2700138820 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2707c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2700137b10 con 0x7f2700138440 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2705200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c5120 0x7f27000a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2705200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c5120 0x7f27000a4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42660/0 (socket says 172.21.15.100:42660) 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.611+0000 7f2705200700 1 -- 172.21.15.100:0/3748639363 learned_addr learned my addr 172.21.15.100:0/3748639363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2705c00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2700138820 0x7f27001672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f26ffe00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138440 0x7f2700137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2705200700 1 -- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138440 msgr2=0x7f2700137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:50.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2705200700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138440 0x7f2700137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2705200700 1 -- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2700138820 msgr2=0x7f27001672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2705200700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2700138820 0x7f27001672a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2705200700 1 -- 172.21.15.100:0/3748639363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f00092a0 con 0x7f27000c5120 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f26ffe00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138440 0x7f2700137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2705200700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c5120 0x7f27000a4d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f26f0009eb0 tx=0x7f26f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f26f7e00700 1 -- 172.21.15.100:0/3748639363 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000b6f0 con 0x7f27000c5120 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f26f7e00700 1 -- 172.21.15.100:0/3748639363 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000b850 con 0x7f27000c5120 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27000a79c0 con 0x7f27000c5120 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f26f7e00700 1 -- 172.21.15.100:0/3748639363 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f001b410 con 0x7f27000c5120 2024-01-22T05:38:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.612+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27000c0610 con 0x7f27000c5120 2024-01-22T05:38:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.613+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270005fdb0 con 0x7f27000c5120 2024-01-22T05:38:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.614+0000 7f26f7e00700 1 -- 172.21.15.100:0/3748639363 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f26f001b800 con 0x7f27000c5120 2024-01-22T05:38:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.615+0000 7f26f7e00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.615+0000 7f26f7e00700 1 -- 172.21.15.100:0/3748639363 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f26f007bdf0 con 0x7f27000c5120 2024-01-22T05:38:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.615+0000 7f26ffe00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.615+0000 7f26ffe00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f27000a94b0 tx=0x7f26e8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:50.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.619+0000 7f26f7e00700 1 -- 172.21.15.100:0/3748639363 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f26f004d2a0 con 0x7f27000c5120 2024-01-22T05:38:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:50.804+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f27000c7530 con 0x7f27000c5120 2024-01-22T05:38:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.592+0000 7f26f7e00700 1 -- 172.21.15.100:0/3748639363 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f26f0029020 con 0x7f27000c5120 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 msgr2=0x7f26d8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f27000a94b0 tx=0x7f26e8008040).stop 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c5120 msgr2=0x7f27000a4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c5120 0x7f27000a4d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f26f0009eb0 tx=0x7f26f0017000).stop 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 shutdown_connections 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2700138820 0x7f27001672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c5120 0x7f27000a4d80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 --2- 172.21.15.100:0/3748639363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2700138440 0x7f2700137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:51.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 >> 172.21.15.100:0/3748639363 conn(0x7f27000630c0 msgr2=0x7f2700150860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:51.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.594+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 shutdown_connections 2024-01-22T05:38:51.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.595+0000 7f2707c00700 1 -- 172.21.15.100:0/3748639363 wait complete. 2024-01-22T05:38:51.596 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-01-22T05:38:51.614 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:38:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.799+0000 7fbcf0c00700 1 Processor -- start 2024-01-22T05:38:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.799+0000 7fbcf0c00700 1 -- start start 2024-01-22T05:38:51.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.800+0000 7fbcf0c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbcec158160 0x7fbcec15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:51.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.800+0000 7fbcf0c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec0c9be0 con 0x7fbcec151bf0 2024-01-22T05:38:51.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.800+0000 7fbcf0c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec0c9ec0 con 0x7fbcec05edc0 2024-01-22T05:38:51.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.800+0000 7fbcf0c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec0ca1a0 con 0x7fbcec158160 2024-01-22T05:38:51.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.800+0000 7fbcea800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbcec158160 0x7fbcec15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:51.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.800+0000 7fbce9e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbcec151bf0 0x7fbcec0c92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59062/0 (socket says 172.21.15.100:59062) 2024-01-22T05:38:51.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.800+0000 7fbcea800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbcec158160 0x7fbcec15edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42664/0 (socket says 172.21.15.100:42664) 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbce9e00700 1 -- 172.21.15.100:0/3143630674 learned_addr learned my addr 172.21.15.100:0/3143630674 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbcea800700 1 -- 172.21.15.100:0/3143630674 >> v1:172.21.15.169:6789/0 conn(0x7fbcec05edc0 legacy=0x7fbcec157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbcea800700 1 -- 172.21.15.100:0/3143630674 >> v1:172.21.15.100:6789/0 conn(0x7fbcec151bf0 legacy=0x7fbcec0c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbcea800700 1 -- 172.21.15.100:0/3143630674 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec0bfe30 con 0x7fbcec158160 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbcea800700 1 --2- 172.21.15.100:0/3143630674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec15edf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fbce4009e60 tx=0x7fbce4009780).ready entity=mon.0 client_cookie=6c35a3edba65a264 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbce8a00700 1 -- 172.21.15.100:0/3143630674 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400e070 con 0x7fbcec158160 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbce8a00700 1 -- 172.21.15.100:0/3143630674 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce400bc30 con 0x7fbcec158160 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.801+0000 7fbce8a00700 1 -- 172.21.15.100:0/3143630674 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4012410 con 0x7fbcec158160 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.802+0000 7fbcf0c00700 1 -- 172.21.15.100:0/3143630674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 msgr2=0x7fbcec15edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:51.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.802+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/3143630674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec15edf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fbce4009e60 tx=0x7fbce4009780).stop 2024-01-22T05:38:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.802+0000 7fbcf0c00700 1 -- 172.21.15.100:0/3143630674 shutdown_connections 2024-01-22T05:38:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.802+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/3143630674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec15edf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.802+0000 7fbcf0c00700 1 -- 172.21.15.100:0/3143630674 >> 172.21.15.100:0/3143630674 conn(0x7fbcec084ab0 msgr2=0x7fbcec0943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.802+0000 7fbcf0c00700 1 -- 172.21.15.100:0/3143630674 shutdown_connections 2024-01-22T05:38:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.802+0000 7fbcf0c00700 1 -- 172.21.15.100:0/3143630674 wait complete. 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.803+0000 7fbcf0c00700 1 Processor -- start 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.804+0000 7fbcf0c00700 1 -- start start 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.804+0000 7fbcf0c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcec05edc0 0x7fbcec0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.804+0000 7fbcf0c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcec151bf0 0x7fbcec14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.804+0000 7fbcf0c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec14aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.804+0000 7fbcf0c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0aaed0 con 0x7fbcec158160 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.804+0000 7fbcf0c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0ae330 con 0x7fbcec05edc0 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.804+0000 7fbcf0c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0ae610 con 0x7fbcec151bf0 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec14aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec14aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42676/0 (socket says 172.21.15.100:42676) 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 -- 172.21.15.100:0/2177292775 learned_addr learned my addr 172.21.15.100:0/2177292775 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbce9e00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcec05edc0 0x7fbcec0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbce9400700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcec151bf0 0x7fbcec14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 -- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcec151bf0 msgr2=0x7fbcec14b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcec151bf0 0x7fbcec14b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 -- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcec05edc0 msgr2=0x7fbcec0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcec05edc0 0x7fbcec0add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 -- 172.21.15.100:0/2177292775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4009a20 con 0x7fbcec158160 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbce9e00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcec05edc0 0x7fbcec0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbce9400700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcec151bf0 0x7fbcec14b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.805+0000 7fbcea800700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec14aa90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fbce400b6c0 tx=0x7fbce4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.806+0000 7fbce1600700 1 -- 172.21.15.100:0/2177292775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40065d0 con 0x7fbcec158160 2024-01-22T05:38:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.806+0000 7fbce1600700 1 -- 172.21.15.100:0/2177292775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce4006730 con 0x7fbcec158160 2024-01-22T05:38:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.806+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec0ae8f0 con 0x7fbcec158160 2024-01-22T05:38:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.806+0000 7fbce1600700 1 -- 172.21.15.100:0/2177292775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4006ad0 con 0x7fbcec158160 2024-01-22T05:38:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.806+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec0aebd0 con 0x7fbcec158160 2024-01-22T05:38:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.807+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec06c680 con 0x7fbcec158160 2024-01-22T05:38:51.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.808+0000 7fbce1600700 1 -- 172.21.15.100:0/2177292775 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbce401d630 con 0x7fbcec158160 2024-01-22T05:38:51.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.809+0000 7fbce1600700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbcc405f150 0x7fbcc4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:51.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.809+0000 7fbce1600700 1 -- 172.21.15.100:0/2177292775 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fbce407c460 con 0x7fbcec158160 2024-01-22T05:38:51.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.809+0000 7fbce9e00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbcc405f150 0x7fbcc4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:51.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.809+0000 7fbce9e00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbcc405f150 0x7fbcc4061610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fbcdc007fd0 tx=0x7fbcdc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:51.813+0000 7fbce1600700 1 -- 172.21.15.100:0/2177292775 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbce404da40 con 0x7fbcec158160 2024-01-22T05:38:52.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.044+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbcec085180 con 0x7fbcec158160 2024-01-22T05:38:52.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.045+0000 7fbce1600700 1 -- 172.21.15.100:0/2177292775 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fbce4051060 con 0x7fbcec158160 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1lKhBbExAAP1BrokBcKT5wpIYo2LQizA==", 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1l5WvtKBAAGBD5pmKa1sf0TSX+OYjENw==", 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:38:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:38:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-01-22T05:38:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1ldUwfHhAAGDh9/oyieZZj+nYGld/h5w==", 2024-01-22T05:38:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:38:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:38:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1lo2avMxAAz3VifArccipq4F2K0FH9Kw==", 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAA/61l9LR1NxAAx58Vl+r8QVwCEFHkEv4HJw==", 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAE/61lSe6xDRAAaFPsyQZNCGPUSo/m2jqETQ==", 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAH/61lK8MxHxAACcVEookX0aW2movigxC2rQ==", 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAK/61lnYc0MBAAOR9vmCTVgAEbjys3KinSew==", 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAR/61l6P8NGxAA/DPstaukdx0isfDgWNW4MA==", 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAU/61lWuCvLBAA8Cd63Y9QlhRZHSJy/DUb8g==", 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-01-22T05:38:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAY/61lYmcMAhAA3ghp6xyqtWETmgFA/Szq8A==", 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAb/61lr2xlExAANagHPAeO/tTQ4KPxCuU6tw==", 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:38:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1l5dFcARAAc8i3e2d9UpF5QQY4na57gg==", 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-22T05:38:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1lFHj8DhAAz0WTKY0O3XjPGv5O0PRvCQ==", 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.2", 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1lq1AhCBAAmkMcm5COJ2MY+F+ZusDcrw==", 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.3", 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1lKApFIRAASzUDqwNZORbBGJ0T3aTCKg==", 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD7/q1lJjuZDxAAz1l9858AcZSaDpAyXIZdyA==", 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mds", 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAj/61lF/aLFRAAHd70oUsIaxmFsV8MoVK7nw==", 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mds" 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mgr", 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAj/61legOMFRAAjMNp1qzya1LnAF9QpfVgug==", 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-22T05:38:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-osd", 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAj/61lRgyMFRAA5NAZfmDO1d3R0KKW+gcIxw==", 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-osd" 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd", 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAj/61lhhSMFRAAu7ZsBDRS5jFsWtSIDUBYxA==", 2024-01-22T05:38:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAj/61lMR2MFRAAfB8TvB1da69gpyGC77bHaA==", 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rgw", 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAj/61lvCWMFRAACJ9UrQxSAz8gq/UgmRjE6Q==", 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1lBYNsDBAAy201tfKKfFR4d3U8DtGtoQ==", 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD7/q1lKDyANRAALG48jCFnVwioSX/dTJfBNQ==", 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-01-22T05:38:52.067 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbcc405f150 msgr2=0x7fbcc4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbcc405f150 0x7fbcc4061610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fbcdc007fd0 tx=0x7fbcdc009040).stop 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 msgr2=0x7fbcec14aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec14aa90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fbce400b6c0 tx=0x7fbce4009780).stop 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 shutdown_connections 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbcc405f150 0x7fbcc4061610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcec05edc0 0x7fbcec0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcec158160 0x7fbcec14aa90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 --2- 172.21.15.100:0/2177292775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcec151bf0 0x7fbcec14b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 >> 172.21.15.100:0/2177292775 conn(0x7fbcec084ab0 msgr2=0x7fbcec0c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:52.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 shutdown_connections 2024-01-22T05:38:52.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.047+0000 7fbcf0c00700 1 -- 172.21.15.100:0/2177292775 wait complete. 2024-01-22T05:38:52.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-22T05:38:52.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.256+0000 7f8ca4a00700 1 Processor -- start 2024-01-22T05:38:52.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.256+0000 7f8ca4a00700 1 -- start start 2024-01-22T05:38:52.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.257+0000 7f8ca4a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c150ae0 0x7f8c9c150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.257+0000 7f8ca4a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8c9c0c25c0 0x7f8c9c0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.257+0000 7f8ca4a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c0660a0 con 0x7f8c9c1521d0 2024-01-22T05:38:52.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.257+0000 7f8ca4a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c065bd0 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.257+0000 7f8ca4a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c151d40 con 0x7f8c9c150ae0 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c150ae0 0x7f8c9c150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c150ae0 0x7f8c9c150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:49526/0 (socket says 172.21.15.100:49526) 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 -- 172.21.15.100:0/3970494231 learned_addr learned my addr 172.21.15.100:0/3970494231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2a00700 1 --2- 172.21.15.100:0/3970494231 >> v2:172.21.15.169:3300/0 conn(0x7f8c9c0c25c0 0x7f8c9c0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca0c00700 1 -- 172.21.15.100:0/3970494231 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202200898 0 0) 0x7f8c9c0660a0 con 0x7f8c9c1521d0 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca0c00700 1 -- 172.21.15.100:0/3970494231 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c7c0033f0 con 0x7f8c9c1521d0 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 -- 172.21.15.100:0/3970494231 >> v2:172.21.15.169:3300/0 conn(0x7f8c9c0c25c0 msgr2=0x7f8c9c0c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 --2- 172.21.15.100:0/3970494231 >> v2:172.21.15.169:3300/0 conn(0x7f8c9c0c25c0 0x7f8c9c0c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 -- 172.21.15.100:0/3970494231 >> v1:172.21.15.169:6789/0 conn(0x7f8c9c1521d0 legacy=0x7f8c9c0654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 -- 172.21.15.100:0/3970494231 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c065dc0 con 0x7f8c9c150ae0 2024-01-22T05:38:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2a00700 1 --2- 172.21.15.100:0/3970494231 >> v2:172.21.15.169:3300/0 conn(0x7f8c9c0c25c0 0x7f8c9c0c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.258+0000 7f8ca2000700 1 --2- 172.21.15.100:0/3970494231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c150ae0 0x7f8c9c150ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8c8c006fd0 tx=0x7f8c8c0090f0).ready entity=mon.2 client_cookie=2a2b71c46bc71edb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca0c00700 1 -- 172.21.15.100:0/3970494231 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00f510 con 0x7f8c9c150ae0 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca0c00700 1 -- 172.21.15.100:0/3970494231 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00f670 con 0x7f8c9c150ae0 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca0c00700 1 -- 172.21.15.100:0/3970494231 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00f9f0 con 0x7f8c9c150ae0 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 -- 172.21.15.100:0/3970494231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c150ae0 msgr2=0x7f8c9c150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/3970494231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c150ae0 0x7f8c9c150ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8c8c006fd0 tx=0x7f8c8c0090f0).stop 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 -- 172.21.15.100:0/3970494231 shutdown_connections 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/3970494231 >> v2:172.21.15.169:3300/0 conn(0x7f8c9c0c25c0 0x7f8c9c0c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/3970494231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c150ae0 0x7f8c9c150ec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 -- 172.21.15.100:0/3970494231 >> 172.21.15.100:0/3970494231 conn(0x7f8c9c0630c0 msgr2=0x7f8c9c0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 -- 172.21.15.100:0/3970494231 shutdown_connections 2024-01-22T05:38:52.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.259+0000 7f8ca4a00700 1 -- 172.21.15.100:0/3970494231 wait complete. 2024-01-22T05:38:52.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.261+0000 7f8ca4a00700 1 Processor -- start 2024-01-22T05:38:52.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.261+0000 7f8ca4a00700 1 -- start start 2024-01-22T05:38:52.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca4a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c0c25c0 0x7f8c9c0a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca4a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c9c150ae0 0x7f8c9c145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca4a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c1521d0 0x7f8c9c146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca4a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c147600 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca4a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c146d60 con 0x7f8c9c150ae0 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca4a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c147040 con 0x7f8c9c1521d0 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c0c25c0 0x7f8c9c0a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c0c25c0 0x7f8c9c0a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42680/0 (socket says 172.21.15.100:42680) 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.262+0000 7f8ca2000700 1 -- 172.21.15.100:0/2039924599 learned_addr learned my addr 172.21.15.100:0/2039924599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c1521d0 0x7f8c9c146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca1600700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c9c150ae0 0x7f8c9c145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2000700 1 -- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c1521d0 msgr2=0x7f8c9c146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2000700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c1521d0 0x7f8c9c146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2000700 1 -- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c9c150ae0 msgr2=0x7f8c9c145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2000700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c9c150ae0 0x7f8c9c145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2000700 1 -- 172.21.15.100:0/2039924599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94009a20 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c1521d0 0x7f8c9c146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca1600700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c9c150ae0 0x7f8c9c145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca2000700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c0c25c0 0x7f8c9c0a9ac0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f8c8c009df0 tx=0x7f8c8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8c99600700 1 -- 172.21.15.100:0/2039924599 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00fe80 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8c99600700 1 -- 172.21.15.100:0/2039924599 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00f7e0 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c009370 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8c99600700 1 -- 172.21.15.100:0/2039924599 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c01a640 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.263+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c0aa470 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.264+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c05fdb0 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.265+0000 7f8c99600700 1 -- 172.21.15.100:0/2039924599 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8c8c01aa30 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.266+0000 7f8c99600700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c7405f150 0x7f8c74061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.266+0000 7f8c99600700 1 -- 172.21.15.100:0/2039924599 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8c8c07b870 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.266+0000 7f8ca1600700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c7405f150 0x7f8c74061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.267+0000 7f8ca1600700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c7405f150 0x7f8c74061610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f8c9c14f2d0 tx=0x7f8c84009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.270+0000 7f8c99600700 1 -- 172.21.15.100:0/2039924599 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8c8c04ce90 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.508+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f8c9c1516f0 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.512+0000 7f8c99600700 1 -- 172.21.15.100:0/2039924599 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8c8c029030 con 0x7f8c9c0c25c0 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.514+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c7405f150 msgr2=0x7f8c74061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.514+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c7405f150 0x7f8c74061610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f8c9c14f2d0 tx=0x7f8c84009040).stop 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.514+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c0c25c0 msgr2=0x7f8c9c0a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.514+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c0c25c0 0x7f8c9c0a9ac0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f8c8c009df0 tx=0x7f8c8c017000).stop 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 shutdown_connections 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8c7405f150 0x7f8c74061610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c9c1521d0 0x7f8c9c146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c0c25c0 0x7f8c9c0a9ac0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 --2- 172.21.15.100:0/2039924599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c9c150ae0 0x7f8c9c145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 >> 172.21.15.100:0/2039924599 conn(0x7f8c9c0630c0 msgr2=0x7f8c9c0bd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 shutdown_connections 2024-01-22T05:38:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.515+0000 7f8ca4a00700 1 -- 172.21.15.100:0/2039924599 wait complete. 2024-01-22T05:38:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:updated 2024-01-22T05:38:52.532 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-22T05:38:52.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.717+0000 7f870bc00700 1 Processor -- start 2024-01-22T05:38:52.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.718+0000 7f870bc00700 1 -- start start 2024-01-22T05:38:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f870bc00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8704157290 0x7f8704092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f870bc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 0x7f87040c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f870bc00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8704065000 con 0x7f8704092600 2024-01-22T05:38:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f870bc00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87040643f0 con 0x7f8704157290 2024-01-22T05:38:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f870bc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87040646d0 con 0x7f87040c5b80 2024-01-22T05:38:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f8703e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8704092600 0x7f87040c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59074/0 (socket says 172.21.15.100:59074) 2024-01-22T05:38:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f8703e00700 1 -- 172.21.15.100:0/3018813687 learned_addr learned my addr 172.21.15.100:0/3018813687 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f8709200700 1 --2- 172.21.15.100:0/3018813687 >> v2:172.21.15.169:3300/0 conn(0x7f8704157290 0x7f8704092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f8709c00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 0x7f87040c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159214758 0 0) 0x7f8704065000 con 0x7f8704092600 2024-01-22T05:38:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.719+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e40033f0 con 0x7f8704092600 2024-01-22T05:38:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993910863 0 0) 0x7f86e40033f0 con 0x7f8704092600 2024-01-22T05:38:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 msgr2=0x7f87040c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 0x7f87040c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 >> v2:172.21.15.169:3300/0 conn(0x7f8704157290 msgr2=0x7f8704092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 --2- 172.21.15.100:0/3018813687 >> v2:172.21.15.169:3300/0 conn(0x7f8704157290 0x7f8704092110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040649b0 con 0x7f8704092600 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f86ec001470 con 0x7f8704092600 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 >> v1:172.21.15.100:6789/0 conn(0x7f8704092600 legacy=0x7f87040c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 0x7f86e40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003e10 0x7f86e4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e4004b80 0x7f86e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040643f0 con 0x7f86e4004b80 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040646d0 con 0x7f86e4003e10 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e400b8e0 con 0x7f87040c5b80 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8709200700 1 --2- 172.21.15.100:0/3018813687 >> v2:172.21.15.169:3300/0 conn(0x7f8704157290 0x7f8704092110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8709c00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e4004b80 0x7f86e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8703e00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003e10 0x7f86e4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.720+0000 7f8709200700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 0x7f86e40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8709c00700 1 -- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 msgr2=0x7f86e40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8709c00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87040c5b80 0x7f86e40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8709c00700 1 -- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003e10 msgr2=0x7f86e4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8709c00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003e10 0x7f86e4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8709c00700 1 -- 172.21.15.100:0/3018813687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40033f0 con 0x7f86e4004b80 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8703e00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003e10 0x7f86e4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8709c00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e4004b80 0x7f86e4005000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f87040bf210 tx=0x7f86fc00b040).ready entity=mon.0 client_cookie=a2f104aaef114d1c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc009ac0 con 0x7f86e4004b80 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc00f040 con 0x7f86e4004b80 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8703400700 1 -- 172.21.15.100:0/3018813687 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00eca0 con 0x7f86e4004b80 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f870bc00700 1 -- 172.21.15.100:0/3018813687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e4004b80 msgr2=0x7f86e4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f870bc00700 1 --2- 172.21.15.100:0/3018813687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e4004b80 0x7f86e4005000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f87040bf210 tx=0x7f86fc00b040).stop 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f8709c00700 1 -- 172.21.15.100:0/3018813687 reap_dead start 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f870bc00700 1 -- 172.21.15.100:0/3018813687 shutdown_connections 2024-01-22T05:38:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.721+0000 7f870bc00700 1 -- 172.21.15.100:0/3018813687 >> 172.21.15.100:0/3018813687 conn(0x7f870405e9d0 msgr2=0x7f8704091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.722+0000 7f870bc00700 1 -- 172.21.15.100:0/3018813687 shutdown_connections 2024-01-22T05:38:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.722+0000 7f870bc00700 1 -- 172.21.15.100:0/3018813687 wait complete. 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.723+0000 7f870bc00700 1 Processor -- start 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.723+0000 7f870bc00700 1 -- start start 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f870bc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86e4004b80 0x7f87040acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f870bc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8704154a30 0x7f87040960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f870bc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8704154eb0 0x7f87040c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f870bc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704167fc0 con 0x7f8704154eb0 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f870bc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040c6d20 con 0x7f8704154a30 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f870bc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8704168de0 con 0x7f86e4004b80 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f8709c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8704154eb0 0x7f87040c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f8709c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8704154eb0 0x7f87040c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42700/0 (socket says 172.21.15.100:42700) 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.724+0000 7f8709c00700 1 -- 172.21.15.100:0/2793345047 learned_addr learned my addr 172.21.15.100:0/2793345047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8703e00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8704154a30 0x7f87040960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8709200700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86e4004b80 0x7f87040acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8709c00700 1 -- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86e4004b80 msgr2=0x7f87040acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8709c00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86e4004b80 0x7f87040acfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8709c00700 1 -- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8704154a30 msgr2=0x7f87040960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8709c00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8704154a30 0x7f87040960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8709c00700 1 -- 172.21.15.100:0/2793345047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87041681d0 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f8709c00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8704154eb0 0x7f87040c7660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f86fc00e7d0 tx=0x7f86fc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f86fbe00700 1 -- 172.21.15.100:0/2793345047 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc021030 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f86fbe00700 1 -- 172.21.15.100:0/2793345047 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc009ac0 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f86fbe00700 1 -- 172.21.15.100:0/2793345047 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc013e60 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87041684b0 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.725+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8704168a70 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.726+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870405fdb0 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.727+0000 7f86fbe00700 1 -- 172.21.15.100:0/2793345047 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f86fc024070 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.728+0000 7f86fbe00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f86dc05f150 0x7f86dc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.728+0000 7f86fbe00700 1 -- 172.21.15.100:0/2793345047 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f86fc022070 con 0x7f8704154eb0 2024-01-22T05:38:52.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.728+0000 7f8709200700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f86dc05f150 0x7f86dc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:52.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.728+0000 7f8709200700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f86dc05f150 0x7f86dc061610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f86f4006f70 tx=0x7f86f4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:52.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.732+0000 7f86fbe00700 1 -- 172.21.15.100:0/2793345047 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86fc04cda0 con 0x7f8704154eb0 2024-01-22T05:38:52.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.963+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8704064c90 con 0x7f8704154eb0 2024-01-22T05:38:52.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.967+0000 7f86fbe00700 1 -- 172.21.15.100:0/2793345047 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f86fc0503c0 con 0x7f8704154eb0 2024-01-22T05:38:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f86dc05f150 msgr2=0x7f86dc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f86dc05f150 0x7f86dc061610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f86f4006f70 tx=0x7f86f4008040).stop 2024-01-22T05:38:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8704154eb0 msgr2=0x7f87040c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8704154eb0 0x7f87040c7660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f86fc00e7d0 tx=0x7f86fc01a000).stop 2024-01-22T05:38:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 shutdown_connections 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f86dc05f150 0x7f86dc061610 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8704154eb0 0x7f87040c7660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86e4004b80 0x7f87040acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 --2- 172.21.15.100:0/2793345047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8704154a30 0x7f87040960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 >> 172.21.15.100:0/2793345047 conn(0x7f870405e9d0 msgr2=0x7f8704067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 shutdown_connections 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:52.969+0000 7f870bc00700 1 -- 172.21.15.100:0/2793345047 wait complete. 2024-01-22T05:38:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:updated 2024-01-22T05:38:52.987 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-22T05:38:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.171+0000 7f7b44a00700 1 Processor -- start 2024-01-22T05:38:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.171+0000 7f7b44a00700 1 -- start start 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b44a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b44a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b3c0c88c0 0x7f7b3c157c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b44a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7b3c0c8ca0 0x7f7b3c158130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b44a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c158620 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b44a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c0310 con 0x7f7b3c0c8ca0 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b44a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c6f20 con 0x7f7b3c153e90 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b41600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b3c0c88c0 0x7f7b3c157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b41600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b3c0c88c0 0x7f7b3c157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40242/0 (socket says 172.21.15.100:40242) 2024-01-22T05:38:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.172+0000 7f7b41600700 1 -- 172.21.15.100:0/2046704716 learned_addr learned my addr 172.21.15.100:0/2046704716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b42000700 1 --2- 172.21.15.100:0/2046704716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b42a00700 1 --2- 172.21.15.100:0/2046704716 >> v2:172.21.15.169:3300/0 conn(0x7f7b3c0c8ca0 0x7f7b3c158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b41600700 1 -- 172.21.15.100:0/2046704716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 msgr2=0x7f7b3c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b41600700 1 --2- 172.21.15.100:0/2046704716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b41600700 1 -- 172.21.15.100:0/2046704716 >> v2:172.21.15.169:3300/0 conn(0x7f7b3c0c8ca0 msgr2=0x7f7b3c158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b41600700 1 --2- 172.21.15.100:0/2046704716 >> v2:172.21.15.169:3300/0 conn(0x7f7b3c0c8ca0 0x7f7b3c158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b41600700 1 -- 172.21.15.100:0/2046704716 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c0c71c0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b41600700 1 --2- 172.21.15.100:0/2046704716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c157c40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7b3c0cac80 tx=0x7f7b240090f0).ready entity=mon.0 client_cookie=90eb25be384b831d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b40c00700 1 -- 172.21.15.100:0/2046704716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400b600 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b40c00700 1 -- 172.21.15.100:0/2046704716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2400b760 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.173+0000 7f7b40c00700 1 -- 172.21.15.100:0/2046704716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400bae0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 -- 172.21.15.100:0/2046704716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 msgr2=0x7f7b3c157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 --2- 172.21.15.100:0/2046704716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c157c40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7b3c0cac80 tx=0x7f7b240090f0).stop 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 -- 172.21.15.100:0/2046704716 shutdown_connections 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 --2- 172.21.15.100:0/2046704716 >> v2:172.21.15.169:3300/0 conn(0x7f7b3c0c8ca0 0x7f7b3c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 --2- 172.21.15.100:0/2046704716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 --2- 172.21.15.100:0/2046704716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c157c40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 -- 172.21.15.100:0/2046704716 >> 172.21.15.100:0/2046704716 conn(0x7f7b3c0943b0 msgr2=0x7f7b3c05e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 -- 172.21.15.100:0/2046704716 shutdown_connections 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.174+0000 7f7b44a00700 1 -- 172.21.15.100:0/2046704716 wait complete. 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.175+0000 7f7b44a00700 1 Processor -- start 2024-01-22T05:38:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.175+0000 7f7b44a00700 1 -- start start 2024-01-22T05:38:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.176+0000 7f7b44a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c0afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.176+0000 7f7b44a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b3c0c8ca0 0x7f7b3c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.176+0000 7f7b44a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c0adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.176+0000 7f7b44a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0b0d10 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.176+0000 7f7b44a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c14d490 con 0x7f7b3c0c8ca0 2024-01-22T05:38:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.176+0000 7f7b44a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0b0100 con 0x7f7b3c153e90 2024-01-22T05:38:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c0afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c0afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40252/0 (socket says 172.21.15.100:40252) 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 -- 172.21.15.100:0/1750673248 learned_addr learned my addr 172.21.15.100:0/1750673248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b41600700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b3c0c8ca0 0x7f7b3c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c0adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 -- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 msgr2=0x7f7b3c0adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c0adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 -- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b3c0c8ca0 msgr2=0x7f7b3c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b3c0c8ca0 0x7f7b3c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 -- 172.21.15.100:0/1750673248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24009370 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c0adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b42000700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c0afb60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7b2c006920 tx=0x7f7b2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b39600700 1 -- 172.21.15.100:0/1750673248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c0125f0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b39600700 1 -- 172.21.15.100:0/1750673248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c012750 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.177+0000 7f7b39600700 1 -- 172.21.15.100:0/1750673248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c012ad0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.178+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c0b03e0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.178+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c0b09a0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.179+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c082f90 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.179+0000 7f7b39600700 1 -- 172.21.15.100:0/1750673248 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7b2c013480 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.180+0000 7f7b39600700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7b1405f150 0x7f7b14061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.180+0000 7f7b39600700 1 -- 172.21.15.100:0/1750673248 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7b2c07a2b0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.180+0000 7f7b41600700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7b1405f150 0x7f7b14061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.181+0000 7f7b41600700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7b1405f150 0x7f7b14061610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f7b3c0cac80 tx=0x7f7b24017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:53.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.184+0000 7f7b39600700 1 -- 172.21.15.100:0/1750673248 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b2c04b7b0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.420+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7b3c06c680 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.423+0000 7f7b39600700 1 -- 172.21.15.100:0/1750673248 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b2c04edd0 con 0x7f7b3c0c88c0 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.425+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7b1405f150 msgr2=0x7f7b14061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7b1405f150 0x7f7b14061610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f7b3c0cac80 tx=0x7f7b24017000).stop 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 msgr2=0x7f7b3c0afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c0afb60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7b2c006920 tx=0x7f7b2c008040).stop 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 shutdown_connections 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7b1405f150 0x7f7b14061610 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b3c153e90 0x7f7b3c0adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b3c0c88c0 0x7f7b3c0afb60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 --2- 172.21.15.100:0/1750673248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b3c0c8ca0 0x7f7b3c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 >> 172.21.15.100:0/1750673248 conn(0x7f7b3c0943b0 msgr2=0x7f7b3c14d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:53.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 shutdown_connections 2024-01-22T05:38:53.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.426+0000 7f7b44a00700 1 -- 172.21.15.100:0/1750673248 wait complete. 2024-01-22T05:38:53.427 INFO:teuthology.orchestra.run.smithi100.stderr:updated 2024-01-22T05:38:53.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-22T05:38:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.626+0000 7f18e5600700 1 Processor -- start 2024-01-22T05:38:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.626+0000 7f18e5600700 1 -- start start 2024-01-22T05:38:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.627+0000 7f18e5600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f18e0157d80 0x7f18e0158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.627+0000 7f18e5600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00c1a40 con 0x7f18e01586f0 2024-01-22T05:38:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.627+0000 7f18e5600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00cbd30 con 0x7f18e0154260 2024-01-22T05:38:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.627+0000 7f18e5600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e0158b80 con 0x7f18e0157d80 2024-01-22T05:38:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18de000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f18e0157d80 0x7f18e0158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18de000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f18e0157d80 0x7f18e0158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40262/0 (socket says 172.21.15.100:40262) 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18de000700 1 -- 172.21.15.100:0/3365592529 learned_addr learned my addr 172.21.15.100:0/3365592529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18de000700 1 -- 172.21.15.100:0/3365592529 >> v1:172.21.15.169:6789/0 conn(0x7f18e0154260 legacy=0x7f18e00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18de000700 1 -- 172.21.15.100:0/3365592529 >> v1:172.21.15.100:6789/0 conn(0x7f18e01586f0 legacy=0x7f18e00c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18de000700 1 -- 172.21.15.100:0/3365592529 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00c1110 con 0x7f18e0157d80 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18dd600700 1 -- 172.21.15.100:0/3365592529 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867198517 0 0) 0x7f18e00c1a40 con 0x7f18e01586f0 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18de000700 1 --2- 172.21.15.100:0/3365592529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0157d80 0x7f18e0158200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f18c8006fd0 tx=0x7f18c80090f0).ready entity=mon.0 client_cookie=3d9d5ae855020335 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18dd600700 1 -- 172.21.15.100:0/3365592529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800b600 con 0x7f18e0157d80 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18dd600700 1 -- 172.21.15.100:0/3365592529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800b760 con 0x7f18e0157d80 2024-01-22T05:38:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.628+0000 7f18dd600700 1 -- 172.21.15.100:0/3365592529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800bae0 con 0x7f18e0157d80 2024-01-22T05:38:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.629+0000 7f18e5600700 1 -- 172.21.15.100:0/3365592529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0157d80 msgr2=0x7f18e0158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.629+0000 7f18e5600700 1 --2- 172.21.15.100:0/3365592529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0157d80 0x7f18e0158200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f18c8006fd0 tx=0x7f18c80090f0).stop 2024-01-22T05:38:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.629+0000 7f18e5600700 1 -- 172.21.15.100:0/3365592529 shutdown_connections 2024-01-22T05:38:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.629+0000 7f18e5600700 1 --2- 172.21.15.100:0/3365592529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0157d80 0x7f18e0158200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.629+0000 7f18e5600700 1 -- 172.21.15.100:0/3365592529 >> 172.21.15.100:0/3365592529 conn(0x7f18e005e9d0 msgr2=0x7f18e00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.629+0000 7f18e5600700 1 -- 172.21.15.100:0/3365592529 shutdown_connections 2024-01-22T05:38:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.629+0000 7f18e5600700 1 -- 172.21.15.100:0/3365592529 wait complete. 2024-01-22T05:38:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.631+0000 7f18e5600700 1 Processor -- start 2024-01-22T05:38:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.631+0000 7f18e5600700 1 -- start start 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18e5600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0154260 0x7f18e00c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18e5600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0157d80 0x7f18e0146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18e5600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e01586f0 0x7f18e0152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18e5600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01549c0 con 0x7f18e0154260 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18e5600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c86e0 con 0x7f18e0157d80 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18e5600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0147fc0 con 0x7f18e01586f0 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0154260 0x7f18e00c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0154260 0x7f18e00c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40266/0 (socket says 172.21.15.100:40266) 2024-01-22T05:38:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 -- 172.21.15.100:0/4167370627 learned_addr learned my addr 172.21.15.100:0/4167370627 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18de000700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0157d80 0x7f18e0146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18df400700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e01586f0 0x7f18e0152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 -- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e01586f0 msgr2=0x7f18e0152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e01586f0 0x7f18e0152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 -- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0157d80 msgr2=0x7f18e0146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0157d80 0x7f18e0146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.632+0000 7f18dea00700 1 -- 172.21.15.100:0/4167370627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8009370 con 0x7f18e0154260 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.633+0000 7f18dea00700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0154260 0x7f18e00c81f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f18d0002f30 tx=0x7f18d0007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.633+0000 7f18d6000700 1 -- 172.21.15.100:0/4167370627 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000f470 con 0x7f18e0154260 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.633+0000 7f18d6000700 1 -- 172.21.15.100:0/4167370627 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000f5d0 con 0x7f18e0154260 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.633+0000 7f18d6000700 1 -- 172.21.15.100:0/4167370627 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000f990 con 0x7f18e0154260 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.633+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00aff50 con 0x7f18e0154260 2024-01-22T05:38:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.633+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0154ba0 con 0x7f18e0154260 2024-01-22T05:38:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.634+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00b0450 con 0x7f18e0154260 2024-01-22T05:38:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.635+0000 7f18d6000700 1 -- 172.21.15.100:0/4167370627 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f18d0012400 con 0x7f18e0154260 2024-01-22T05:38:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.635+0000 7f18d6000700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f18b805f150 0x7f18b8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.635+0000 7f18d6000700 1 -- 172.21.15.100:0/4167370627 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f18d0079460 con 0x7f18e0154260 2024-01-22T05:38:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.636+0000 7f18de000700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f18b805f150 0x7f18b8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:53.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.636+0000 7f18de000700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f18b805f150 0x7f18b8061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f18c8009130 tx=0x7f18c8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.639+0000 7f18d6000700 1 -- 172.21.15.100:0/4167370627 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f18d0048b00 con 0x7f18e0154260 2024-01-22T05:38:53.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.871+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f18e005fdb0 con 0x7f18e0154260 2024-01-22T05:38:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.875+0000 7f18d6000700 1 -- 172.21.15.100:0/4167370627 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f18d004aa10 con 0x7f18e0154260 2024-01-22T05:38:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f18b805f150 msgr2=0x7f18b8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f18b805f150 0x7f18b8061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f18c8009130 tx=0x7f18c8017000).stop 2024-01-22T05:38:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0154260 msgr2=0x7f18e00c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0154260 0x7f18e00c81f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f18d0002f30 tx=0x7f18d0007e30).stop 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 shutdown_connections 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f18b805f150 0x7f18b8061610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e01586f0 0x7f18e0152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0154260 0x7f18e00c81f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 --2- 172.21.15.100:0/4167370627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0157d80 0x7f18e0146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 >> 172.21.15.100:0/4167370627 conn(0x7f18e005e9d0 msgr2=0x7f18e0063ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 shutdown_connections 2024-01-22T05:38:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:53.877+0000 7f18e5600700 1 -- 172.21.15.100:0/4167370627 wait complete. 2024-01-22T05:38:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:updated 2024-01-22T05:38:53.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-22T05:38:54.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.078+0000 7f0817000700 1 Processor -- start 2024-01-22T05:38:54.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.079+0000 7f0817000700 1 -- start start 2024-01-22T05:38:54.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f0817000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f081005e900 0x7f08100aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f0817000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f0817000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100c74b0 con 0x7f08100a9f60 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f0817000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100cab90 con 0x7f081005e900 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f0817000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0810158660 con 0x7f08100c1940 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f080fe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f08100a9f60 0x7f081005e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40908/0 (socket says 172.21.15.100:40908) 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f080fe00700 1 -- 172.21.15.100:0/2337236099 learned_addr learned my addr 172.21.15.100:0/2337236099 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f0815000700 1 --2- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f080f400700 1 --2- 172.21.15.100:0/2337236099 >> v2:172.21.15.169:3300/0 conn(0x7f081005e900 0x7f08100aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f080ea00700 1 -- 172.21.15.100:0/2337236099 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420935976 0 0) 0x7f08100c74b0 con 0x7f08100a9f60 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.081+0000 7f080ea00700 1 -- 172.21.15.100:0/2337236099 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f00033f0 con 0x7f08100a9f60 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080f400700 1 -- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 msgr2=0x7f08100ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080f400700 1 --2- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080f400700 1 -- 172.21.15.100:0/2337236099 >> v1:172.21.15.100:6789/0 conn(0x7f08100a9f60 legacy=0x7f081005e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080f400700 1 -- 172.21.15.100:0/2337236099 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0810158940 con 0x7f081005e900 2024-01-22T05:38:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f0815000700 1 --2- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080f400700 1 --2- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f081005e900 0x7f08100aa340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f07f8009760 tx=0x7f07f8009060).ready entity=mon.1 client_cookie=99ac07cff3bc1b4c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080ea00700 1 -- 172.21.15.100:0/2337236099 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800d4a0 con 0x7f081005e900 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080ea00700 1 -- 172.21.15.100:0/2337236099 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f800d600 con 0x7f081005e900 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.082+0000 7f080ea00700 1 -- 172.21.15.100:0/2337236099 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800d980 con 0x7f081005e900 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 -- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f081005e900 msgr2=0x7f08100aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 --2- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f081005e900 0x7f08100aa340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f07f8009760 tx=0x7f07f8009060).stop 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 -- 172.21.15.100:0/2337236099 shutdown_connections 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 --2- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 --2- 172.21.15.100:0/2337236099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f081005e900 0x7f08100aa340 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 -- 172.21.15.100:0/2337236099 >> 172.21.15.100:0/2337236099 conn(0x7f08100cada0 msgr2=0x7f08100cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 -- 172.21.15.100:0/2337236099 shutdown_connections 2024-01-22T05:38:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.083+0000 7f0817000700 1 -- 172.21.15.100:0/2337236099 wait complete. 2024-01-22T05:38:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.084+0000 7f0817000700 1 Processor -- start 2024-01-22T05:38:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.084+0000 7f0817000700 1 -- start start 2024-01-22T05:38:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.085+0000 7f0817000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f081005e900 0x7f08100abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.085+0000 7f0817000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08100a9f60 0x7f08100c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.085+0000 7f0817000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.085+0000 7f0817000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08101549d0 con 0x7f081005e900 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.085+0000 7f0817000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08100ac3c0 con 0x7f08100a9f60 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.085+0000 7f0817000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100ac6a0 con 0x7f08100c1940 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f081005e900 0x7f08100abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f081005e900 0x7f08100abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40268/0 (socket says 172.21.15.100:40268) 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 -- 172.21.15.100:0/2545807344 learned_addr learned my addr 172.21.15.100:0/2545807344 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 -- 172.21.15.100:0/2545807344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 msgr2=0x7f08100c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 -- 172.21.15.100:0/2545807344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08100a9f60 msgr2=0x7f08100c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08100a9f60 0x7f08100c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 -- 172.21.15.100:0/2545807344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808009a20 con 0x7f081005e900 2024-01-22T05:38:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f080fe00700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f081005e900 0x7f08100abd20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f080000c590 tx=0x7f0800007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f0807400700 1 -- 172.21.15.100:0/2545807344 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800007e40 con 0x7f081005e900 2024-01-22T05:38:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f0807400700 1 -- 172.21.15.100:0/2545807344 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08000072e0 con 0x7f081005e900 2024-01-22T05:38:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f0807400700 1 -- 172.21.15.100:0/2545807344 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000057a0 con 0x7f081005e900 2024-01-22T05:38:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.086+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f80092a0 con 0x7f081005e900 2024-01-22T05:38:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.087+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08100acc60 con 0x7f081005e900 2024-01-22T05:38:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.088+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081005fdb0 con 0x7f081005e900 2024-01-22T05:38:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.088+0000 7f0807400700 1 -- 172.21.15.100:0/2545807344 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0800005bd0 con 0x7f081005e900 2024-01-22T05:38:54.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.089+0000 7f0807400700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f07e805f150 0x7f07e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.089+0000 7f0807400700 1 -- 172.21.15.100:0/2545807344 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0800079750 con 0x7f081005e900 2024-01-22T05:38:54.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.089+0000 7f080f400700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f07e805f150 0x7f07e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.090+0000 7f080f400700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f07e805f150 0x7f07e8061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f081005f230 tx=0x7f07f8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.093+0000 7f0807400700 1 -- 172.21.15.100:0/2545807344 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f080004ad70 con 0x7f081005e900 2024-01-22T05:38:54.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.333+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f081006abb0 con 0x7f081005e900 2024-01-22T05:38:54.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.337+0000 7f0807400700 1 -- 172.21.15.100:0/2545807344 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f080004e390 con 0x7f081005e900 2024-01-22T05:38:54.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f07e805f150 msgr2=0x7f07e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f07e805f150 0x7f07e8061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f081005f230 tx=0x7f07f8016000).stop 2024-01-22T05:38:54.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f081005e900 msgr2=0x7f08100abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f081005e900 0x7f08100abd20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f080000c590 tx=0x7f0800007c80).stop 2024-01-22T05:38:54.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 shutdown_connections 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f07e805f150 0x7f07e8061610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08100c1940 0x7f08100c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f081005e900 0x7f08100abd20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 --2- 172.21.15.100:0/2545807344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08100a9f60 0x7f08100c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 >> 172.21.15.100:0/2545807344 conn(0x7f08100cada0 msgr2=0x7f08100ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 shutdown_connections 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.339+0000 7f0817000700 1 -- 172.21.15.100:0/2545807344 wait complete. 2024-01-22T05:38:54.341 INFO:teuthology.orchestra.run.smithi100.stderr:updated 2024-01-22T05:38:54.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-22T05:38:54.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.540+0000 7f36b0c00700 1 Processor -- start 2024-01-22T05:38:54.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.540+0000 7f36b0c00700 1 -- start start 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36b0c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36ac05e900 0x7f36ac0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36b0c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac0c1940 0x7f36ac0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36b0c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0c74b0 con 0x7f36ac0a9f60 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36b0c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac0cab90 con 0x7f36ac05e900 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36b0c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac158660 con 0x7f36ac0c1940 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36a9400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36ac05e900 0x7f36ac0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36a9400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36ac05e900 0x7f36ac0aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40282/0 (socket says 172.21.15.100:40282) 2024-01-22T05:38:54.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36a9400700 1 -- 172.21.15.100:0/312024629 learned_addr learned my addr 172.21.15.100:0/312024629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36a9e00700 1 --1- 172.21.15.100:0/312024629 >> v1:172.21.15.100:6789/0 conn(0x7f36ac0a9f60 0x7f36ac05e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40916/0 (socket says 172.21.15.100:40916) 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36aa800700 1 --2- 172.21.15.100:0/312024629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac0c1940 0x7f36ac0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36a9400700 1 -- 172.21.15.100:0/312024629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac0c1940 msgr2=0x7f36ac0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.542+0000 7f36a9400700 1 --2- 172.21.15.100:0/312024629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac0c1940 0x7f36ac0ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36a9400700 1 -- 172.21.15.100:0/312024629 >> v1:172.21.15.100:6789/0 conn(0x7f36ac0a9f60 legacy=0x7f36ac05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36a9400700 1 -- 172.21.15.100:0/312024629 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac158940 con 0x7f36ac05e900 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36a8a00700 1 -- 172.21.15.100:0/312024629 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313990993 0 0) 0x7f36ac0c74b0 con 0x7f36ac0a9f60 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36aa800700 1 --2- 172.21.15.100:0/312024629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac0c1940 0x7f36ac0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36a9400700 1 --2- 172.21.15.100:0/312024629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac05e900 0x7f36ac0aa340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f3694006fd0 tx=0x7f36940090f0).ready entity=mon.0 client_cookie=d5610cdfd7a7c41d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36a8a00700 1 -- 172.21.15.100:0/312024629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400b600 con 0x7f36ac05e900 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36a8a00700 1 -- 172.21.15.100:0/312024629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369400b760 con 0x7f36ac05e900 2024-01-22T05:38:54.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36a8a00700 1 -- 172.21.15.100:0/312024629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400bae0 con 0x7f36ac05e900 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36b0c00700 1 -- 172.21.15.100:0/312024629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac05e900 msgr2=0x7f36ac0aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.543+0000 7f36b0c00700 1 --2- 172.21.15.100:0/312024629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac05e900 0x7f36ac0aa340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f3694006fd0 tx=0x7f36940090f0).stop 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.544+0000 7f36b0c00700 1 -- 172.21.15.100:0/312024629 shutdown_connections 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.544+0000 7f36b0c00700 1 --2- 172.21.15.100:0/312024629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac0c1940 0x7f36ac0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.544+0000 7f36b0c00700 1 --2- 172.21.15.100:0/312024629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac05e900 0x7f36ac0aa340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.544+0000 7f36b0c00700 1 -- 172.21.15.100:0/312024629 >> 172.21.15.100:0/312024629 conn(0x7f36ac0cada0 msgr2=0x7f36ac0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.544+0000 7f36b0c00700 1 -- 172.21.15.100:0/312024629 shutdown_connections 2024-01-22T05:38:54.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.544+0000 7f36b0c00700 1 -- 172.21.15.100:0/312024629 wait complete. 2024-01-22T05:38:54.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.545+0000 7f36b0c00700 1 Processor -- start 2024-01-22T05:38:54.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.546+0000 7f36b0c00700 1 -- start start 2024-01-22T05:38:54.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.546+0000 7f36b0c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac05e900 0x7f36ac0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36b0c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac0a9f60 0x7f36ac168410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36b0c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36ac0c1940 0x7f36ac164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36b0c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0aa340 con 0x7f36ac0a9f60 2024-01-22T05:38:54.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36b0c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac164c40 con 0x7f36ac0c1940 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36b0c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac164f20 con 0x7f36ac05e900 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac0a9f60 0x7f36ac168410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac0a9f60 0x7f36ac168410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40290/0 (socket says 172.21.15.100:40290) 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 -- 172.21.15.100:0/132101903 learned_addr learned my addr 172.21.15.100:0/132101903 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9e00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac05e900 0x7f36ac0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36aa800700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36ac0c1940 0x7f36ac164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 -- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac05e900 msgr2=0x7f36ac0abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac05e900 0x7f36ac0abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 -- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36ac0c1940 msgr2=0x7f36ac164410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36ac0c1940 0x7f36ac164410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 -- 172.21.15.100:0/132101903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009370 con 0x7f36ac0a9f60 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.547+0000 7f36a9400700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac0a9f60 0x7f36ac168410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f3694009130 tx=0x7f3694017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.548+0000 7f36a1600700 1 -- 172.21.15.100:0/132101903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400b8d0 con 0x7f36ac0a9f60 2024-01-22T05:38:54.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.548+0000 7f36a1600700 1 -- 172.21.15.100:0/132101903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369400ba30 con 0x7f36ac0a9f60 2024-01-22T05:38:54.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.548+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac165200 con 0x7f36ac0a9f60 2024-01-22T05:38:54.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.548+0000 7f36a1600700 1 -- 172.21.15.100:0/132101903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369401b690 con 0x7f36ac0a9f60 2024-01-22T05:38:54.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.548+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac164900 con 0x7f36ac0a9f60 2024-01-22T05:38:54.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.549+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac05fdb0 con 0x7f36ac0a9f60 2024-01-22T05:38:54.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.550+0000 7f36a1600700 1 -- 172.21.15.100:0/132101903 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f369401ba00 con 0x7f36ac0a9f60 2024-01-22T05:38:54.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.550+0000 7f36a1600700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f368405f150 0x7f3684061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.551+0000 7f36a1600700 1 -- 172.21.15.100:0/132101903 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f369407b620 con 0x7f36ac0a9f60 2024-01-22T05:38:54.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.551+0000 7f36a9e00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f368405f150 0x7f3684061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.551+0000 7f36a9e00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f368405f150 0x7f3684061610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f369c0011e0 tx=0x7f369c007180).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:54.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.555+0000 7f36a1600700 1 -- 172.21.15.100:0/132101903 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f369404cc40 con 0x7f36ac0a9f60 2024-01-22T05:38:54.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.789+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f36ac06abb0 con 0x7f36ac0a9f60 2024-01-22T05:38:54.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.793+0000 7f36a1600700 1 -- 172.21.15.100:0/132101903 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3694028070 con 0x7f36ac0a9f60 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f368405f150 msgr2=0x7f3684061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f368405f150 0x7f3684061610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f369c0011e0 tx=0x7f369c007180).stop 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac0a9f60 msgr2=0x7f36ac168410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac0a9f60 0x7f36ac168410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f3694009130 tx=0x7f3694017000).stop 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 shutdown_connections 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f368405f150 0x7f3684061610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36ac0c1940 0x7f36ac164410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36ac05e900 0x7f36ac0abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 --2- 172.21.15.100:0/132101903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36ac0a9f60 0x7f36ac168410 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 >> 172.21.15.100:0/132101903 conn(0x7f36ac0cada0 msgr2=0x7f36ac1537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 shutdown_connections 2024-01-22T05:38:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.796+0000 7f36b0c00700 1 -- 172.21.15.100:0/132101903 wait complete. 2024-01-22T05:38:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:updated 2024-01-22T05:38:54.814 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:54.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.996+0000 7f2a2aa00700 1 Processor -- start 2024-01-22T05:38:54.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.996+0000 7f2a2aa00700 1 -- start start 2024-01-22T05:38:54.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.997+0000 7f2a2aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a240c45a0 0x7f2a240be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:54.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.997+0000 7f2a2aa00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240928b0 con 0x7f2a24153ee0 2024-01-22T05:38:54.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.997+0000 7f2a2aa00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240bfba0 con 0x7f2a240c7d30 2024-01-22T05:38:54.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.997+0000 7f2a2aa00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a240bef90 con 0x7f2a240c45a0 2024-01-22T05:38:54.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.997+0000 7f2a23400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a240c45a0 0x7f2a240be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:54.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.997+0000 7f2a23400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a240c45a0 0x7f2a240be2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40296/0 (socket says 172.21.15.100:40296) 2024-01-22T05:38:54.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.997+0000 7f2a23400700 1 -- 172.21.15.100:0/3173567326 learned_addr learned my addr 172.21.15.100:0/3173567326 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.998+0000 7f2a23400700 1 -- 172.21.15.100:0/3173567326 >> v1:172.21.15.169:6789/0 conn(0x7f2a240c7d30 legacy=0x7f2a240be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.998+0000 7f2a23400700 1 -- 172.21.15.100:0/3173567326 >> v1:172.21.15.100:6789/0 conn(0x7f2a24153ee0 legacy=0x7f2a240c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.998+0000 7f2a23400700 1 -- 172.21.15.100:0/3173567326 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240bf270 con 0x7f2a240c45a0 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.998+0000 7f2a23400700 1 --2- 172.21.15.100:0/3173567326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a240c45a0 0x7f2a240be2d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f2a0c006fd0 tx=0x7f2a0c0090f0).ready entity=mon.0 client_cookie=e4671eb3ca8876ce server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.998+0000 7f2a22a00700 1 -- 172.21.15.100:0/3173567326 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00b600 con 0x7f2a240c45a0 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.998+0000 7f2a22a00700 1 -- 172.21.15.100:0/3173567326 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00b760 con 0x7f2a240c45a0 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.998+0000 7f2a22a00700 1 -- 172.21.15.100:0/3173567326 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00bae0 con 0x7f2a240c45a0 2024-01-22T05:38:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.999+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3173567326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a240c45a0 msgr2=0x7f2a240be2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.999+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3173567326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a240c45a0 0x7f2a240be2d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f2a0c006fd0 tx=0x7f2a0c0090f0).stop 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.999+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3173567326 shutdown_connections 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.999+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3173567326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a240c45a0 0x7f2a240be2d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.999+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3173567326 >> 172.21.15.100:0/3173567326 conn(0x7f2a24091a00 msgr2=0x7f2a24091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.999+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3173567326 shutdown_connections 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:54.999+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3173567326 wait complete. 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.000+0000 7f2a2aa00700 1 Processor -- start 2024-01-22T05:38:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.001+0000 7f2a2aa00700 1 -- start start 2024-01-22T05:38:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.001+0000 7f2a2aa00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a240c45a0 0x7f2a24168a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.001+0000 7f2a2aa00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a240c7d30 0x7f2a240ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.001+0000 7f2a2aa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a24153ee0 0x7f2a24152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.001+0000 7f2a2aa00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240abba0 con 0x7f2a24153ee0 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.001+0000 7f2a2aa00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240abe80 con 0x7f2a240c45a0 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.001+0000 7f2a2aa00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240adfa0 con 0x7f2a240c7d30 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a24153ee0 0x7f2a24152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a24153ee0 0x7f2a24152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40300/0 (socket says 172.21.15.100:40300) 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 -- 172.21.15.100:0/3394361613 learned_addr learned my addr 172.21.15.100:0/3394361613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a23e00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a240c45a0 0x7f2a24168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a23400700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a240c7d30 0x7f2a240ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 -- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a240c7d30 msgr2=0x7f2a240ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a240c7d30 0x7f2a240ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 -- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a240c45a0 msgr2=0x7f2a24168a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a240c45a0 0x7f2a24168a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 -- 172.21.15.100:0/3394361613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c009370 con 0x7f2a24153ee0 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a23400700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a240c7d30 0x7f2a240ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.002+0000 7f2a28a00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a24153ee0 0x7f2a24152cd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f2a1c002230 tx=0x7f2a1c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.003+0000 7f2a1b400700 1 -- 172.21.15.100:0/3394361613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c010510 con 0x7f2a24153ee0 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.003+0000 7f2a1b400700 1 -- 172.21.15.100:0/3394361613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c010670 con 0x7f2a24153ee0 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.003+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240ae280 con 0x7f2a24153ee0 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.003+0000 7f2a1b400700 1 -- 172.21.15.100:0/3394361613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0109f0 con 0x7f2a24153ee0 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.003+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a240adc30 con 0x7f2a24153ee0 2024-01-22T05:38:55.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.004+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2405fdb0 con 0x7f2a24153ee0 2024-01-22T05:38:55.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.005+0000 7f2a1b400700 1 -- 172.21.15.100:0/3394361613 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2a1c01b400 con 0x7f2a24153ee0 2024-01-22T05:38:55.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.005+0000 7f2a1b400700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f29fc05f150 0x7f29fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.005+0000 7f2a1b400700 1 -- 172.21.15.100:0/3394361613 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2a1c079c10 con 0x7f2a24153ee0 2024-01-22T05:38:55.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.006+0000 7f2a23e00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f29fc05f150 0x7f29fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.006+0000 7f2a23e00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f29fc05f150 0x7f29fc061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2a14003760 tx=0x7f2a14007d20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.009+0000 7f2a1b400700 1 -- 172.21.15.100:0/3394361613 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a1c04b1d0 con 0x7f2a24153ee0 2024-01-22T05:38:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.182+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a240bf550 con 0x7f2a24153ee0 2024-01-22T05:38:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.183+0000 7f2a1b400700 1 -- 172.21.15.100:0/3394361613 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+13760 (secure 0 0 0) 0x7f2a1c04e7f0 con 0x7f2a24153ee0 2024-01-22T05:38:55.184 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:55.184 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:38:51.584168+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f29fc05f150 msgr2=0x7f29fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f29fc05f150 0x7f29fc061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2a14003760 tx=0x7f2a14007d20).stop 2024-01-22T05:38:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a24153ee0 msgr2=0x7f2a24152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a24153ee0 0x7f2a24152cd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f2a1c002230 tx=0x7f2a1c0015e0).stop 2024-01-22T05:38:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 shutdown_connections 2024-01-22T05:38:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f29fc05f150 0x7f29fc061610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a240c45a0 0x7f2a24168a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a24153ee0 0x7f2a24152cd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 --2- 172.21.15.100:0/3394361613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a240c7d30 0x7f2a240ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 >> 172.21.15.100:0/3394361613 conn(0x7f2a24091a00 msgr2=0x7f2a24158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 shutdown_connections 2024-01-22T05:38:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.185+0000 7f2a2aa00700 1 -- 172.21.15.100:0/3394361613 wait complete. 2024-01-22T05:38:55.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:38:55.204 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:38:55.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.390+0000 7f9cbae00700 1 Processor -- start 2024-01-22T05:38:55.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.390+0000 7f9cbae00700 1 -- start start 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.391+0000 7f9cbae00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 0x7f9cb4065220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.391+0000 7f9cbae00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9cb4064370 0x7f9cb40691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.391+0000 7f9cbae00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb40c2480 con 0x7f9cb4069690 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.391+0000 7f9cbae00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb4069b20 con 0x7f9cb4064370 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.391+0000 7f9cbae00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c1b50 con 0x7f9cb4064e40 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.391+0000 7f9cb8e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9cb4069690 0x7f9cb40c44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40932/0 (socket says 172.21.15.100:40932) 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb8e00700 1 -- 172.21.15.100:0/489155291 learned_addr learned my addr 172.21.15.100:0/489155291 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb3400700 1 --2- 172.21.15.100:0/489155291 >> v2:172.21.15.169:3300/0 conn(0x7f9cb4064370 0x7f9cb40691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb3e00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 0x7f9cb4065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807199852 0 0) 0x7f9cb40c2480 con 0x7f9cb4069690 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c940033f0 con 0x7f9cb4069690 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 269888433 0 0) 0x7f9c940033f0 con 0x7f9cb4069690 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 msgr2=0x7f9cb4065220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 0x7f9cb4065220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 >> v2:172.21.15.169:3300/0 conn(0x7f9cb4064370 msgr2=0x7f9cb40691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 --2- 172.21.15.100:0/489155291 >> v2:172.21.15.169:3300/0 conn(0x7f9cb4064370 0x7f9cb40691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40c1e30 con 0x7f9cb4069690 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f9cac0017f0 con 0x7f9cb4069690 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb3400700 1 --2- 172.21.15.100:0/489155291 >> v2:172.21.15.169:3300/0 conn(0x7f9cb4064370 0x7f9cb40691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 >> v1:172.21.15.100:6789/0 conn(0x7f9cb4069690 legacy=0x7f9cb40c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c940038e0 0x7f9c94003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c94004690 0x7f9c94004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 0x7f9c94005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4069b20 con 0x7f9c94004690 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c1b50 con 0x7f9c940038e0 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.392+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9400b8e0 con 0x7f9cb4064e40 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3400700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c94004690 0x7f9c94004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3e00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c940038e0 0x7f9c94003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb8e00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 0x7f9c94005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3400700 1 -- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 msgr2=0x7f9c94005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3400700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9cb4064e40 0x7f9c94005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3400700 1 -- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c940038e0 msgr2=0x7f9c94003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3400700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c940038e0 0x7f9c94003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3400700 1 -- 172.21.15.100:0/489155291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940033f0 con 0x7f9c94004690 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb3400700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c94004690 0x7f9c94004b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f9cb41541a0 tx=0x7f9c9c009060).ready entity=mon.0 client_cookie=8cfaaa390592bba1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0095c0 con 0x7f9c94004690 2024-01-22T05:38:55.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c00e6e0 con 0x7f9c94004690 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.393+0000 7f9cb2a00700 1 -- 172.21.15.100:0/489155291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c00ea60 con 0x7f9c94004690 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.394+0000 7f9cbae00700 1 -- 172.21.15.100:0/489155291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c94004690 msgr2=0x7f9c94004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.394+0000 7f9cbae00700 1 --2- 172.21.15.100:0/489155291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c94004690 0x7f9c94004b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f9cb41541a0 tx=0x7f9c9c009060).stop 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.394+0000 7f9cb8e00700 1 -- 172.21.15.100:0/489155291 reap_dead start 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.394+0000 7f9cbae00700 1 -- 172.21.15.100:0/489155291 shutdown_connections 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.394+0000 7f9cbae00700 1 -- 172.21.15.100:0/489155291 >> 172.21.15.100:0/489155291 conn(0x7f9cb40630c0 msgr2=0x7f9cb40c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.394+0000 7f9cbae00700 1 -- 172.21.15.100:0/489155291 shutdown_connections 2024-01-22T05:38:55.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.394+0000 7f9cbae00700 1 -- 172.21.15.100:0/489155291 wait complete. 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.395+0000 7f9cbae00700 1 Processor -- start 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.396+0000 7f9cbae00700 1 -- start start 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cbae00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c94004690 0x7f9cb41650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cbae00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb4165590 0x7f9cb41674a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cbae00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cb4167990 0x7f9cb40a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cbae00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40a8020 con 0x7f9cb4165590 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cbae00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40a7430 con 0x7f9cb4167990 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cbae00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4167df0 con 0x7f9c94004690 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb4165590 0x7f9cb41674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb4165590 0x7f9cb41674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40312/0 (socket says 172.21.15.100:40312) 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 -- 172.21.15.100:0/3658038723 learned_addr learned my addr 172.21.15.100:0/3658038723 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3e00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c94004690 0x7f9cb41650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb8e00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cb4167990 0x7f9cb40a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 -- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c94004690 msgr2=0x7f9cb41650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c94004690 0x7f9cb41650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 -- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cb4167990 msgr2=0x7f9cb40a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cb4167990 0x7f9cb40a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 -- 172.21.15.100:0/3658038723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40a7680 con 0x7f9cb4165590 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb8e00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cb4167990 0x7f9cb40a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.397+0000 7f9cb3400700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb4165590 0x7f9cb41674a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9c94004480 tx=0x7f9c9c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.398+0000 7f9cab400700 1 -- 172.21.15.100:0/3658038723 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c00e850 con 0x7f9cb4165590 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.398+0000 7f9cab400700 1 -- 172.21.15.100:0/3658038723 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c00e9b0 con 0x7f9cb4165590 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.398+0000 7f9cab400700 1 -- 172.21.15.100:0/3658038723 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c01b6c0 con 0x7f9cb4165590 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.398+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb40a7960 con 0x7f9cb4165590 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.398+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb40a8930 con 0x7f9cb4165590 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.399+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb405fdb0 con 0x7f9cb4165590 2024-01-22T05:38:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.400+0000 7f9cab400700 1 -- 172.21.15.100:0/3658038723 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9c9c01ba70 con 0x7f9cb4165590 2024-01-22T05:38:55.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.400+0000 7f9cab400700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9c8c05f120 0x7f9c8c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.400+0000 7f9cab400700 1 -- 172.21.15.100:0/3658038723 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9c9c07bb70 con 0x7f9cb4165590 2024-01-22T05:38:55.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.401+0000 7f9cb3e00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9c8c05f120 0x7f9c8c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.401+0000 7f9cb3e00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9c8c05f120 0x7f9c8c0615e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9ca4006c40 tx=0x7f9ca4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.404+0000 7f9cab400700 1 -- 172.21.15.100:0/3658038723 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9c9c04d190 con 0x7f9cb4165590 2024-01-22T05:38:55.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.572+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9cb40c2110 con 0x7f9cb4165590 2024-01-22T05:38:55.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.572+0000 7f9cab400700 1 -- 172.21.15.100:0/3658038723 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v32) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9c9c0507b0 con 0x7f9cb4165590 2024-01-22T05:38:55.574 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9c8c05f120 msgr2=0x7f9c8c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9c8c05f120 0x7f9c8c0615e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9ca4006c40 tx=0x7f9ca4008040).stop 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb4165590 msgr2=0x7f9cb41674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb4165590 0x7f9cb41674a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9c94004480 tx=0x7f9c9c019000).stop 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 shutdown_connections 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9c8c05f120 0x7f9c8c0615e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9cb4167990 0x7f9cb40a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c94004690 0x7f9cb41650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 --2- 172.21.15.100:0/3658038723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb4165590 0x7f9cb41674a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.574+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 >> 172.21.15.100:0/3658038723 conn(0x7f9cb40630c0 msgr2=0x7f9cb40c6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.575+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 shutdown_connections 2024-01-22T05:38:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.575+0000 7f9cbae00700 1 -- 172.21.15.100:0/3658038723 wait complete. 2024-01-22T05:38:55.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:38:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.778+0000 7fcc65200700 1 Processor -- start 2024-01-22T05:38:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.778+0000 7fcc65200700 1 -- start start 2024-01-22T05:38:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.779+0000 7fcc65200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcc60064c30 0x7fcc600c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.779+0000 7fcc65200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600c6820 con 0x7fcc600c6c00 2024-01-22T05:38:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.779+0000 7fcc65200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600c7050 con 0x7fcc600c5340 2024-01-22T05:38:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.779+0000 7fcc65200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc600c64d0 con 0x7fcc60064c30 2024-01-22T05:38:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5e800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcc600c6c00 0x7fcc600631b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40944/0 (socket says 172.21.15.100:40944) 2024-01-22T05:38:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5e800700 1 -- 172.21.15.100:0/3443635523 learned_addr learned my addr 172.21.15.100:0/3443635523 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5d400700 1 --2- 172.21.15.100:0/3443635523 >> v2:172.21.15.169:3300/0 conn(0x7fcc60064c30 0x7fcc600c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93889171 0 0) 0x7fcc600c6820 con 0x7fcc600c6c00 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc400033f0 con 0x7fcc600c6c00 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4229540386 0 0) 0x7fcc400033f0 con 0x7fcc600c6c00 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 >> v2:172.21.15.169:3300/0 conn(0x7fcc60064c30 msgr2=0x7fcc600c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5ca00700 1 --2- 172.21.15.100:0/3443635523 >> v2:172.21.15.169:3300/0 conn(0x7fcc60064c30 0x7fcc600c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 >> v1:172.21.15.169:6789/0 conn(0x7fcc600c5340 legacy=0x7fcc600c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.780+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600c1940 con 0x7fcc600c6c00 2024-01-22T05:38:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fcc580017f0 con 0x7fcc600c6c00 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 >> v1:172.21.15.100:6789/0 conn(0x7fcc600c6c00 legacy=0x7fcc600631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc400038e0 0x7fcc40003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc40004690 0x7fcc40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc40005000 0x7fcc4000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600c64d0 con 0x7fcc400038e0 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4000beb0 con 0x7fcc40004690 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4000c070 con 0x7fcc40005000 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5de00700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc400038e0 0x7fcc40003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5e800700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc40005000 0x7fcc4000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5d400700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc40004690 0x7fcc40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5de00700 1 -- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc40005000 msgr2=0x7fcc4000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5de00700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc40005000 0x7fcc4000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5de00700 1 -- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc40004690 msgr2=0x7fcc40004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5de00700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc40004690 0x7fcc40004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5de00700 1 -- 172.21.15.100:0/3443635523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400033f0 con 0x7fcc400038e0 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.781+0000 7fcc5e800700 1 -- 172.21.15.100:0/3443635523 reap_dead start 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc5de00700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc400038e0 0x7fcc40003d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fcc50001730 tx=0x7fcc50007bb0).ready entity=mon.0 client_cookie=5ac4d9db7863afa7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50007020 con 0x7fcc400038e0 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50007180 con 0x7fcc400038e0 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc5ca00700 1 -- 172.21.15.100:0/3443635523 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50007520 con 0x7fcc400038e0 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc65200700 1 -- 172.21.15.100:0/3443635523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc400038e0 msgr2=0x7fcc40003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc65200700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc400038e0 0x7fcc40003d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fcc50001730 tx=0x7fcc50007bb0).stop 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc65200700 1 -- 172.21.15.100:0/3443635523 shutdown_connections 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc65200700 1 --2- 172.21.15.100:0/3443635523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc400038e0 0x7fcc40003d00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc65200700 1 -- 172.21.15.100:0/3443635523 >> 172.21.15.100:0/3443635523 conn(0x7fcc600c3ca0 msgr2=0x7fcc600c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.782+0000 7fcc65200700 1 -- 172.21.15.100:0/3443635523 shutdown_connections 2024-01-22T05:38:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.783+0000 7fcc65200700 1 -- 172.21.15.100:0/3443635523 wait complete. 2024-01-22T05:38:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.784+0000 7fcc65200700 1 Processor -- start 2024-01-22T05:38:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.784+0000 7fcc65200700 1 -- start start 2024-01-22T05:38:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc65200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc400038e0 0x7fcc600a8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc65200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc60157240 0x7fcc60148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc65200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc600ab1e0 0x7fcc600ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc65200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600a9720 con 0x7fcc600ab1e0 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc65200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600abb50 con 0x7fcc400038e0 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc65200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600a8b10 con 0x7fcc60157240 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc5e800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc600ab1e0 0x7fcc600ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc5e800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc600ab1e0 0x7fcc600ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40326/0 (socket says 172.21.15.100:40326) 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.785+0000 7fcc5e800700 1 -- 172.21.15.100:0/3413295341 learned_addr learned my addr 172.21.15.100:0/3413295341 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5de00700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc400038e0 0x7fcc600a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5d400700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc60157240 0x7fcc60148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5e800700 1 -- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc60157240 msgr2=0x7fcc60148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5e800700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc60157240 0x7fcc60148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5e800700 1 -- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc400038e0 msgr2=0x7fcc600a8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5e800700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc400038e0 0x7fcc600a8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5e800700 1 -- 172.21.15.100:0/3413295341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600a8df0 con 0x7fcc600ab1e0 2024-01-22T05:38:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc5e800700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc600ab1e0 0x7fcc600ab660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fcc600c6fe0 tx=0x7fcc600c6790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc55600700 1 -- 172.21.15.100:0/3413295341 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5800f970 con 0x7fcc600ab1e0 2024-01-22T05:38:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc55600700 1 -- 172.21.15.100:0/3413295341 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5800fad0 con 0x7fcc600ab1e0 2024-01-22T05:38:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc600a90d0 con 0x7fcc600ab1e0 2024-01-22T05:38:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc55600700 1 -- 172.21.15.100:0/3413295341 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5800fe50 con 0x7fcc600ab1e0 2024-01-22T05:38:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.786+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc601576c0 con 0x7fcc600ab1e0 2024-01-22T05:38:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.787+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6005fdb0 con 0x7fcc600ab1e0 2024-01-22T05:38:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.788+0000 7fcc55600700 1 -- 172.21.15.100:0/3413295341 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcc58015620 con 0x7fcc600ab1e0 2024-01-22T05:38:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.789+0000 7fcc55600700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc3805f150 0x7fcc38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.789+0000 7fcc55600700 1 -- 172.21.15.100:0/3413295341 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcc58079ad0 con 0x7fcc600ab1e0 2024-01-22T05:38:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.789+0000 7fcc5de00700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc3805f150 0x7fcc38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.789+0000 7fcc5de00700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc3805f150 0x7fcc38061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fcc50001010 tx=0x7fcc50015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.793+0000 7fcc55600700 1 -- 172.21.15.100:0/3413295341 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc5804afd0 con 0x7fcc600ab1e0 2024-01-22T05:38:55.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.961+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc60069a10 con 0x7fcc600ab1e0 2024-01-22T05:38:55.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.962+0000 7fcc55600700 1 -- 172.21.15.100:0/3413295341 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc5801b030 con 0x7fcc600ab1e0 2024-01-22T05:38:55.963 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:38:55.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc3805f150 msgr2=0x7fcc38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc3805f150 0x7fcc38061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fcc50001010 tx=0x7fcc50015000).stop 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc600ab1e0 msgr2=0x7fcc600ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc600ab1e0 0x7fcc600ab660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fcc600c6fe0 tx=0x7fcc600c6790).stop 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 shutdown_connections 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc3805f150 0x7fcc38061610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc400038e0 0x7fcc600a8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc600ab1e0 0x7fcc600ab660 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 --2- 172.21.15.100:0/3413295341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc60157240 0x7fcc60148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 >> 172.21.15.100:0/3413295341 conn(0x7fcc600c3ca0 msgr2=0x7fcc600acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 shutdown_connections 2024-01-22T05:38:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:55.964+0000 7fcc65200700 1 -- 172.21.15.100:0/3413295341 wait complete. 2024-01-22T05:38:55.982 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:38:56.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.165+0000 7f4e63800700 1 Processor -- start 2024-01-22T05:38:56.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.165+0000 7f4e63800700 1 -- start start 2024-01-22T05:38:56.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.166+0000 7f4e63800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4e5c153ff0 0x7f4e5c1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.166+0000 7f4e63800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c0c66e0 con 0x7f4e5c0aa440 2024-01-22T05:38:56.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.166+0000 7f4e63800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c0c0750 con 0x7f4e5c0c5cd0 2024-01-22T05:38:56.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.166+0000 7f4e63800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0bfe20 con 0x7f4e5c153ff0 2024-01-22T05:38:56.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e60e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4e5c153ff0 0x7f4e5c1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e61800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4e5c0aa440 0x7f4e5c0c0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40958/0 (socket says 172.21.15.100:40958) 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e60e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4e5c153ff0 0x7f4e5c1543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40340/0 (socket says 172.21.15.100:40340) 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e61800700 1 -- 172.21.15.100:0/398225659 learned_addr learned my addr 172.21.15.100:0/398225659 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e60e00700 1 -- 172.21.15.100:0/398225659 >> v1:172.21.15.169:6789/0 conn(0x7f4e5c0c5cd0 legacy=0x7f4e5c0a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e60e00700 1 -- 172.21.15.100:0/398225659 >> v1:172.21.15.100:6789/0 conn(0x7f4e5c0aa440 legacy=0x7f4e5c0c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e60e00700 1 -- 172.21.15.100:0/398225659 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c0c0100 con 0x7f4e5c153ff0 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e5b400700 1 -- 172.21.15.100:0/398225659 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102952837 0 0) 0x7f4e5c0c66e0 con 0x7f4e5c0aa440 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e60e00700 1 --2- 172.21.15.100:0/398225659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c1543d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f4e4c009760 tx=0x7f4e4c009060).ready entity=mon.0 client_cookie=b178a25f87f89156 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.167+0000 7f4e5b400700 1 -- 172.21.15.100:0/398225659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00b580 con 0x7f4e5c153ff0 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e5b400700 1 -- 172.21.15.100:0/398225659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00b6e0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e5b400700 1 -- 172.21.15.100:0/398225659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00ba60 con 0x7f4e5c153ff0 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e63800700 1 -- 172.21.15.100:0/398225659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 msgr2=0x7f4e5c1543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e63800700 1 --2- 172.21.15.100:0/398225659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c1543d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f4e4c009760 tx=0x7f4e4c009060).stop 2024-01-22T05:38:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e63800700 1 -- 172.21.15.100:0/398225659 shutdown_connections 2024-01-22T05:38:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e63800700 1 --2- 172.21.15.100:0/398225659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c1543d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e63800700 1 -- 172.21.15.100:0/398225659 >> 172.21.15.100:0/398225659 conn(0x7f4e5c0c82a0 msgr2=0x7f4e5c05e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e63800700 1 -- 172.21.15.100:0/398225659 shutdown_connections 2024-01-22T05:38:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.168+0000 7f4e63800700 1 -- 172.21.15.100:0/398225659 wait complete. 2024-01-22T05:38:56.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.170+0000 7f4e63800700 1 Processor -- start 2024-01-22T05:38:56.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.170+0000 7f4e63800700 1 -- start start 2024-01-22T05:38:56.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e63800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e5c0aa440 0x7f4e5c0c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e63800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e5c0c5cd0 0x7f4e5c168470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e63800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c14bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e63800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0c51a0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e63800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c168960 con 0x7f4e5c0aa440 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e63800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0c4620 con 0x7f4e5c0c5cd0 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c14bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c14bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40344/0 (socket says 172.21.15.100:40344) 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 -- 172.21.15.100:0/3429526714 learned_addr learned my addr 172.21.15.100:0/3429526714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e60e00700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e5c0aa440 0x7f4e5c0c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e5be00700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e5c0c5cd0 0x7f4e5c168470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 -- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e5c0c5cd0 msgr2=0x7f4e5c168470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e5c0c5cd0 0x7f4e5c168470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 -- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e5c0aa440 msgr2=0x7f4e5c0c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e5c0aa440 0x7f4e5c0c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e61800700 1 -- 172.21.15.100:0/3429526714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0092a0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.171+0000 7f4e5be00700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e5c0c5cd0 0x7f4e5c168470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:38:56.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.172+0000 7f4e61800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c14bd40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f4e5400c810 tx=0x7f4e54007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:56.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.172+0000 7f4e53e00700 1 -- 172.21.15.100:0/3429526714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54001630 con 0x7f4e5c153ff0 2024-01-22T05:38:56.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.172+0000 7f4e53e00700 1 -- 172.21.15.100:0/3429526714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54005d30 con 0x7f4e5c153ff0 2024-01-22T05:38:56.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.172+0000 7f4e53e00700 1 -- 172.21.15.100:0/3429526714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54005ea0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.172+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c0c4900 con 0x7f4e5c153ff0 2024-01-22T05:38:56.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.172+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c0c4ec0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.173+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c05fdb0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.174+0000 7f4e53e00700 1 -- 172.21.15.100:0/3429526714 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4e540075b0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.175+0000 7f4e53e00700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4e3405f180 0x7f4e34061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.175+0000 7f4e53e00700 1 -- 172.21.15.100:0/3429526714 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4e54079e60 con 0x7f4e5c153ff0 2024-01-22T05:38:56.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.175+0000 7f4e60e00700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4e3405f180 0x7f4e34061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.175+0000 7f4e60e00700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4e3405f180 0x7f4e34061640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4e4c009760 tx=0x7f4e4c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:56.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.179+0000 7f4e53e00700 1 -- 172.21.15.100:0/3429526714 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4e5404b440 con 0x7f4e5c153ff0 2024-01-22T05:38:56.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.353+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4e5c0c03e0 con 0x7f4e5c153ff0 2024-01-22T05:38:56.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.353+0000 7f4e53e00700 1 -- 172.21.15.100:0/3429526714 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4e5404ea60 con 0x7f4e5c153ff0 2024-01-22T05:38:56.354 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:56.354 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-22T05:38:56.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:56.354 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-22T05:38:56.355 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "device_health_metrics" 2024-01-22T05:38:56.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:38:56.355 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:38:56.355 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 2, 2024-01-22T05:38:56.355 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "rbd" 2024-01-22T05:38:56.355 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:38:56.355 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.355+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4e3405f180 msgr2=0x7f4e34061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.355+0000 7f4e63800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4e3405f180 0x7f4e34061640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4e4c009760 tx=0x7f4e4c017000).stop 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.355+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 msgr2=0x7f4e5c14bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.355+0000 7f4e63800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c14bd40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f4e5400c810 tx=0x7f4e54007ed0).stop 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.355+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 shutdown_connections 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.356+0000 7f4e63800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4e3405f180 0x7f4e34061640 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.356+0000 7f4e63800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e5c0aa440 0x7f4e5c0c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.356+0000 7f4e63800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e5c153ff0 0x7f4e5c14bd40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.356+0000 7f4e63800700 1 --2- 172.21.15.100:0/3429526714 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e5c0c5cd0 0x7f4e5c168470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.356+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 >> 172.21.15.100:0/3429526714 conn(0x7f4e5c0c82a0 msgr2=0x7f4e5c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.356+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 shutdown_connections 2024-01-22T05:38:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.356+0000 7f4e63800700 1 -- 172.21.15.100:0/3429526714 wait complete. 2024-01-22T05:38:56.373 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:38:56.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:38:56.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.561+0000 7efc32c00700 1 Processor -- start 2024-01-22T05:38:56.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.562+0000 7efc32c00700 1 -- start start 2024-01-22T05:38:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc32c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc2c0a9f60 0x7efc2c0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc32c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c05e900 0x7efc2c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc32c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0c74b0 con 0x7efc2c0c1940 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc32c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0cab90 con 0x7efc2c0a9f60 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc32c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c158660 con 0x7efc2c05e900 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc2be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc2c0a9f60 0x7efc2c0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc2be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc2c0a9f60 0x7efc2c0aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40354/0 (socket says 172.21.15.100:40354) 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc2be00700 1 -- 172.21.15.100:0/687985534 learned_addr learned my addr 172.21.15.100:0/687985534 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc2b400700 1 --1- 172.21.15.100:0/687985534 >> v1:172.21.15.100:6789/0 conn(0x7efc2c0c1940 0x7efc2c05e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40962/0 (socket says 172.21.15.100:40962) 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.563+0000 7efc30c00700 1 --2- 172.21.15.100:0/687985534 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c05e900 0x7efc2c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2be00700 1 -- 172.21.15.100:0/687985534 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c05e900 msgr2=0x7efc2c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2be00700 1 --2- 172.21.15.100:0/687985534 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c05e900 0x7efc2c0ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2aa00700 1 -- 172.21.15.100:0/687985534 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323274599 0 0) 0x7efc2c0c74b0 con 0x7efc2c0c1940 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2be00700 1 -- 172.21.15.100:0/687985534 >> v1:172.21.15.100:6789/0 conn(0x7efc2c0c1940 legacy=0x7efc2c05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2be00700 1 -- 172.21.15.100:0/687985534 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c158940 con 0x7efc2c0a9f60 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2be00700 1 --2- 172.21.15.100:0/687985534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c0a9f60 0x7efc2c0aa340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7efc1c006fd0 tx=0x7efc1c0090f0).ready entity=mon.0 client_cookie=ccf40c33a0cd441b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2aa00700 1 -- 172.21.15.100:0/687985534 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c00b600 con 0x7efc2c0a9f60 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2aa00700 1 -- 172.21.15.100:0/687985534 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c00b760 con 0x7efc2c0a9f60 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.564+0000 7efc2aa00700 1 -- 172.21.15.100:0/687985534 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c00bae0 con 0x7efc2c0a9f60 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 -- 172.21.15.100:0/687985534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c0a9f60 msgr2=0x7efc2c0aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 --2- 172.21.15.100:0/687985534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c0a9f60 0x7efc2c0aa340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7efc1c006fd0 tx=0x7efc1c0090f0).stop 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 -- 172.21.15.100:0/687985534 shutdown_connections 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 --2- 172.21.15.100:0/687985534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c0a9f60 0x7efc2c0aa340 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 --2- 172.21.15.100:0/687985534 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c05e900 0x7efc2c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 -- 172.21.15.100:0/687985534 >> 172.21.15.100:0/687985534 conn(0x7efc2c0cada0 msgr2=0x7efc2c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 -- 172.21.15.100:0/687985534 shutdown_connections 2024-01-22T05:38:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.565+0000 7efc32c00700 1 -- 172.21.15.100:0/687985534 wait complete. 2024-01-22T05:38:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.566+0000 7efc32c00700 1 Processor -- start 2024-01-22T05:38:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.566+0000 7efc32c00700 1 -- start start 2024-01-22T05:38:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.567+0000 7efc32c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c05e900 0x7efc2c152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.567+0000 7efc32c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc2c0a9f60 0x7efc2c0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.567+0000 7efc32c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c0c1940 0x7efc2c157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.567+0000 7efc32c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1555b0 con 0x7efc2c05e900 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.567+0000 7efc32c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c155e50 con 0x7efc2c0a9f60 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.567+0000 7efc32c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0c4780 con 0x7efc2c0c1940 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c05e900 0x7efc2c152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c05e900 0x7efc2c152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40370/0 (socket says 172.21.15.100:40370) 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 -- 172.21.15.100:0/3280364533 learned_addr learned my addr 172.21.15.100:0/3280364533 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2b400700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc2c0a9f60 0x7efc2c0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc30c00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c0c1940 0x7efc2c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 -- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c0c1940 msgr2=0x7efc2c157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c0c1940 0x7efc2c157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 -- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc2c0a9f60 msgr2=0x7efc2c0c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc2c0a9f60 0x7efc2c0c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 -- 172.21.15.100:0/3280364533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c009370 con 0x7efc2c05e900 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc2be00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c05e900 0x7efc2c152440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7efc1c009f50 tx=0x7efc1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc23400700 1 -- 172.21.15.100:0/3280364533 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c00b8d0 con 0x7efc2c05e900 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc23400700 1 -- 172.21.15.100:0/3280364533 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c00ba30 con 0x7efc2c05e900 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.568+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c155800 con 0x7efc2c05e900 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.569+0000 7efc23400700 1 -- 172.21.15.100:0/3280364533 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c01c670 con 0x7efc2c05e900 2024-01-22T05:38:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.569+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c152930 con 0x7efc2c05e900 2024-01-22T05:38:56.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.570+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c05fdb0 con 0x7efc2c05e900 2024-01-22T05:38:56.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.570+0000 7efc23400700 1 -- 172.21.15.100:0/3280364533 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efc1c01ca60 con 0x7efc2c05e900 2024-01-22T05:38:56.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.571+0000 7efc23400700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0405f150 0x7efc04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:56.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.572+0000 7efc23400700 1 -- 172.21.15.100:0/3280364533 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7efc1c07bc00 con 0x7efc2c05e900 2024-01-22T05:38:56.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.572+0000 7efc2b400700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0405f150 0x7efc04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:56.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.572+0000 7efc2b400700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0405f150 0x7efc04061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7efc2c0aecc0 tx=0x7efc14007d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:56.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.576+0000 7efc23400700 1 -- 172.21.15.100:0/3280364533 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc1c082080 con 0x7efc2c05e900 2024-01-22T05:38:56.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:56.748+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7efc2c0ca030 con 0x7efc2c05e900 2024-01-22T05:38:56.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:38:56.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:38:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.329+0000 7efc23400700 1 -- 172.21.15.100:0/3280364533 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 152+0+0 (secure 0 0 0) 0x7efc1c02a070 con 0x7efc2c05e900 2024-01-22T05:38:57.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0405f150 msgr2=0x7efc04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:57.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0405f150 0x7efc04061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7efc2c0aecc0 tx=0x7efc14007d70).stop 2024-01-22T05:38:57.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c05e900 msgr2=0x7efc2c152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:57.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c05e900 0x7efc2c152440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7efc1c009f50 tx=0x7efc1c017000).stop 2024-01-22T05:38:57.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 shutdown_connections 2024-01-22T05:38:57.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0405f150 0x7efc04061610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc2c0c1940 0x7efc2c157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c05e900 0x7efc2c152440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 --2- 172.21.15.100:0/3280364533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc2c0a9f60 0x7efc2c0c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 >> 172.21.15.100:0/3280364533 conn(0x7efc2c0cada0 msgr2=0x7efc2c064840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:57.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.334+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 shutdown_connections 2024-01-22T05:38:57.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.336+0000 7efc32c00700 1 -- 172.21.15.100:0/3280364533 wait complete. 2024-01-22T05:38:57.342 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-01-22T05:38:57.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:38:57.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.552+0000 7f390aa00700 1 Processor -- start 2024-01-22T05:38:57.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.552+0000 7f390aa00700 1 -- start start 2024-01-22T05:38:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.553+0000 7f390aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39040c5340 0x7f3904064c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.553+0000 7f390aa00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39040c5e30 0x7f39040c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.553+0000 7f390aa00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39040c7060 con 0x7f39040c6c00 2024-01-22T05:38:57.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.553+0000 7f390aa00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040c2760 con 0x7f39040c5340 2024-01-22T05:38:57.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.553+0000 7f390aa00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040c6820 con 0x7f39040c5e30 2024-01-22T05:38:57.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39040c5340 0x7f3904064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:57.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39040c5340 0x7f3904064c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40386/0 (socket says 172.21.15.100:40386) 2024-01-22T05:38:57.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 -- 172.21.15.100:0/570651102 learned_addr learned my addr 172.21.15.100:0/570651102 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:57.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3908a00700 1 --2- 172.21.15.100:0/570651102 >> v2:172.21.15.169:3300/0 conn(0x7f39040c5e30 0x7f39040c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 -- 172.21.15.100:0/570651102 >> v2:172.21.15.169:3300/0 conn(0x7f39040c5e30 msgr2=0x7f39040c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 --2- 172.21.15.100:0/570651102 >> v2:172.21.15.169:3300/0 conn(0x7f39040c5e30 0x7f39040c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 -- 172.21.15.100:0/570651102 >> v1:172.21.15.169:6789/0 conn(0x7f39040c6c00 legacy=0x7f39040c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 -- 172.21.15.100:0/570651102 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040c6280 con 0x7f39040c5340 2024-01-22T05:38:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.554+0000 7f3903e00700 1 --2- 172.21.15.100:0/570651102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c5340 0x7f3904064c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f3904066c00 tx=0x7f38f40090f0).ready entity=mon.0 client_cookie=c615289995e7a48b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f3902a00700 1 -- 172.21.15.100:0/570651102 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400b600 con 0x7f39040c5340 2024-01-22T05:38:57.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f3902a00700 1 -- 172.21.15.100:0/570651102 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f400b760 con 0x7f39040c5340 2024-01-22T05:38:57.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f3902a00700 1 -- 172.21.15.100:0/570651102 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400bae0 con 0x7f39040c5340 2024-01-22T05:38:57.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 -- 172.21.15.100:0/570651102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c5340 msgr2=0x7f3904064c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:57.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 --2- 172.21.15.100:0/570651102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c5340 0x7f3904064c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f3904066c00 tx=0x7f38f40090f0).stop 2024-01-22T05:38:57.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 -- 172.21.15.100:0/570651102 shutdown_connections 2024-01-22T05:38:57.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 --2- 172.21.15.100:0/570651102 >> v2:172.21.15.169:3300/0 conn(0x7f39040c5e30 0x7f39040c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 --2- 172.21.15.100:0/570651102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c5340 0x7f3904064c30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 -- 172.21.15.100:0/570651102 >> 172.21.15.100:0/570651102 conn(0x7f39040c3ca0 msgr2=0x7f39040c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:57.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 -- 172.21.15.100:0/570651102 shutdown_connections 2024-01-22T05:38:57.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.555+0000 7f390aa00700 1 -- 172.21.15.100:0/570651102 wait complete. 2024-01-22T05:38:57.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.557+0000 7f390aa00700 1 Processor -- start 2024-01-22T05:38:57.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.557+0000 7f390aa00700 1 -- start start 2024-01-22T05:38:57.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f390aa00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39040c5340 0x7f3904161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:57.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f390aa00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39040c5e30 0x7f3904164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:57.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f390aa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c6c00 0x7f3904163820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:57.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f390aa00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904166310 con 0x7f39040c6c00 2024-01-22T05:38:57.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f390aa00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904165700 con 0x7f39040c5e30 2024-01-22T05:38:57.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f390aa00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39041659e0 con 0x7f39040c5340 2024-01-22T05:38:57.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c6c00 0x7f3904163820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c6c00 0x7f3904163820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40390/0 (socket says 172.21.15.100:40390) 2024-01-22T05:38:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 -- 172.21.15.100:0/3167353295 learned_addr learned my addr 172.21.15.100:0/3167353295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3903e00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39040c5340 0x7f3904161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3903400700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39040c5e30 0x7f3904164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 -- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39040c5340 msgr2=0x7f3904161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39040c5340 0x7f3904161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 -- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39040c5e30 msgr2=0x7f3904164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:57.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39040c5e30 0x7f3904164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:57.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3908a00700 1 -- 172.21.15.100:0/3167353295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009370 con 0x7f39040c6c00 2024-01-22T05:38:57.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.558+0000 7f3903400700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39040c5e30 0x7f3904164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:57.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.559+0000 7f3908a00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c6c00 0x7f3904163820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f38fc009fa0 tx=0x7f38fc009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:57.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.559+0000 7f38fb400700 1 -- 172.21.15.100:0/3167353295 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00ec70 con 0x7f39040c6c00 2024-01-22T05:38:57.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.559+0000 7f38fb400700 1 -- 172.21.15.100:0/3167353295 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc00edd0 con 0x7f39040c6c00 2024-01-22T05:38:57.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.559+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3904165cc0 con 0x7f39040c6c00 2024-01-22T05:38:57.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.559+0000 7f38fb400700 1 -- 172.21.15.100:0/3167353295 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc014610 con 0x7f39040c6c00 2024-01-22T05:38:57.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.559+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3904162110 con 0x7f39040c6c00 2024-01-22T05:38:57.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.560+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39041664c0 con 0x7f39040c6c00 2024-01-22T05:38:57.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.561+0000 7f38fb400700 1 -- 172.21.15.100:0/3167353295 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f38fc0149c0 con 0x7f39040c6c00 2024-01-22T05:38:57.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.562+0000 7f38fb400700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38dc05f150 0x7f38dc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:57.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.562+0000 7f38fb400700 1 -- 172.21.15.100:0/3167353295 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f38fc07a470 con 0x7f39040c6c00 2024-01-22T05:38:57.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.562+0000 7f3903e00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38dc05f150 0x7f38dc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:57.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.562+0000 7f3903e00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38dc05f150 0x7f38dc061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f38f4009fd0 tx=0x7f38f4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:57.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.566+0000 7f38fb400700 1 -- 172.21.15.100:0/3167353295 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f39041664c0 con 0x7f39040c6c00 2024-01-22T05:38:57.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:57.734+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f390405fdb0 con 0x7f39040c6c00 2024-01-22T05:38:58.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.340+0000 7f38fb400700 1 -- 172.21.15.100:0/3167353295 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f38fc04f2f0 con 0x7f39040c6c00 2024-01-22T05:38:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.345+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38dc05f150 msgr2=0x7f38dc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.346+0000 7f390aa00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38dc05f150 0x7f38dc061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f38f4009fd0 tx=0x7f38f4017000).stop 2024-01-22T05:38:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.346+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c6c00 msgr2=0x7f3904163820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.346+0000 7f390aa00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c6c00 0x7f3904163820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f38fc009fa0 tx=0x7f38fc009900).stop 2024-01-22T05:38:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.347+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 shutdown_connections 2024-01-22T05:38:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.347+0000 7f390aa00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f38dc05f150 0x7f38dc061610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.347+0000 7f390aa00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39040c6c00 0x7f3904163820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.347+0000 7f390aa00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39040c5340 0x7f3904161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.347+0000 7f390aa00700 1 --2- 172.21.15.100:0/3167353295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39040c5e30 0x7f3904164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.347+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 >> 172.21.15.100:0/3167353295 conn(0x7f39040c3ca0 msgr2=0x7f39040c4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:58.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.352+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 shutdown_connections 2024-01-22T05:38:58.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.352+0000 7f390aa00700 1 -- 172.21.15.100:0/3167353295 wait complete. 2024-01-22T05:38:58.361 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-01-22T05:38:58.385 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:38:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.571+0000 7f522d600700 1 Processor -- start 2024-01-22T05:38:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.571+0000 7f522d600700 1 -- start start 2024-01-22T05:38:58.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.572+0000 7f522d600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f52280c5340 0x7f5228064c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.572+0000 7f522d600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c6c00 0x7f52280c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.572+0000 7f522d600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280c7060 con 0x7f52280c5720 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.572+0000 7f522d600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52280c62c0 con 0x7f52280c5340 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.572+0000 7f522d600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c2760 con 0x7f52280c6c00 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.572+0000 7f5226a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f52280c5340 0x7f5228064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f52280c5340 0x7f5228064c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40398/0 (socket says 172.21.15.100:40398) 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226a00700 1 -- 172.21.15.100:0/2972997823 learned_addr learned my addr 172.21.15.100:0/2972997823 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226000700 1 --2- 172.21.15.100:0/2972997823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c6c00 0x7f52280c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226a00700 1 -- 172.21.15.100:0/2972997823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c6c00 msgr2=0x7f52280c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226a00700 1 --2- 172.21.15.100:0/2972997823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c6c00 0x7f52280c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226a00700 1 -- 172.21.15.100:0/2972997823 >> v1:172.21.15.169:6789/0 conn(0x7f52280c5720 legacy=0x7f52280c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226a00700 1 -- 172.21.15.100:0/2972997823 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280c6820 con 0x7f52280c5340 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5226a00700 1 --2- 172.21.15.100:0/2972997823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c5340 0x7f5228064c30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f5218006fd0 tx=0x7f52180090f0).ready entity=mon.0 client_cookie=9c6f58f032b53307 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.573+0000 7f5225600700 1 -- 172.21.15.100:0/2972997823 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800b580 con 0x7f52280c5340 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f5225600700 1 -- 172.21.15.100:0/2972997823 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800b6e0 con 0x7f52280c5340 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f5225600700 1 -- 172.21.15.100:0/2972997823 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800ba60 con 0x7f52280c5340 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 -- 172.21.15.100:0/2972997823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c5340 msgr2=0x7f5228064c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 --2- 172.21.15.100:0/2972997823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c5340 0x7f5228064c30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f5218006fd0 tx=0x7f52180090f0).stop 2024-01-22T05:38:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 -- 172.21.15.100:0/2972997823 shutdown_connections 2024-01-22T05:38:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 --2- 172.21.15.100:0/2972997823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c5340 0x7f5228064c30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 --2- 172.21.15.100:0/2972997823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c6c00 0x7f52280c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 -- 172.21.15.100:0/2972997823 >> 172.21.15.100:0/2972997823 conn(0x7f52280c3ca0 msgr2=0x7f52280c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:58.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 -- 172.21.15.100:0/2972997823 shutdown_connections 2024-01-22T05:38:58.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.574+0000 7f522d600700 1 -- 172.21.15.100:0/2972997823 wait complete. 2024-01-22T05:38:58.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.576+0000 7f522d600700 1 Processor -- start 2024-01-22T05:38:58.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.576+0000 7f522d600700 1 -- start start 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f522d600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52280c5340 0x7f52281529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f522d600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c5720 0x7f5228145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f522d600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c6c00 0x7f5228145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f522d600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280bc4c0 con 0x7f52280c6c00 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f522d600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5228152510 con 0x7f52280c5340 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f522d600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228151900 con 0x7f52280c5720 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c6c00 0x7f5228145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c6c00 0x7f5228145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40404/0 (socket says 172.21.15.100:40404) 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 -- 172.21.15.100:0/905887463 learned_addr learned my addr 172.21.15.100:0/905887463 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5226a00700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52280c5340 0x7f52281529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5226000700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c5720 0x7f5228145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 -- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c5720 msgr2=0x7f5228145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c5720 0x7f5228145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 -- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52280c5340 msgr2=0x7f52281529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52280c5340 0x7f52281529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5227400700 1 -- 172.21.15.100:0/905887463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218009370 con 0x7f52280c6c00 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.578+0000 7f5226a00700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52280c5340 0x7f52281529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.579+0000 7f5227400700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c6c00 0x7f5228145c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f5220002230 tx=0x7f52200015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.579+0000 7f521e000700 1 -- 172.21.15.100:0/905887463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220010510 con 0x7f52280c6c00 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.579+0000 7f521e000700 1 -- 172.21.15.100:0/905887463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220010670 con 0x7f52280c6c00 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.579+0000 7f521e000700 1 -- 172.21.15.100:0/905887463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200109f0 con 0x7f52280c6c00 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.579+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5228151be0 con 0x7f52280c6c00 2024-01-22T05:38:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.579+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52281521a0 con 0x7f52280c6c00 2024-01-22T05:38:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.580+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52281526a0 con 0x7f52280c6c00 2024-01-22T05:38:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.581+0000 7f521e000700 1 -- 172.21.15.100:0/905887463 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f522001b400 con 0x7f52280c6c00 2024-01-22T05:38:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.582+0000 7f521e000700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f520005f150 0x7f5200061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.582+0000 7f521e000700 1 -- 172.21.15.100:0/905887463 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f5220079ec0 con 0x7f52280c6c00 2024-01-22T05:38:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.582+0000 7f5226a00700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f520005f150 0x7f5200061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.582+0000 7f5226a00700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f520005f150 0x7f5200061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f5218009130 tx=0x7f5218017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.586+0000 7f521e000700 1 -- 172.21.15.100:0/905887463 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f522004b0d0 con 0x7f52280c6c00 2024-01-22T05:38:58.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.796+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f52280c7060 con 0x7f52280c6c00 2024-01-22T05:38:58.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.803+0000 7f521e000700 1 -- 172.21.15.100:0/905887463 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f52280c7060 con 0x7f52280c6c00 2024-01-22T05:38:58.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.807+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f520005f150 msgr2=0x7f5200061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.807+0000 7f522d600700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f520005f150 0x7f5200061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f5218009130 tx=0x7f5218017000).stop 2024-01-22T05:38:58.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.807+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c6c00 msgr2=0x7f5228145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:58.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.807+0000 7f522d600700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c6c00 0x7f5228145c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f5220002230 tx=0x7f52200015e0).stop 2024-01-22T05:38:58.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.809+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 shutdown_connections 2024-01-22T05:38:58.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.809+0000 7f522d600700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f520005f150 0x7f5200061610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.809+0000 7f522d600700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52280c5340 0x7f52281529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.809+0000 7f522d600700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52280c6c00 0x7f5228145c20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.809+0000 7f522d600700 1 --2- 172.21.15.100:0/905887463 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52280c5720 0x7f5228145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:58.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.809+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 >> 172.21.15.100:0/905887463 conn(0x7f52280c3ca0 msgr2=0x7f52280a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:58.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.809+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 shutdown_connections 2024-01-22T05:38:58.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:58.810+0000 7f522d600700 1 -- 172.21.15.100:0/905887463 wait complete. 2024-01-22T05:38:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 5 and data pool 6 2024-01-22T05:38:58.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:59.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.027+0000 7fa0b9a00700 1 Processor -- start 2024-01-22T05:38:59.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.027+0000 7fa0b9a00700 1 -- start start 2024-01-22T05:38:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.028+0000 7fa0b9a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa0b4064950 0x7fa0b40c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.028+0000 7fa0b9a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b41546c0 con 0x7fa0b40668e0 2024-01-22T05:38:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.028+0000 7fa0b9a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b40bc180 con 0x7fa0b4064dd0 2024-01-22T05:38:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.028+0000 7fa0b9a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b40bc460 con 0x7fa0b4064950 2024-01-22T05:38:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b2a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa0b40668e0 0x7fa0b40c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40972/0 (socket says 172.21.15.100:40972) 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b2a00700 1 -- 172.21.15.100:0/2263793880 learned_addr learned my addr 172.21.15.100:0/2263793880 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b2000700 1 --2- 172.21.15.100:0/2263793880 >> v2:172.21.15.169:3300/0 conn(0x7fa0b4064950 0x7fa0b40c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572219962 0 0) 0x7fa0b41546c0 con 0x7fa0b40668e0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0940033f0 con 0x7fa0b40668e0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776494325 0 0) 0x7fa0b40bc180 con 0x7fa0b4064dd0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b41546c0 con 0x7fa0b4064dd0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2507069815 0 0) 0x7fa0940033f0 con 0x7fa0b40668e0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 >> v2:172.21.15.169:3300/0 conn(0x7fa0b4064950 msgr2=0x7fa0b40c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 --2- 172.21.15.100:0/2263793880 >> v2:172.21.15.169:3300/0 conn(0x7fa0b4064950 0x7fa0b40c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 >> v1:172.21.15.169:6789/0 conn(0x7fa0b4064dd0 legacy=0x7fa0b40bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40bc740 con 0x7fa0b40668e0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fa0a4001470 con 0x7fa0b40668e0 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.029+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 >> v1:172.21.15.100:6789/0 conn(0x7fa0b40668e0 legacy=0x7fa0b40c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b1600700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa094003ac0 0x7fa094003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b1600700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004690 0x7fa094004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b1600700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094005000 0x7fa09400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40bc460 con 0x7fa094004690 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09400beb0 con 0x7fa094003ac0 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09400c070 con 0x7fa094005000 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2000700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004690 0x7fa094004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2a00700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa094003ac0 0x7fa094003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b3400700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094005000 0x7fa09400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2000700 1 -- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094005000 msgr2=0x7fa09400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2000700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094005000 0x7fa09400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2000700 1 -- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa094003ac0 msgr2=0x7fa094003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2000700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa094003ac0 0x7fa094003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2000700 1 -- 172.21.15.100:0/2263793880 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0940033f0 con 0x7fa094004690 2024-01-22T05:38:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2a00700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa094003ac0 0x7fa094003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b3400700 1 -- 172.21.15.100:0/2263793880 reap_dead start 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.030+0000 7fa0b2000700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004690 0x7fa094004b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fa09c009a80 tx=0x7fa09c009060).ready entity=mon.0 client_cookie=2a8711f1693a733b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c009430 con 0x7fa094004690 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c00e640 con 0x7fa094004690 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b1600700 1 -- 172.21.15.100:0/2263793880 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00e9c0 con 0x7fa094004690 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b9a00700 1 -- 172.21.15.100:0/2263793880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004690 msgr2=0x7fa094004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004690 0x7fa094004b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fa09c009a80 tx=0x7fa09c009060).stop 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b9a00700 1 -- 172.21.15.100:0/2263793880 shutdown_connections 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/2263793880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004690 0x7fa094004b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b9a00700 1 -- 172.21.15.100:0/2263793880 >> 172.21.15.100:0/2263793880 conn(0x7fa0b40c78d0 msgr2=0x7fa0b40c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b9a00700 1 -- 172.21.15.100:0/2263793880 shutdown_connections 2024-01-22T05:38:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.031+0000 7fa0b9a00700 1 -- 172.21.15.100:0/2263793880 wait complete. 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.033+0000 7fa0b9a00700 1 Processor -- start 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.033+0000 7fa0b9a00700 1 -- start start 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b9a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094004690 0x7fa0b4145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b9a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40a78f0 0x7fa0b40a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b9a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b41538f0 0x7fa0b4153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b9a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4154260 con 0x7fa0b40a78f0 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b9a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40a7dd0 con 0x7fa0b41538f0 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b9a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40a80b0 con 0x7fa094004690 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40a78f0 0x7fa0b40a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40a78f0 0x7fa0b40a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40416/0 (socket says 172.21.15.100:40416) 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 -- 172.21.15.100:0/1699319129 learned_addr learned my addr 172.21.15.100:0/1699319129 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094004690 0x7fa0b4145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b3400700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b41538f0 0x7fa0b4153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 -- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094004690 msgr2=0x7fa0b4145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094004690 0x7fa0b4145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 -- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b41538f0 msgr2=0x7fa0b4153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b41538f0 0x7fa0b4153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 -- 172.21.15.100:0/1699319129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40a8390 con 0x7fa0b40a78f0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.034+0000 7fa0b2000700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40a78f0 0x7fa0b40a9330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fa09c00e4b0 tx=0x7fa09c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.035+0000 7fa0aa000700 1 -- 172.21.15.100:0/1699319129 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00ed70 con 0x7fa0b40a78f0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.035+0000 7fa0aa000700 1 -- 172.21.15.100:0/1699319129 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c00eed0 con 0x7fa0b40a78f0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.035+0000 7fa0aa000700 1 -- 172.21.15.100:0/1699319129 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00ea00 con 0x7fa0b40a78f0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.035+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b40a8670 con 0x7fa0b40a78f0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.035+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b41553c0 con 0x7fa0b40a78f0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.036+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b41555b0 con 0x7fa0b40a78f0 2024-01-22T05:38:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.036+0000 7fa0aa000700 1 -- 172.21.15.100:0/1699319129 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa09c0123f0 con 0x7fa0b40a78f0 2024-01-22T05:38:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.037+0000 7fa0aa000700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa08c05f150 0x7fa08c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.037+0000 7fa0aa000700 1 -- 172.21.15.100:0/1699319129 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa09c07b800 con 0x7fa0b40a78f0 2024-01-22T05:38:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.037+0000 7fa0b2a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa08c05f150 0x7fa08c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.038+0000 7fa0b2a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa08c05f150 0x7fa08c061610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa0b4061820 tx=0x7fa0a4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.041+0000 7fa0aa000700 1 -- 172.21.15.100:0/1699319129 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa09c04c9b0 con 0x7fa0b40a78f0 2024-01-22T05:38:59.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.216+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0b405fdb0 con 0x7fa0b40a78f0 2024-01-22T05:38:59.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.216+0000 7fa0aa000700 1 -- 172.21.15.100:0/1699319129 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16989 (secure 0 0 0) 0x7fa09c029090 con 0x7fa0b40a78f0 2024-01-22T05:38:59.218 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:38:58.798713+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:38:56.791674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-22T05:38:57.778340+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa08c05f150 msgr2=0x7fa08c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa08c05f150 0x7fa08c061610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa0b4061820 tx=0x7fa0a4009040).stop 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40a78f0 msgr2=0x7fa0b40a9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40a78f0 0x7fa0b40a9330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fa09c00e4b0 tx=0x7fa09c01a000).stop 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 shutdown_connections 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa08c05f150 0x7fa08c061610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b41538f0 0x7fa0b4153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa094004690 0x7fa0b4145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 --2- 172.21.15.100:0/1699319129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40a78f0 0x7fa0b40a9330 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 >> 172.21.15.100:0/1699319129 conn(0x7fa0b40c78d0 msgr2=0x7fa0b4151950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:59.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 shutdown_connections 2024-01-22T05:38:59.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.219+0000 7fa0b9a00700 1 -- 172.21.15.100:0/1699319129 wait complete. 2024-01-22T05:38:59.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.422+0000 7fc682e00700 1 Processor -- start 2024-01-22T05:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.422+0000 7fc682e00700 1 -- start start 2024-01-22T05:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.423+0000 7fc682e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc67c0aa3f0 0x7fc67c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.423+0000 7fc682e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c0c1530 con 0x7fc67c154060 2024-01-22T05:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.423+0000 7fc682e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c0cb880 con 0x7fc67c0c64b0 2024-01-22T05:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.423+0000 7fc682e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c0cbb60 con 0x7fc67c0aa3f0 2024-01-22T05:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67be00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc67c154060 0x7fc67c0c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40978/0 (socket says 172.21.15.100:40978) 2024-01-22T05:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67be00700 1 -- 172.21.15.100:0/2871408456 learned_addr learned my addr 172.21.15.100:0/2871408456 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:38:59.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840805619 0 0) 0x7fc67c0c1530 con 0x7fc67c154060 2024-01-22T05:38:59.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc65c0033f0 con 0x7fc67c154060 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc680e00700 1 --2- 172.21.15.100:0/2871408456 >> v2:172.21.15.169:3300/0 conn(0x7fc67c0aa3f0 0x7fc67c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335547340 0 0) 0x7fc65c0033f0 con 0x7fc67c154060 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 >> v2:172.21.15.169:3300/0 conn(0x7fc67c0aa3f0 msgr2=0x7fc67c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 --2- 172.21.15.100:0/2871408456 >> v2:172.21.15.169:3300/0 conn(0x7fc67c0aa3f0 0x7fc67c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 >> v1:172.21.15.169:6789/0 conn(0x7fc67c0c64b0 legacy=0x7fc67c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0c17d0 con 0x7fc67c154060 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fc66c001470 con 0x7fc67c154060 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.424+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 >> v1:172.21.15.100:6789/0 conn(0x7fc67c154060 legacy=0x7fc67c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67aa00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc65c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67aa00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc65c004690 0x7fc65c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67aa00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc65c005120 0x7fc65c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c00c080 con 0x7fc65c0039b0 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c00c1f0 con 0x7fc65c005120 2024-01-22T05:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c00c3b0 con 0x7fc65c004690 2024-01-22T05:38:59.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67be00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc65c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc680e00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc65c005120 0x7fc65c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67b400700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc65c004690 0x7fc65c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67be00700 1 -- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc65c004690 msgr2=0x7fc65c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:59.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67be00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc65c004690 0x7fc65c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67be00700 1 -- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc65c005120 msgr2=0x7fc65c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:59.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67be00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc65c005120 0x7fc65c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67be00700 1 -- 172.21.15.100:0/2871408456 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c0033f0 con 0x7fc65c0039b0 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc680e00700 1 -- 172.21.15.100:0/2871408456 reap_dead start 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67be00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc65c003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fc66c007f90 tx=0x7fc67c0c1d90).ready entity=mon.0 client_cookie=7ee742c80607b1e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.425+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00c9a0 con 0x7fc65c0039b0 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c00cb00 con 0x7fc65c0039b0 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc67aa00700 1 -- 172.21.15.100:0/2871408456 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0070d0 con 0x7fc65c0039b0 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc682e00700 1 -- 172.21.15.100:0/2871408456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 msgr2=0x7fc65c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc682e00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc65c003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fc66c007f90 tx=0x7fc67c0c1d90).stop 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc682e00700 1 -- 172.21.15.100:0/2871408456 shutdown_connections 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc682e00700 1 --2- 172.21.15.100:0/2871408456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc65c003dd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc682e00700 1 -- 172.21.15.100:0/2871408456 >> 172.21.15.100:0/2871408456 conn(0x7fc67c05e9d0 msgr2=0x7fc67c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc682e00700 1 -- 172.21.15.100:0/2871408456 shutdown_connections 2024-01-22T05:38:59.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.426+0000 7fc682e00700 1 -- 172.21.15.100:0/2871408456 wait complete. 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.428+0000 7fc682e00700 1 Processor -- start 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.428+0000 7fc682e00700 1 -- start start 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc682e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc67c156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc682e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc67c150f20 0x7fc67c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc682e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc67c0c3ea0 0x7fc67c064470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc682e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c157130 con 0x7fc65c0039b0 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc682e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0ae9d0 con 0x7fc67c150f20 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc682e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0addc0 con 0x7fc67c0c3ea0 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc67c156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc67c156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40432/0 (socket says 172.21.15.100:40432) 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 -- 172.21.15.100:0/2658078702 learned_addr learned my addr 172.21.15.100:0/2658078702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:59.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67b400700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc67c150f20 0x7fc67c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc680e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc67c0c3ea0 0x7fc67c064470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 -- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc67c0c3ea0 msgr2=0x7fc67c064470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc67c0c3ea0 0x7fc67c064470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 -- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc67c150f20 msgr2=0x7fc67c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc67c150f20 0x7fc67c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc67be00700 1 -- 172.21.15.100:0/2658078702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0ae0a0 con 0x7fc65c0039b0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.429+0000 7fc680e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc67c0c3ea0 0x7fc67c064470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.430+0000 7fc67be00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc67c156c40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fc66c00c6a0 tx=0x7fc66c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.430+0000 7fc673400700 1 -- 172.21.15.100:0/2658078702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0070d0 con 0x7fc65c0039b0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.430+0000 7fc673400700 1 -- 172.21.15.100:0/2658078702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c00ce80 con 0x7fc65c0039b0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.430+0000 7fc673400700 1 -- 172.21.15.100:0/2658078702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c000c30 con 0x7fc65c0039b0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.430+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c0ae380 con 0x7fc65c0039b0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.430+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c0c4a20 con 0x7fc65c0039b0 2024-01-22T05:38:59.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.431+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c05fdb0 con 0x7fc65c0039b0 2024-01-22T05:38:59.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.432+0000 7fc673400700 1 -- 172.21.15.100:0/2658078702 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc66c01c070 con 0x7fc65c0039b0 2024-01-22T05:38:59.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.432+0000 7fc673400700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc65405f150 0x7fc654061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.433+0000 7fc673400700 1 -- 172.21.15.100:0/2658078702 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc66c07a850 con 0x7fc65c0039b0 2024-01-22T05:38:59.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.433+0000 7fc67b400700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc65405f150 0x7fc654061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.433+0000 7fc67b400700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc65405f150 0x7fc654061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc67c0cb260 tx=0x7fc664009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.437+0000 7fc673400700 1 -- 172.21.15.100:0/2658078702 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc66c04ba60 con 0x7fc65c0039b0 2024-01-22T05:38:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.608+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc67c159a70 con 0x7fc65c0039b0 2024-01-22T05:38:59.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.609+0000 7fc673400700 1 -- 172.21.15.100:0/2658078702 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16989 (secure 0 0 0) 0x7fc66c04f080 con 0x7fc65c0039b0 2024-01-22T05:38:59.610 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:38:59.610 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:38:58.798713+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:38:56.791674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-22T05:38:57.778340+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc65405f150 msgr2=0x7fc654061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc65405f150 0x7fc654061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc67c0cb260 tx=0x7fc664009040).stop 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 msgr2=0x7fc67c156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc67c156c40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fc66c00c6a0 tx=0x7fc66c015000).stop 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 shutdown_connections 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc65405f150 0x7fc654061610 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc67c0c3ea0 0x7fc67c064470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc65c0039b0 0x7fc67c156c40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 --2- 172.21.15.100:0/2658078702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc67c150f20 0x7fc67c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 >> 172.21.15.100:0/2658078702 conn(0x7fc67c05e9d0 msgr2=0x7fc67c0a84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:59.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 shutdown_connections 2024-01-22T05:38:59.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.611+0000 7fc682e00700 1 -- 172.21.15.100:0/2658078702 wait complete. 2024-01-22T05:38:59.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:38:59.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.815+0000 7f8fc5600700 1 Processor -- start 2024-01-22T05:38:59.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.815+0000 7f8fc5600700 1 -- start start 2024-01-22T05:38:59.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fc5600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc00688f0 0x7f8fc00c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fc5600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8fc0138820 0x7f8fc00c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fc5600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc0064520 con 0x7f8fc0138440 2024-01-22T05:38:59.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fc5600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc0064e30 con 0x7f8fc0138820 2024-01-22T05:38:59.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fc5600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00c5e50 con 0x7f8fc00688f0 2024-01-22T05:38:59.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fbe000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc00688f0 0x7f8fc00c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fbe000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc00688f0 0x7f8fc00c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:52266/0 (socket says 172.21.15.100:52266) 2024-01-22T05:38:59.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fbe000700 1 -- 172.21.15.100:0/394036238 learned_addr learned my addr 172.21.15.100:0/394036238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:59.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fbf400700 1 --2- 172.21.15.100:0/394036238 >> v2:172.21.15.169:3300/0 conn(0x7f8fc0138820 0x7f8fc00c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.817+0000 7f8fbea00700 1 --1- 172.21.15.100:0/394036238 >> v1:172.21.15.169:6789/0 conn(0x7f8fc0138440 0x7f8fc00681e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:40694/0 (socket says 172.21.15.100:40694) 2024-01-22T05:38:59.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbe000700 1 -- 172.21.15.100:0/394036238 >> v2:172.21.15.169:3300/0 conn(0x7f8fc0138820 msgr2=0x7f8fc00c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:38:59.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbe000700 1 --2- 172.21.15.100:0/394036238 >> v2:172.21.15.169:3300/0 conn(0x7f8fc0138820 0x7f8fc00c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbd600700 1 -- 172.21.15.100:0/394036238 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428662950 0 0) 0x7f8fc0064520 con 0x7f8fc0138440 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbe000700 1 -- 172.21.15.100:0/394036238 >> v1:172.21.15.169:6789/0 conn(0x7f8fc0138440 legacy=0x7f8fc00681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbe000700 1 -- 172.21.15.100:0/394036238 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0064770 con 0x7f8fc00688f0 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbe000700 1 --2- 172.21.15.100:0/394036238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc00688f0 0x7f8fc00c5120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8fa8006fd0 tx=0x7f8fa80090f0).ready entity=mon.2 client_cookie=b3f55946119d6604 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbd600700 1 -- 172.21.15.100:0/394036238 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800b580 con 0x7f8fc00688f0 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbd600700 1 -- 172.21.15.100:0/394036238 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800b6e0 con 0x7f8fc00688f0 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.818+0000 7f8fbd600700 1 -- 172.21.15.100:0/394036238 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800ba80 con 0x7f8fc00688f0 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 -- 172.21.15.100:0/394036238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc00688f0 msgr2=0x7f8fc00c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 --2- 172.21.15.100:0/394036238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc00688f0 0x7f8fc00c5120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8fa8006fd0 tx=0x7f8fa80090f0).stop 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 -- 172.21.15.100:0/394036238 shutdown_connections 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 --2- 172.21.15.100:0/394036238 >> v2:172.21.15.169:3300/0 conn(0x7f8fc0138820 0x7f8fc00c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 --2- 172.21.15.100:0/394036238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc00688f0 0x7f8fc00c5120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 -- 172.21.15.100:0/394036238 >> 172.21.15.100:0/394036238 conn(0x7f8fc00630c0 msgr2=0x7f8fc00c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 -- 172.21.15.100:0/394036238 shutdown_connections 2024-01-22T05:38:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.819+0000 7f8fc5600700 1 -- 172.21.15.100:0/394036238 wait complete. 2024-01-22T05:38:59.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.821+0000 7f8fc5600700 1 Processor -- start 2024-01-22T05:38:59.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.821+0000 7f8fc5600700 1 -- start start 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fc5600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fc00688f0 0x7f8fc014f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fc5600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0138440 0x7f8fc00c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fc5600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc0138820 0x7f8fc00a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fc5600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00a6f90 con 0x7f8fc0138440 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fc5600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00a6380 con 0x7f8fc00688f0 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fc5600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00a6660 con 0x7f8fc0138820 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0138440 0x7f8fc00c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0138440 0x7f8fc00c1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40446/0 (socket says 172.21.15.100:40446) 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 -- 172.21.15.100:0/3212177333 learned_addr learned my addr 172.21.15.100:0/3212177333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbea00700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fc00688f0 0x7f8fc014f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbf400700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc0138820 0x7f8fc00a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 -- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc0138820 msgr2=0x7f8fc00a78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc0138820 0x7f8fc00a78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 -- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fc00688f0 msgr2=0x7f8fc014f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fc00688f0 0x7f8fc014f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.823+0000 7f8fbe000700 1 -- 172.21.15.100:0/3212177333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009370 con 0x7f8fc0138440 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.824+0000 7f8fbe000700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0138440 0x7f8fc00c1ea0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f8fc00c5f90 tx=0x7f8fa8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.824+0000 7f8fb6000700 1 -- 172.21.15.100:0/3212177333 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8006930 con 0x7f8fc0138440 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.824+0000 7f8fb6000700 1 -- 172.21.15.100:0/3212177333 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800be40 con 0x7f8fc0138440 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.824+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc00a6940 con 0x7f8fc0138440 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.824+0000 7f8fb6000700 1 -- 172.21.15.100:0/3212177333 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa801c420 con 0x7f8fc0138440 2024-01-22T05:38:59.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.824+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc014fc70 con 0x7f8fc0138440 2024-01-22T05:38:59.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.825+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc00a7100 con 0x7f8fc0138440 2024-01-22T05:38:59.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.826+0000 7f8fb6000700 1 -- 172.21.15.100:0/3212177333 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8fa801c7d0 con 0x7f8fc0138440 2024-01-22T05:38:59.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.827+0000 7f8fb6000700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f9805f150 0x7f8f98061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:38:59.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.827+0000 7f8fb6000700 1 -- 172.21.15.100:0/3212177333 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8fa807bd70 con 0x7f8fc0138440 2024-01-22T05:38:59.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.827+0000 7f8fbea00700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f9805f150 0x7f8f98061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:38:59.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.827+0000 7f8fbea00700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f9805f150 0x7f8f98061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f8fb00011e0 tx=0x7f8fb0007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:38:59.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:38:59.830+0000 7f8fb6000700 1 -- 172.21.15.100:0/3212177333 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8fa804d040 con 0x7f8fc0138440 2024-01-22T05:39:00.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.046+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8fc005fdb0 con 0x7f8fc0138440 2024-01-22T05:39:00.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.808+0000 7f8fb6000700 1 -- 172.21.15.100:0/3212177333 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8fa802a030 con 0x7f8fc0138440 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f9805f150 msgr2=0x7f8f98061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f9805f150 0x7f8f98061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f8fb00011e0 tx=0x7f8fb0007bd0).stop 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0138440 msgr2=0x7f8fc00c1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0138440 0x7f8fc00c1ea0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f8fc00c5f90 tx=0x7f8fa8017000).stop 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 shutdown_connections 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f9805f150 0x7f8f98061610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fc00688f0 0x7f8fc014f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fc0138820 0x7f8fc00a78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 --2- 172.21.15.100:0/3212177333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0138440 0x7f8fc00c1ea0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.810+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 >> 172.21.15.100:0/3212177333 conn(0x7f8fc00630c0 msgr2=0x7f8fc00a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.811+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 shutdown_connections 2024-01-22T05:39:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:00.811+0000 7f8fc5600700 1 -- 172.21.15.100:0/3212177333 wait complete. 2024-01-22T05:39:00.831 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:39:00.831 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:39:01.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.017+0000 7f76f4600700 1 Processor -- start 2024-01-22T05:39:01.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.018+0000 7f76f4600700 1 -- start start 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f4600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f4600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76ec0c5960 0x7f76ec0c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f4600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0c5e10 con 0x7f76ec157290 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f4600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec065000 con 0x7f76ec0c5960 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f4600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec092820 con 0x7f76ec157670 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f2600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76ec0c5960 0x7f76ec0c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f2600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76ec0c5960 0x7f76ec0c3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40462/0 (socket says 172.21.15.100:40462) 2024-01-22T05:39:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.019+0000 7f76f2600700 1 -- 172.21.15.100:0/1722253484 learned_addr learned my addr 172.21.15.100:0/1722253484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76f1200700 1 --2- 172.21.15.100:0/1722253484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76f2600700 1 -- 172.21.15.100:0/1722253484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 msgr2=0x7f76ec0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76f2600700 1 --2- 172.21.15.100:0/1722253484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec0c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76f2600700 1 -- 172.21.15.100:0/1722253484 >> v1:172.21.15.169:6789/0 conn(0x7f76ec157290 legacy=0x7f76ec092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76f2600700 1 -- 172.21.15.100:0/1722253484 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0643f0 con 0x7f76ec0c5960 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76f1200700 1 --2- 172.21.15.100:0/1722253484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec0c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76f2600700 1 --2- 172.21.15.100:0/1722253484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec0c5960 0x7f76ec0c3240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f76e4009f20 tx=0x7f76e4009840).ready entity=mon.0 client_cookie=cc482f69fd2454ac server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76ebe00700 1 -- 172.21.15.100:0/1722253484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400e070 con 0x7f76ec0c5960 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76ebe00700 1 -- 172.21.15.100:0/1722253484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e400ba40 con 0x7f76ec0c5960 2024-01-22T05:39:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.020+0000 7f76ebe00700 1 -- 172.21.15.100:0/1722253484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400bdc0 con 0x7f76ec0c5960 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 -- 172.21.15.100:0/1722253484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec0c5960 msgr2=0x7f76ec0c3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 --2- 172.21.15.100:0/1722253484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec0c5960 0x7f76ec0c3240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f76e4009f20 tx=0x7f76e4009840).stop 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 -- 172.21.15.100:0/1722253484 shutdown_connections 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 --2- 172.21.15.100:0/1722253484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec0c5960 0x7f76ec0c3240 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 --2- 172.21.15.100:0/1722253484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec0c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 -- 172.21.15.100:0/1722253484 >> 172.21.15.100:0/1722253484 conn(0x7f76ec05e9d0 msgr2=0x7f76ec091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 -- 172.21.15.100:0/1722253484 shutdown_connections 2024-01-22T05:39:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.021+0000 7f76f4600700 1 -- 172.21.15.100:0/1722253484 wait complete. 2024-01-22T05:39:01.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.022+0000 7f76f4600700 1 Processor -- start 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.023+0000 7f76f4600700 1 -- start start 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.023+0000 7f76f4600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec0c5960 0x7f76ec0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.023+0000 7f76f4600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec157290 0x7f76ec067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f4600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f4600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec1656b0 con 0x7f76ec157290 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f4600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0aeac0 con 0x7f76ec0c5960 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f4600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0c9700 con 0x7f76ec157670 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec157290 0x7f76ec067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec157290 0x7f76ec067c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40476/0 (socket says 172.21.15.100:40476) 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 -- 172.21.15.100:0/361051837 learned_addr learned my addr 172.21.15.100:0/361051837 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1c00700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec0c5960 0x7f76ec0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 -- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 msgr2=0x7f76ec154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f2600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 -- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec0c5960 msgr2=0x7f76ec0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec0c5960 0x7f76ec0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 -- 172.21.15.100:0/361051837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4009ae0 con 0x7f76ec157290 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1c00700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec0c5960 0x7f76ec0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f2600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.024+0000 7f76f1200700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec157290 0x7f76ec067c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f76d400c880 tx=0x7f76d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.025+0000 7f76e8c00700 1 -- 172.21.15.100:0/361051837 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4010580 con 0x7f76ec157290 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.025+0000 7f76e8c00700 1 -- 172.21.15.100:0/361051837 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d40106e0 con 0x7f76ec157290 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.025+0000 7f76e8c00700 1 -- 172.21.15.100:0/361051837 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4010a80 con 0x7f76ec157290 2024-01-22T05:39:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.025+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec164b30 con 0x7f76ec157290 2024-01-22T05:39:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.025+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec165170 con 0x7f76ec157290 2024-01-22T05:39:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.026+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec065750 con 0x7f76ec157290 2024-01-22T05:39:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.027+0000 7f76e8c00700 1 -- 172.21.15.100:0/361051837 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f76d401b460 con 0x7f76ec157290 2024-01-22T05:39:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.028+0000 7f76e8c00700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76c405f180 0x7f76c4061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.028+0000 7f76e8c00700 1 -- 172.21.15.100:0/361051837 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f76d407a120 con 0x7f76ec157290 2024-01-22T05:39:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.028+0000 7f76f1c00700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76c405f180 0x7f76c4061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.028+0000 7f76f1c00700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76c405f180 0x7f76c4061640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f76ec068630 tx=0x7f76dc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.032+0000 7f76e8c00700 1 -- 172.21.15.100:0/361051837 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f76d404b390 con 0x7f76ec157290 2024-01-22T05:39:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.245+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f76ec05fdb0 con 0x7f76ec157290 2024-01-22T05:39:01.320 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-01-22T05:39:01.320+0000 7ff6b4a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:39:01.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.813+0000 7f76e8c00700 1 -- 172.21.15.100:0/361051837 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f76d404e9b0 con 0x7f76ec157290 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76c405f180 msgr2=0x7f76c4061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76c405f180 0x7f76c4061640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f76ec068630 tx=0x7f76dc009040).stop 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec157290 msgr2=0x7f76ec067c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec157290 0x7f76ec067c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f76d400c880 tx=0x7f76d4008040).stop 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 shutdown_connections 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76c405f180 0x7f76c4061640 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec0c5960 0x7f76ec0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76ec157670 0x7f76ec154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 --2- 172.21.15.100:0/361051837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76ec157290 0x7f76ec067c20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 >> 172.21.15.100:0/361051837 conn(0x7f76ec05e9d0 msgr2=0x7f76ec0c4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 shutdown_connections 2024-01-22T05:39:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:01.816+0000 7f76f4600700 1 -- 172.21.15.100:0/361051837 wait complete. 2024-01-22T05:39:01.835 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:39:01.835 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.017+0000 7f35d3600700 1 Processor -- start 2024-01-22T05:39:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.017+0000 7f35d3600700 1 -- start start 2024-01-22T05:39:02.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.019+0000 7f35d3600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f35cc154060 0x7f35cc154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.019+0000 7f35d3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 0x7f35cc0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.019+0000 7f35d3600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0c1530 con 0x7f35cc0aa3f0 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.019+0000 7f35d3600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc0cbb60 con 0x7f35cc154060 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.019+0000 7f35d3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0cb880 con 0x7f35cc0c64b0 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.019+0000 7f35cbe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f35cc0aa3f0 0x7f35cc0c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40992/0 (socket says 172.21.15.100:40992) 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.019+0000 7f35cbe00700 1 -- 172.21.15.100:0/2435593875 learned_addr learned my addr 172.21.15.100:0/2435593875 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438299862 0 0) 0x7f35cc0c1530 con 0x7f35cc0aa3f0 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35d0c00700 1 --2- 172.21.15.100:0/2435593875 >> v2:172.21.15.169:3300/0 conn(0x7f35cc154060 0x7f35cc154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35ac0033f0 con 0x7f35cc0aa3f0 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35d1600700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 0x7f35cc0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 97307929 0 0) 0x7f35ac0033f0 con 0x7f35cc0aa3f0 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 msgr2=0x7f35cc0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 0x7f35cc0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 >> v2:172.21.15.169:3300/0 conn(0x7f35cc154060 msgr2=0x7f35cc154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 --2- 172.21.15.100:0/2435593875 >> v2:172.21.15.169:3300/0 conn(0x7f35cc154060 0x7f35cc154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0c17d0 con 0x7f35cc0aa3f0 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f35b4001470 con 0x7f35cc0aa3f0 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 >> v1:172.21.15.100:6789/0 conn(0x7f35cc0aa3f0 legacy=0x7f35cc0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 0x7f35ac003960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35ac003ee0 0x7f35ac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac004b80 0x7f35ac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0cb880 con 0x7f35ac003ee0 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac00b8e0 con 0x7f35ac004b80 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.020+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac00ba50 con 0x7f35cc0c64b0 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cbe00700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35ac003ee0 0x7f35ac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35d0c00700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 0x7f35ac003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35d1600700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac004b80 0x7f35ac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cbe00700 1 -- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 msgr2=0x7f35ac003960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cbe00700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c64b0 0x7f35ac003960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cbe00700 1 -- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac004b80 msgr2=0x7f35ac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cbe00700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac004b80 0x7f35ac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cbe00700 1 -- 172.21.15.100:0/2435593875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0033f0 con 0x7f35ac003ee0 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cbe00700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35ac003ee0 0x7f35ac004690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f35cc0aa7f0 tx=0x7f35cc0c0470).ready entity=mon.0 client_cookie=fe864e9fcd127177 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40079b0 con 0x7f35ac003ee0 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400c9e0 con 0x7f35ac003ee0 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.021+0000 7f35cb400700 1 -- 172.21.15.100:0/2435593875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400cd60 con 0x7f35ac003ee0 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.022+0000 7f35d3600700 1 -- 172.21.15.100:0/2435593875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35ac003ee0 msgr2=0x7f35ac004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.022+0000 7f35d3600700 1 --2- 172.21.15.100:0/2435593875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35ac003ee0 0x7f35ac004690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f35cc0aa7f0 tx=0x7f35cc0c0470).stop 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.022+0000 7f35d1600700 1 -- 172.21.15.100:0/2435593875 reap_dead start 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.022+0000 7f35d3600700 1 -- 172.21.15.100:0/2435593875 shutdown_connections 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.022+0000 7f35d3600700 1 -- 172.21.15.100:0/2435593875 >> 172.21.15.100:0/2435593875 conn(0x7f35cc05e9d0 msgr2=0x7f35cc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.022+0000 7f35d3600700 1 -- 172.21.15.100:0/2435593875 shutdown_connections 2024-01-22T05:39:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.022+0000 7f35d3600700 1 -- 172.21.15.100:0/2435593875 wait complete. 2024-01-22T05:39:02.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.024+0000 7f35d3600700 1 Processor -- start 2024-01-22T05:39:02.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.024+0000 7f35d3600700 1 -- start start 2024-01-22T05:39:02.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d3600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac003ee0 0x7f35cc14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d3600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35cc0c1eb0 0x7f35cc14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c2310 0x7f35cc14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d3600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc14ebf0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d3600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc14de10 con 0x7f35ac003ee0 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc14edd0 con 0x7f35cc0c2310 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35cc0c1eb0 0x7f35cc14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35cc0c1eb0 0x7f35cc14e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40494/0 (socket says 172.21.15.100:40494) 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 -- 172.21.15.100:0/2409460657 learned_addr learned my addr 172.21.15.100:0/2409460657 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d0c00700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac003ee0 0x7f35cc14ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35d1600700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c2310 0x7f35cc14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 -- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c2310 msgr2=0x7f35cc14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c2310 0x7f35cc14e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 -- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac003ee0 msgr2=0x7f35cc14ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac003ee0 0x7f35cc14ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.025+0000 7f35cbe00700 1 -- 172.21.15.100:0/2409460657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc14f0b0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.026+0000 7f35cbe00700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35cc0c1eb0 0x7f35cc14e210 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f35b400c6a0 tx=0x7f35b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.026+0000 7f35c3e00700 1 -- 172.21.15.100:0/2409460657 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4001580 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.026+0000 7f35c3e00700 1 -- 172.21.15.100:0/2409460657 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b40016e0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.026+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc0aed40 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.026+0000 7f35c3e00700 1 -- 172.21.15.100:0/2409460657 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004900 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.026+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc0af300 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.027+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc0af4f0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.028+0000 7f35c3e00700 1 -- 172.21.15.100:0/2409460657 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f35b4004cb0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.028+0000 7f35c3e00700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f35a405f150 0x7f35a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.028+0000 7f35c3e00700 1 -- 172.21.15.100:0/2409460657 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35b407aec0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.029+0000 7f35d0c00700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f35a405f150 0x7f35a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.029+0000 7f35d0c00700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f35a405f150 0x7f35a4061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f35bc006d80 tx=0x7f35bc009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.032+0000 7f35c3e00700 1 -- 172.21.15.100:0/2409460657 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f35b404c0d0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.241+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35cc05fdb0 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.241+0000 7f35c3e00700 1 -- 172.21.15.100:0/2409460657 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f35b4025020 con 0x7f35cc0c1eb0 2024-01-22T05:39:02.242 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:02.242 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:38:58.799067+0000","modified":"2024-01-22T05:39:01.808491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6834/2612830615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2612830615},{"type":"v1","addr":"172.21.15.169:6834","nonce":2612830615}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f35a405f150 msgr2=0x7f35a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f35a405f150 0x7f35a4061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f35bc006d80 tx=0x7f35bc009060).stop 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35cc0c1eb0 msgr2=0x7f35cc14e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35cc0c1eb0 0x7f35cc14e210 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f35b400c6a0 tx=0x7f35b4015000).stop 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 shutdown_connections 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f35a405f150 0x7f35a4061610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac003ee0 0x7f35cc14ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35cc0c2310 0x7f35cc14e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 --2- 172.21.15.100:0/2409460657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35cc0c1eb0 0x7f35cc14e210 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.243+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 >> 172.21.15.100:0/2409460657 conn(0x7f35cc05e9d0 msgr2=0x7f35cc150920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.244+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 shutdown_connections 2024-01-22T05:39:02.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.244+0000 7f35d3600700 1 -- 172.21.15.100:0/2409460657 wait complete. 2024-01-22T05:39:02.246 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-01-22T05:39:02.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:02.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.446+0000 7f44eac00700 1 Processor -- start 2024-01-22T05:39:02.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.446+0000 7f44eac00700 1 -- start start 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44eac00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e40c64b0 0x7f44e4154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44eac00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44e40aa3f0 0x7f44e40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44eac00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e40c1530 con 0x7f44e4154060 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44eac00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e40cbb60 con 0x7f44e40aa3f0 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44eac00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40cb880 con 0x7f44e40c64b0 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44e3e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f44e4154060 0x7f44e40c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41004/0 (socket says 172.21.15.100:41004) 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44e3e00700 1 -- 172.21.15.100:0/3815131962 learned_addr learned my addr 172.21.15.100:0/3815131962 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44e8c00700 1 --2- 172.21.15.100:0/3815131962 >> v2:172.21.15.169:3300/0 conn(0x7f44e40aa3f0 0x7f44e40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.448+0000 7f44e3400700 1 --2- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e40c64b0 0x7f44e4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e2a00700 1 -- 172.21.15.100:0/3815131962 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496285927 0 0) 0x7f44e40c1530 con 0x7f44e4154060 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e2a00700 1 -- 172.21.15.100:0/3815131962 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c40033f0 con 0x7f44e4154060 2024-01-22T05:39:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e2a00700 1 -- 172.21.15.100:0/3815131962 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2374334709 0 0) 0x7f44c40033f0 con 0x7f44e4154060 2024-01-22T05:39:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e8c00700 1 -- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e40c64b0 msgr2=0x7f44e4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e8c00700 1 --2- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e40c64b0 0x7f44e4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e8c00700 1 -- 172.21.15.100:0/3815131962 >> v1:172.21.15.100:6789/0 conn(0x7f44e4154060 legacy=0x7f44e40c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e8c00700 1 -- 172.21.15.100:0/3815131962 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40c17d0 con 0x7f44e40aa3f0 2024-01-22T05:39:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e8c00700 1 --2- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40c9950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f44dc009e60 tx=0x7f44dc009780).ready entity=mon.1 client_cookie=c46aca036c4147d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e2a00700 1 -- 172.21.15.100:0/3815131962 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00e070 con 0x7f44e40aa3f0 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e2a00700 1 -- 172.21.15.100:0/3815131962 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00b7a0 con 0x7f44e40aa3f0 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.449+0000 7f44e2a00700 1 -- 172.21.15.100:0/3815131962 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4001470 con 0x7f44e40aa3f0 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 -- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 msgr2=0x7f44e40c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 --2- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40c9950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f44dc009e60 tx=0x7f44dc009780).stop 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 -- 172.21.15.100:0/3815131962 shutdown_connections 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 --2- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40c9950 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 --2- 172.21.15.100:0/3815131962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e40c64b0 0x7f44e4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 -- 172.21.15.100:0/3815131962 >> 172.21.15.100:0/3815131962 conn(0x7f44e405e9d0 msgr2=0x7f44e40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:02.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 -- 172.21.15.100:0/3815131962 shutdown_connections 2024-01-22T05:39:02.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.450+0000 7f44eac00700 1 -- 172.21.15.100:0/3815131962 wait complete. 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.452+0000 7f44eac00700 1 Processor -- start 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.452+0000 7f44eac00700 1 -- start start 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44eac00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40a8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44eac00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44e40c64b0 0x7f44e4143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44eac00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e4154060 0x7f44e40c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44eac00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40a8cf0 con 0x7f44e40c64b0 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44eac00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40ae6e0 con 0x7f44e40aa3f0 2024-01-22T05:39:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44eac00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e41453d0 con 0x7f44e4154060 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44e40c64b0 0x7f44e4143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44e40c64b0 0x7f44e4143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40498/0 (socket says 172.21.15.100:40498) 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 -- 172.21.15.100:0/849059364 learned_addr learned my addr 172.21.15.100:0/849059364 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e8c00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e4154060 0x7f44e40c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3e00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 -- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e4154060 msgr2=0x7f44e40c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e4154060 0x7f44e40c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 -- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 msgr2=0x7f44e40a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40a8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 -- 172.21.15.100:0/849059364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc009a20 con 0x7f44e40c64b0 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e8c00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e4154060 0x7f44e40c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3e00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.453+0000 7f44e3400700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44e40c64b0 0x7f44e4143870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f44cc00e900 tx=0x7f44cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.454+0000 7f44db400700 1 -- 172.21.15.100:0/849059364 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00eea0 con 0x7f44e40c64b0 2024-01-22T05:39:02.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.454+0000 7f44db400700 1 -- 172.21.15.100:0/849059364 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc00c850 con 0x7f44e40c64b0 2024-01-22T05:39:02.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.454+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e40ae090 con 0x7f44e40c64b0 2024-01-22T05:39:02.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.454+0000 7f44db400700 1 -- 172.21.15.100:0/849059364 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00cbd0 con 0x7f44e40c64b0 2024-01-22T05:39:02.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.454+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e40add20 con 0x7f44e40c64b0 2024-01-22T05:39:02.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.455+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e40ae870 con 0x7f44e40c64b0 2024-01-22T05:39:02.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.455+0000 7f44db400700 1 -- 172.21.15.100:0/849059364 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f44cc01b400 con 0x7f44e40c64b0 2024-01-22T05:39:02.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.457+0000 7f44db400700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f44bc05f150 0x7f44bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.457+0000 7f44db400700 1 -- 172.21.15.100:0/849059364 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44cc07a7e0 con 0x7f44e40c64b0 2024-01-22T05:39:02.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.457+0000 7f44e3e00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f44bc05f150 0x7f44bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.457+0000 7f44e3e00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f44bc05f150 0x7f44bc061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f44d40011e0 tx=0x7f44d40015e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.461+0000 7f44db400700 1 -- 172.21.15.100:0/849059364 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f44cc04b9d0 con 0x7f44e40c64b0 2024-01-22T05:39:02.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.632+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44e405fdb0 con 0x7f44e40c64b0 2024-01-22T05:39:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.633+0000 7f44db400700 1 -- 172.21.15.100:0/849059364 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f44cc016070 con 0x7f44e40c64b0 2024-01-22T05:39:02.635 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:02.635 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":36,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:38:59.801663+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:38:56.791674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-22T05:38:57.778340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f44bc05f150 msgr2=0x7f44bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f44bc05f150 0x7f44bc061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f44d40011e0 tx=0x7f44d40015e0).stop 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44e40c64b0 msgr2=0x7f44e4143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44e40c64b0 0x7f44e4143870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f44cc00e900 tx=0x7f44cc009060).stop 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 shutdown_connections 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f44bc05f150 0x7f44bc061610 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44e40aa3f0 0x7f44e40a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44e4154060 0x7f44e40c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 --2- 172.21.15.100:0/849059364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44e40c64b0 0x7f44e4143870 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.635+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 >> 172.21.15.100:0/849059364 conn(0x7f44e405e9d0 msgr2=0x7f44e4150600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.636+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 shutdown_connections 2024-01-22T05:39:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.636+0000 7f44eac00700 1 -- 172.21.15.100:0/849059364 wait complete. 2024-01-22T05:39:02.654 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:39:02.654 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:39:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.836+0000 7fcca3e00700 1 Processor -- start 2024-01-22T05:39:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.836+0000 7fcca3e00700 1 -- start start 2024-01-22T05:39:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.837+0000 7fcca3e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcc9c154060 0x7fcc9c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.837+0000 7fcca3e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcc9c0c64b0 0x7fcc9c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca3e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c0c1530 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca3e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c0cbb60 con 0x7fcc9c154060 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca3e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c0cb880 con 0x7fcc9c0c64b0 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcc9c154060 0x7fcc9c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcc9c154060 0x7fcc9c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40512/0 (socket says 172.21.15.100:40512) 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 -- 172.21.15.100:0/156014819 learned_addr learned my addr 172.21.15.100:0/156014819 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca0a00700 1 --1- 172.21.15.100:0/156014819 >> v1:172.21.15.100:6789/0 conn(0x7fcc9c0aa3f0 0x7fcc9c0c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41006/0 (socket says 172.21.15.100:41006) 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1e00700 1 --2- 172.21.15.100:0/156014819 >> v2:172.21.15.169:3300/0 conn(0x7fcc9c0c64b0 0x7fcc9c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 -- 172.21.15.100:0/156014819 >> v2:172.21.15.169:3300/0 conn(0x7fcc9c0c64b0 msgr2=0x7fcc9c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 --2- 172.21.15.100:0/156014819 >> v2:172.21.15.169:3300/0 conn(0x7fcc9c0c64b0 0x7fcc9c0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 -- 172.21.15.100:0/156014819 >> v1:172.21.15.100:6789/0 conn(0x7fcc9c0aa3f0 legacy=0x7fcc9c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 -- 172.21.15.100:0/156014819 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0c17d0 con 0x7fcc9c154060 2024-01-22T05:39:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1e00700 1 --2- 172.21.15.100:0/156014819 >> v2:172.21.15.169:3300/0 conn(0x7fcc9c0c64b0 0x7fcc9c0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcc9be00700 1 -- 172.21.15.100:0/156014819 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421195514 0 0) 0x7fcc9c0c1530 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.838+0000 7fcca1400700 1 --2- 172.21.15.100:0/156014819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c154060 0x7fcc9c154440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fcc9c0c5aa0 tx=0x7fcc8c0090f0).ready entity=mon.0 client_cookie=1eaa26bd6f028c62 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcc9be00700 1 -- 172.21.15.100:0/156014819 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00b600 con 0x7fcc9c154060 2024-01-22T05:39:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcc9be00700 1 -- 172.21.15.100:0/156014819 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00b760 con 0x7fcc9c154060 2024-01-22T05:39:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcc9be00700 1 -- 172.21.15.100:0/156014819 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00bae0 con 0x7fcc9c154060 2024-01-22T05:39:02.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcca3e00700 1 -- 172.21.15.100:0/156014819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c154060 msgr2=0x7fcc9c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcca3e00700 1 --2- 172.21.15.100:0/156014819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c154060 0x7fcc9c154440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fcc9c0c5aa0 tx=0x7fcc8c0090f0).stop 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcca3e00700 1 -- 172.21.15.100:0/156014819 shutdown_connections 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcca3e00700 1 --2- 172.21.15.100:0/156014819 >> v2:172.21.15.169:3300/0 conn(0x7fcc9c0c64b0 0x7fcc9c0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcca3e00700 1 --2- 172.21.15.100:0/156014819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c154060 0x7fcc9c154440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcca3e00700 1 -- 172.21.15.100:0/156014819 >> 172.21.15.100:0/156014819 conn(0x7fcc9c05e9d0 msgr2=0x7fcc9c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.839+0000 7fcca3e00700 1 -- 172.21.15.100:0/156014819 shutdown_connections 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.840+0000 7fcca3e00700 1 -- 172.21.15.100:0/156014819 wait complete. 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.841+0000 7fcca3e00700 1 Processor -- start 2024-01-22T05:39:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.841+0000 7fcca3e00700 1 -- start start 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca3e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c0aa3f0 0x7fcc9c143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca3e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc9c0c64b0 0x7fcc9c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca3e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc9c154060 0x7fcc9c0ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca3e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0af280 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca3e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c143d60 con 0x7fcc9c0c64b0 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca3e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0ae670 con 0x7fcc9c154060 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca1400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c0aa3f0 0x7fcc9c143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca1400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c0aa3f0 0x7fcc9c143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40528/0 (socket says 172.21.15.100:40528) 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.842+0000 7fcca1400700 1 -- 172.21.15.100:0/403760275 learned_addr learned my addr 172.21.15.100:0/403760275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc9c154060 0x7fcc9c0ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca0a00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc9c0c64b0 0x7fcc9c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1400700 1 -- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc9c154060 msgr2=0x7fcc9c0ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1400700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc9c154060 0x7fcc9c0ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1400700 1 -- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc9c0c64b0 msgr2=0x7fcc9c0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1400700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc9c0c64b0 0x7fcc9c0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1400700 1 -- 172.21.15.100:0/403760275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c009370 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc9c154060 0x7fcc9c0ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca0a00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc9c0c64b0 0x7fcc9c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca1400700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c0aa3f0 0x7fcc9c143870 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fcc9c065810 tx=0x7fcc8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcc98c00700 1 -- 172.21.15.100:0/403760275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00bae0 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcc98c00700 1 -- 172.21.15.100:0/403760275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c000c90 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c0ae950 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcc98c00700 1 -- 172.21.15.100:0/403760275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c01b640 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.843+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c0aef10 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.845+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c05fdb0 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.845+0000 7fcc98c00700 1 -- 172.21.15.100:0/403760275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcc8c01ba30 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.846+0000 7fcc98c00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc7405f150 0x7fcc74061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.846+0000 7fcc98c00700 1 -- 172.21.15.100:0/403760275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcc8c07bce0 con 0x7fcc9c0aa3f0 2024-01-22T05:39:02.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.846+0000 7fcca0a00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc7405f150 0x7fcc74061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:02.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.847+0000 7fcca0a00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc7405f150 0x7fcc74061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fcc9c0afee0 tx=0x7fcc84009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:02.850+0000 7fcc98c00700 1 -- 172.21.15.100:0/403760275 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc8c04cfb0 con 0x7fcc9c0aa3f0 2024-01-22T05:39:03.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.016+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc9c06abb0 con 0x7fcc7405f150 2024-01-22T05:39:03.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.027+0000 7fcc98c00700 1 -- 172.21.15.100:0/403760275 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+351606 (secure 0 0 0) 0x7fcc9c06abb0 con 0x7fcc7405f150 2024-01-22T05:39:03.037 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:03.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc7405f150 msgr2=0x7fcc74061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc7405f150 0x7fcc74061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fcc9c0afee0 tx=0x7fcc84009040).stop 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c0aa3f0 msgr2=0x7fcc9c143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c0aa3f0 0x7fcc9c143870 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fcc9c065810 tx=0x7fcc8c017000).stop 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 shutdown_connections 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcc7405f150 0x7fcc74061610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc9c154060 0x7fcc9c0ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc9c0aa3f0 0x7fcc9c143870 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 --2- 172.21.15.100:0/403760275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc9c0c64b0 0x7fcc9c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.032+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 >> 172.21.15.100:0/403760275 conn(0x7fcc9c05e9d0 msgr2=0x7fcc9c0c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.033+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 shutdown_connections 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.033+0000 7fcca3e00700 1 -- 172.21.15.100:0/403760275 wait complete. 2024-01-22T05:39:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:39:03.051 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-01-22T05:39:01.142161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":678,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":68,"acting":68,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379604,"kb_used_data":2836,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595116,"statfs":{"total":773094113280,"available":770657398784,"internally_reserved":0,"allocated":2904064,"data_stored":1160879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5393,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.157961"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842353+0000","last_change":"2024-01-22T05:38:58.840422+0000","last_active":"2024-01-22T05:38:58.842353+0000","last_peered":"2024-01-22T05:38:58.842353+0000","last_clean":"2024-01-22T05:38:58.842353+0000","last_became_active":"2024-01-22T05:38:58.840127+0000","last_became_peered":"2024-01-22T05:38:58.840127+0000","last_unstale":"2024-01-22T05:38:58.842353+0000","last_undegraded":"2024-01-22T05:38:58.842353+0000","last_fullsized":"2024-01-22T05:38:58.842353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840467+0000","last_change":"2024-01-22T05:38:58.833696+0000","last_active":"2024-01-22T05:38:58.840467+0000","last_peered":"2024-01-22T05:38:58.840467+0000","last_clean":"2024-01-22T05:38:58.840467+0000","last_became_active":"2024-01-22T05:38:58.833270+0000","last_became_peered":"2024-01-22T05:38:58.833270+0000","last_unstale":"2024-01-22T05:38:58.840467+0000","last_undegraded":"2024-01-22T05:38:58.840467+0000","last_fullsized":"2024-01-22T05:38:58.840467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840649+0000","last_change":"2024-01-22T05:38:58.833736+0000","last_active":"2024-01-22T05:38:58.840649+0000","last_peered":"2024-01-22T05:38:58.840649+0000","last_clean":"2024-01-22T05:38:58.840649+0000","last_became_active":"2024-01-22T05:38:58.832670+0000","last_became_peered":"2024-01-22T05:38:58.832670+0000","last_unstale":"2024-01-22T05:38:58.840649+0000","last_undegraded":"2024-01-22T05:38:58.840649+0000","last_fullsized":"2024-01-22T05:38:58.840649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837329+0000","last_change":"2024-01-22T05:38:58.378156+0000","last_active":"2024-01-22T05:38:58.837329+0000","last_peered":"2024-01-22T05:38:58.837329+0000","last_clean":"2024-01-22T05:38:58.837329+0000","last_became_active":"2024-01-22T05:38:58.377732+0000","last_became_peered":"2024-01-22T05:38:58.377732+0000","last_unstale":"2024-01-22T05:38:58.837329+0000","last_undegraded":"2024-01-22T05:38:58.837329+0000","last_fullsized":"2024-01-22T05:38:58.837329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835962+0000","last_change":"2024-01-22T05:38:58.827520+0000","last_active":"2024-01-22T05:38:58.835962+0000","last_peered":"2024-01-22T05:38:58.835962+0000","last_clean":"2024-01-22T05:38:58.835962+0000","last_became_active":"2024-01-22T05:38:58.823709+0000","last_became_peered":"2024-01-22T05:38:58.823709+0000","last_unstale":"2024-01-22T05:38:58.835962+0000","last_undegraded":"2024-01-22T05:38:58.835962+0000","last_fullsized":"2024-01-22T05:38:58.835962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.815459+0000","last_change":"2024-01-22T05:38:58.370361+0000","last_active":"2024-01-22T05:38:58.815459+0000","last_peered":"2024-01-22T05:38:58.815459+0000","last_clean":"2024-01-22T05:38:58.815459+0000","last_became_active":"2024-01-22T05:38:58.369992+0000","last_became_peered":"2024-01-22T05:38:58.369992+0000","last_unstale":"2024-01-22T05:38:58.815459+0000","last_undegraded":"2024-01-22T05:38:58.815459+0000","last_fullsized":"2024-01-22T05:38:58.815459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.811724+0000","last_change":"2024-01-22T05:38:58.368098+0000","last_active":"2024-01-22T05:38:58.811724+0000","last_peered":"2024-01-22T05:38:58.811724+0000","last_clean":"2024-01-22T05:38:58.811724+0000","last_became_active":"2024-01-22T05:38:58.367702+0000","last_became_peered":"2024-01-22T05:38:58.367702+0000","last_unstale":"2024-01-22T05:38:58.811724+0000","last_undegraded":"2024-01-22T05:38:58.811724+0000","last_fullsized":"2024-01-22T05:38:58.811724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835946+0000","last_change":"2024-01-22T05:38:58.827290+0000","last_active":"2024-01-22T05:38:58.835946+0000","last_peered":"2024-01-22T05:38:58.835946+0000","last_clean":"2024-01-22T05:38:58.835946+0000","last_became_active":"2024-01-22T05:38:58.825148+0000","last_became_peered":"2024-01-22T05:38:58.825148+0000","last_unstale":"2024-01-22T05:38:58.835946+0000","last_undegraded":"2024-01-22T05:38:58.835946+0000","last_fullsized":"2024-01-22T05:38:58.835946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.812867+0000","last_change":"2024-01-22T05:38:58.364864+0000","last_active":"2024-01-22T05:38:58.812867+0000","last_peered":"2024-01-22T05:38:58.812867+0000","last_clean":"2024-01-22T05:38:58.812867+0000","last_became_active":"2024-01-22T05:38:58.364552+0000","last_became_peered":"2024-01-22T05:38:58.364552+0000","last_unstale":"2024-01-22T05:38:58.812867+0000","last_undegraded":"2024-01-22T05:38:58.812867+0000","last_fullsized":"2024-01-22T05:38:58.812867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.815127+0000","last_change":"2024-01-22T05:38:58.375633+0000","last_active":"2024-01-22T05:38:58.815127+0000","last_peered":"2024-01-22T05:38:58.815127+0000","last_clean":"2024-01-22T05:38:58.815127+0000","last_became_active":"2024-01-22T05:38:58.375280+0000","last_became_peered":"2024-01-22T05:38:58.375280+0000","last_unstale":"2024-01-22T05:38:58.815127+0000","last_undegraded":"2024-01-22T05:38:58.815127+0000","last_fullsized":"2024-01-22T05:38:58.815127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835900+0000","last_change":"2024-01-22T05:38:58.829229+0000","last_active":"2024-01-22T05:38:58.835900+0000","last_peered":"2024-01-22T05:38:58.835900+0000","last_clean":"2024-01-22T05:38:58.835900+0000","last_became_active":"2024-01-22T05:38:58.828914+0000","last_became_peered":"2024-01-22T05:38:58.828914+0000","last_unstale":"2024-01-22T05:38:58.835900+0000","last_undegraded":"2024-01-22T05:38:58.835900+0000","last_fullsized":"2024-01-22T05:38:58.835900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835925+0000","last_change":"2024-01-22T05:38:58.826814+0000","last_active":"2024-01-22T05:38:58.835925+0000","last_peered":"2024-01-22T05:38:58.835925+0000","last_clean":"2024-01-22T05:38:58.835925+0000","last_became_active":"2024-01-22T05:38:58.824735+0000","last_became_peered":"2024-01-22T05:38:58.824735+0000","last_unstale":"2024-01-22T05:38:58.835925+0000","last_undegraded":"2024-01-22T05:38:58.835925+0000","last_fullsized":"2024-01-22T05:38:58.835925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.834092+0000","last_change":"2024-01-22T05:38:58.375885+0000","last_active":"2024-01-22T05:38:58.834092+0000","last_peered":"2024-01-22T05:38:58.834092+0000","last_clean":"2024-01-22T05:38:58.834092+0000","last_became_active":"2024-01-22T05:38:58.375491+0000","last_became_peered":"2024-01-22T05:38:58.375491+0000","last_unstale":"2024-01-22T05:38:58.834092+0000","last_undegraded":"2024-01-22T05:38:58.834092+0000","last_fullsized":"2024-01-22T05:38:58.834092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840725+0000","last_change":"2024-01-22T05:38:58.831111+0000","last_active":"2024-01-22T05:38:58.840725+0000","last_peered":"2024-01-22T05:38:58.840725+0000","last_clean":"2024-01-22T05:38:58.840725+0000","last_became_active":"2024-01-22T05:38:58.830419+0000","last_became_peered":"2024-01-22T05:38:58.830419+0000","last_unstale":"2024-01-22T05:38:58.840725+0000","last_undegraded":"2024-01-22T05:38:58.840725+0000","last_fullsized":"2024-01-22T05:38:58.840725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817316+0000","last_change":"2024-01-22T05:38:58.365301+0000","last_active":"2024-01-22T05:38:58.817316+0000","last_peered":"2024-01-22T05:38:58.817316+0000","last_clean":"2024-01-22T05:38:58.817316+0000","last_became_active":"2024-01-22T05:38:58.364971+0000","last_became_peered":"2024-01-22T05:38:58.364971+0000","last_unstale":"2024-01-22T05:38:58.817316+0000","last_undegraded":"2024-01-22T05:38:58.817316+0000","last_fullsized":"2024-01-22T05:38:58.817316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.844478+0000","last_change":"2024-01-22T05:38:58.840590+0000","last_active":"2024-01-22T05:38:58.844478+0000","last_peered":"2024-01-22T05:38:58.844478+0000","last_clean":"2024-01-22T05:38:58.844478+0000","last_became_active":"2024-01-22T05:38:58.839763+0000","last_became_peered":"2024-01-22T05:38:58.839763+0000","last_unstale":"2024-01-22T05:38:58.844478+0000","last_undegraded":"2024-01-22T05:38:58.844478+0000","last_fullsized":"2024-01-22T05:38:58.844478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.812981+0000","last_change":"2024-01-22T05:38:58.356067+0000","last_active":"2024-01-22T05:38:58.812981+0000","last_peered":"2024-01-22T05:38:58.812981+0000","last_clean":"2024-01-22T05:38:58.812981+0000","last_became_active":"2024-01-22T05:38:58.355681+0000","last_became_peered":"2024-01-22T05:38:58.355681+0000","last_unstale":"2024-01-22T05:38:58.812981+0000","last_undegraded":"2024-01-22T05:38:58.812981+0000","last_fullsized":"2024-01-22T05:38:58.812981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.830741+0000","last_change":"2024-01-22T05:38:58.820066+0000","last_active":"2024-01-22T05:38:58.830741+0000","last_peered":"2024-01-22T05:38:58.830741+0000","last_clean":"2024-01-22T05:38:58.830741+0000","last_became_active":"2024-01-22T05:38:58.819724+0000","last_became_peered":"2024-01-22T05:38:58.819724+0000","last_unstale":"2024-01-22T05:38:58.830741+0000","last_undegraded":"2024-01-22T05:38:58.830741+0000","last_fullsized":"2024-01-22T05:38:58.830741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840605+0000","last_change":"2024-01-22T05:38:58.367713+0000","last_active":"2024-01-22T05:38:58.840605+0000","last_peered":"2024-01-22T05:38:58.840605+0000","last_clean":"2024-01-22T05:38:58.840605+0000","last_became_active":"2024-01-22T05:38:58.367354+0000","last_became_peered":"2024-01-22T05:38:58.367354+0000","last_unstale":"2024-01-22T05:38:58.840605+0000","last_undegraded":"2024-01-22T05:38:58.840605+0000","last_fullsized":"2024-01-22T05:38:58.840605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840704+0000","last_change":"2024-01-22T05:38:58.830803+0000","last_active":"2024-01-22T05:38:58.840704+0000","last_peered":"2024-01-22T05:38:58.840704+0000","last_clean":"2024-01-22T05:38:58.840704+0000","last_became_active":"2024-01-22T05:38:58.830143+0000","last_became_peered":"2024-01-22T05:38:58.830143+0000","last_unstale":"2024-01-22T05:38:58.840704+0000","last_undegraded":"2024-01-22T05:38:58.840704+0000","last_fullsized":"2024-01-22T05:38:58.840704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835256+0000","last_change":"2024-01-22T05:38:58.365090+0000","last_active":"2024-01-22T05:38:58.835256+0000","last_peered":"2024-01-22T05:38:58.835256+0000","last_clean":"2024-01-22T05:38:58.835256+0000","last_became_active":"2024-01-22T05:38:58.364815+0000","last_became_peered":"2024-01-22T05:38:58.364815+0000","last_unstale":"2024-01-22T05:38:58.835256+0000","last_undegraded":"2024-01-22T05:38:58.835256+0000","last_fullsized":"2024-01-22T05:38:58.835256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835501+0000","last_change":"2024-01-22T05:38:58.828014+0000","last_active":"2024-01-22T05:38:58.835501+0000","last_peered":"2024-01-22T05:38:58.835501+0000","last_clean":"2024-01-22T05:38:58.835501+0000","last_became_active":"2024-01-22T05:38:58.827725+0000","last_became_peered":"2024-01-22T05:38:58.827725+0000","last_unstale":"2024-01-22T05:38:58.835501+0000","last_undegraded":"2024-01-22T05:38:58.835501+0000","last_fullsized":"2024-01-22T05:38:58.835501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835170+0000","last_change":"2024-01-22T05:38:58.825247+0000","last_active":"2024-01-22T05:38:58.835170+0000","last_peered":"2024-01-22T05:38:58.835170+0000","last_clean":"2024-01-22T05:38:58.835170+0000","last_became_active":"2024-01-22T05:38:58.823249+0000","last_became_peered":"2024-01-22T05:38:58.823249+0000","last_unstale":"2024-01-22T05:38:58.835170+0000","last_undegraded":"2024-01-22T05:38:58.835170+0000","last_fullsized":"2024-01-22T05:38:58.835170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817762+0000","last_change":"2024-01-22T05:38:58.365038+0000","last_active":"2024-01-22T05:38:58.817762+0000","last_peered":"2024-01-22T05:38:58.817762+0000","last_clean":"2024-01-22T05:38:58.817762+0000","last_became_active":"2024-01-22T05:38:58.364461+0000","last_became_peered":"2024-01-22T05:38:58.364461+0000","last_unstale":"2024-01-22T05:38:58.817762+0000","last_undegraded":"2024-01-22T05:38:58.817762+0000","last_fullsized":"2024-01-22T05:38:58.817762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-22T05:38:50.537474+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:38:50.537474+0000","last_peered":"2024-01-22T05:38:50.537474+0000","last_clean":"2024-01-22T05:38:50.537474+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:38:50.537474+0000","last_undegraded":"2024-01-22T05:38:50.537474+0000","last_fullsized":"2024-01-22T05:38:50.537474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-22T05:38:50.546535+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:38:50.546535+0000","last_peered":"2024-01-22T05:38:50.546535+0000","last_clean":"2024-01-22T05:38:50.546535+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:38:50.546535+0000","last_undegraded":"2024-01-22T05:38:50.546535+0000","last_fullsized":"2024-01-22T05:38:50.546535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T05:38:50.571637+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:38:50.571637+0000","last_peered":"2024-01-22T05:38:50.571637+0000","last_clean":"2024-01-22T05:38:50.571637+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:38:50.571637+0000","last_undegraded":"2024-01-22T05:38:50.571637+0000","last_fullsized":"2024-01-22T05:38:50.571637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-22T05:38:50.548232+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:38:50.548232+0000","last_peered":"2024-01-22T05:38:50.548232+0000","last_clean":"2024-01-22T05:38:50.548232+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:38:50.548232+0000","last_undegraded":"2024-01-22T05:38:50.548232+0000","last_fullsized":"2024-01-22T05:38:50.548232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-22T05:38:51.938639+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:38:51.938639+0000","last_peered":"2024-01-22T05:38:51.938639+0000","last_clean":"2024-01-22T05:38:51.938639+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:38:51.938639+0000","last_undegraded":"2024-01-22T05:38:51.938639+0000","last_fullsized":"2024-01-22T05:38:51.938639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-22T05:38:50.539726+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:38:50.539726+0000","last_peered":"2024-01-22T05:38:50.539726+0000","last_clean":"2024-01-22T05:38:50.539726+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:38:50.539726+0000","last_undegraded":"2024-01-22T05:38:50.539726+0000","last_fullsized":"2024-01-22T05:38:50.539726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-22T05:38:50.554720+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:38:50.554720+0000","last_peered":"2024-01-22T05:38:50.554720+0000","last_clean":"2024-01-22T05:38:50.554720+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:38:50.554720+0000","last_undegraded":"2024-01-22T05:38:50.554720+0000","last_fullsized":"2024-01-22T05:38:50.554720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:57.323341+0000","last_change":"2024-01-22T05:38:57.323341+0000","last_active":"2024-01-22T05:38:57.323341+0000","last_peered":"2024-01-22T05:38:57.323341+0000","last_clean":"2024-01-22T05:38:57.323341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:57.323341+0000","last_undegraded":"2024-01-22T05:38:57.323341+0000","last_fullsized":"2024-01-22T05:38:57.323341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.814970+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:38:58.814970+0000","last_peered":"2024-01-22T05:38:58.814970+0000","last_clean":"2024-01-22T05:38:58.814970+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:38:58.814970+0000","last_undegraded":"2024-01-22T05:38:58.814970+0000","last_fullsized":"2024-01-22T05:38:58.814970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:38:58.330326+0000","last_change":"2024-01-22T05:38:58.330326+0000","last_active":"2024-01-22T05:38:58.330326+0000","last_peered":"2024-01-22T05:38:58.330326+0000","last_clean":"2024-01-22T05:38:58.330326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:38:58.330326+0000","last_undegraded":"2024-01-22T05:38:58.330326+0000","last_fullsized":"2024-01-22T05:38:58.330326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.813284+0000","last_change":"2024-01-22T05:38:58.369110+0000","last_active":"2024-01-22T05:38:58.813284+0000","last_peered":"2024-01-22T05:38:58.813284+0000","last_clean":"2024-01-22T05:38:58.813284+0000","last_became_active":"2024-01-22T05:38:58.363854+0000","last_became_peered":"2024-01-22T05:38:58.363854+0000","last_unstale":"2024-01-22T05:38:58.813284+0000","last_undegraded":"2024-01-22T05:38:58.813284+0000","last_fullsized":"2024-01-22T05:38:58.813284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-22T05:38:50.539502+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:38:50.539502+0000","last_peered":"2024-01-22T05:38:50.539502+0000","last_clean":"2024-01-22T05:38:50.539502+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:38:50.539502+0000","last_undegraded":"2024-01-22T05:38:50.539502+0000","last_fullsized":"2024-01-22T05:38:50.539502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":1},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":678,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":24,"acting":24,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":142504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.86299999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.83099999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.878}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.84899999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78300000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.70499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":142504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.63700000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.53300000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.52000000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61799999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.68999999999999995}]},{"osd":7,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.73699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":142504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.67200000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44900000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.755}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.59499999999999997}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":163351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.1180000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.1080000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.1910000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.256},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":1.0549999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":1.242},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":3.145}]},{"osd":7,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":4.2350000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":2.927}]}]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":142504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.439},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.93300000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.02}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.67800000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":142504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.50600000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.437},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.79800000000000004}]},{"osd":5,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.747},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.69299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":142504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.503},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.317}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.44}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.74299999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":142504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.751},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.84499999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.87}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.93700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:39:03.058 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:39:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.275+0000 7f928fa00700 1 Processor -- start 2024-01-22T05:39:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.275+0000 7f928fa00700 1 -- start start 2024-01-22T05:39:03.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.276+0000 7f928fa00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9288153ee0 0x7f92880c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.276+0000 7f928fa00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92880c7d30 0x7f92880be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.276+0000 7f928fa00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92880928b0 con 0x7f92881542c0 2024-01-22T05:39:03.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.276+0000 7f928fa00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92880bef90 con 0x7f9288153ee0 2024-01-22T05:39:03.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.276+0000 7f928fa00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92880bf270 con 0x7f92880c7d30 2024-01-22T05:39:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f928da00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92880c7d30 0x7f92880be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f928d000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9288153ee0 0x7f92880c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f9287e00700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f92881542c0 0x7f92880be2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:33384/0 (socket says 172.21.15.100:33384) 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f9287e00700 1 -- 172.21.15.100:0/2495149336 learned_addr learned my addr 172.21.15.100:0/2495149336 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f9287400700 1 -- 172.21.15.100:0/2495149336 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208316532 0 0) 0x7f92880928b0 con 0x7f92881542c0 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f9287400700 1 -- 172.21.15.100:0/2495149336 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92680033f0 con 0x7f92881542c0 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f928d000700 1 -- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92880c7d30 msgr2=0x7f92880be9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f928d000700 1 --2- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92880c7d30 0x7f92880be9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f928d000700 1 -- 172.21.15.100:0/2495149336 >> v1:172.21.15.169:6789/0 conn(0x7f92881542c0 legacy=0x7f92880be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f928d000700 1 -- 172.21.15.100:0/2495149336 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92880bfba0 con 0x7f9288153ee0 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.277+0000 7f928da00700 1 --2- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92880c7d30 0x7f92880be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f928d000700 1 --2- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9288153ee0 0x7f92880c3e90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f9278006fd0 tx=0x7f9278006f40).ready entity=mon.1 client_cookie=bac81b8363ef0b4b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f9287400700 1 -- 172.21.15.100:0/2495149336 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278005880 con 0x7f9288153ee0 2024-01-22T05:39:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f9287400700 1 -- 172.21.15.100:0/2495149336 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92780059e0 con 0x7f9288153ee0 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f9287400700 1 -- 172.21.15.100:0/2495149336 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278005d60 con 0x7f9288153ee0 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f928fa00700 1 -- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9288153ee0 msgr2=0x7f92880c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f928fa00700 1 --2- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9288153ee0 0x7f92880c3e90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f9278006fd0 tx=0x7f9278006f40).stop 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f928fa00700 1 -- 172.21.15.100:0/2495149336 shutdown_connections 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f928fa00700 1 --2- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9288153ee0 0x7f92880c3e90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f928fa00700 1 --2- 172.21.15.100:0/2495149336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92880c7d30 0x7f92880be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.278+0000 7f928fa00700 1 -- 172.21.15.100:0/2495149336 >> 172.21.15.100:0/2495149336 conn(0x7f9288091a00 msgr2=0x7f9288091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.279+0000 7f928fa00700 1 -- 172.21.15.100:0/2495149336 shutdown_connections 2024-01-22T05:39:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.279+0000 7f928fa00700 1 -- 172.21.15.100:0/2495149336 wait complete. 2024-01-22T05:39:03.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.280+0000 7f928fa00700 1 Processor -- start 2024-01-22T05:39:03.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.280+0000 7f928fa00700 1 -- start start 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928fa00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92880c7d30 0x7f92880aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928fa00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9288153ee0 0x7f92880a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928fa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92881542c0 0x7f92880ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928fa00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92880aea60 con 0x7f92881542c0 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928fa00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92880ad290 con 0x7f92880c7d30 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928fa00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92880a9540 con 0x7f9288153ee0 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928da00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92881542c0 0x7f92880ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928da00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92881542c0 0x7f92880ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38874/0 (socket says 172.21.15.100:38874) 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.281+0000 7f928da00700 1 -- 172.21.15.100:0/948742335 learned_addr learned my addr 172.21.15.100:0/948742335 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928d000700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92880c7d30 0x7f92880aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f9287e00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9288153ee0 0x7f92880a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928da00700 1 -- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9288153ee0 msgr2=0x7f92880a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928da00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9288153ee0 0x7f92880a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928da00700 1 -- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92880c7d30 msgr2=0x7f92880aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928da00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92880c7d30 0x7f92880aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928da00700 1 -- 172.21.15.100:0/948742335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280009a20 con 0x7f92881542c0 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928da00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92881542c0 0x7f92880ad720 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f9280009fc0 tx=0x7f928000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f927fe00700 1 -- 172.21.15.100:0/948742335 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000cbd0 con 0x7f92881542c0 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f927fe00700 1 -- 172.21.15.100:0/948742335 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928000f040 con 0x7f92881542c0 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9278009250 con 0x7f92881542c0 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.282+0000 7f927fe00700 1 -- 172.21.15.100:0/948742335 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280013400 con 0x7f92881542c0 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.283+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92880ab370 con 0x7f92881542c0 2024-01-22T05:39:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.284+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92880ad400 con 0x7f92881542c0 2024-01-22T05:39:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.284+0000 7f927fe00700 1 -- 172.21.15.100:0/948742335 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f92800137b0 con 0x7f92881542c0 2024-01-22T05:39:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.285+0000 7f927fe00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f926005f150 0x7f9260061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.285+0000 7f927fe00700 1 -- 172.21.15.100:0/948742335 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f928007ab50 con 0x7f92881542c0 2024-01-22T05:39:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.286+0000 7f928d000700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f926005f150 0x7f9260061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.286+0000 7f928d000700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f926005f150 0x7f9260061610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9278006f80 tx=0x7f9278015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:03.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.289+0000 7f927fe00700 1 -- 172.21.15.100:0/948742335 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f928004bd60 con 0x7f92881542c0 2024-01-22T05:39:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.456+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f928805fdb0 con 0x7f926005f150 2024-01-22T05:39:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.466+0000 7f927fe00700 1 -- 172.21.15.100:0/948742335 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360884 (secure 0 0 0) 0x7f928805fdb0 con 0x7f926005f150 2024-01-22T05:39:03.472 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f926005f150 msgr2=0x7f9260061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f926005f150 0x7f9260061610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9278006f80 tx=0x7f9278015000).stop 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92881542c0 msgr2=0x7f92880ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92881542c0 0x7f92880ad720 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f9280009fc0 tx=0x7f928000b040).stop 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 shutdown_connections 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f926005f150 0x7f9260061610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92880c7d30 0x7f92880aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92881542c0 0x7f92880ad720 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 --2- 172.21.15.100:0/948742335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9288153ee0 0x7f92880a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 >> 172.21.15.100:0/948742335 conn(0x7f9288091a00 msgr2=0x7f92880649c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:03.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 shutdown_connections 2024-01-22T05:39:03.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.471+0000 7f928fa00700 1 -- 172.21.15.100:0/948742335 wait complete. 2024-01-22T05:39:03.476 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:39:03.489 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-01-22T05:39:03.142494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":248,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379988,"kb_used_data":3220,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594732,"statfs":{"total":773094113280,"available":770657005568,"internally_reserved":0,"allocated":3297280,"data_stored":1352204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3765,"num_objects":-6,"num_object_clones":0,"num_object_copies":-12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-18,"num_write_kb":-11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.017661"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842353+0000","last_change":"2024-01-22T05:38:58.840422+0000","last_active":"2024-01-22T05:38:58.842353+0000","last_peered":"2024-01-22T05:38:58.842353+0000","last_clean":"2024-01-22T05:38:58.842353+0000","last_became_active":"2024-01-22T05:38:58.840127+0000","last_became_peered":"2024-01-22T05:38:58.840127+0000","last_unstale":"2024-01-22T05:38:58.842353+0000","last_undegraded":"2024-01-22T05:38:58.842353+0000","last_fullsized":"2024-01-22T05:38:58.842353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"35'3","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835578+0000","last_change":"2024-01-22T05:38:58.365925+0000","last_active":"2024-01-22T05:38:58.835578+0000","last_peered":"2024-01-22T05:38:58.835578+0000","last_clean":"2024-01-22T05:38:58.835578+0000","last_became_active":"2024-01-22T05:38:58.365576+0000","last_became_peered":"2024-01-22T05:38:58.365576+0000","last_unstale":"2024-01-22T05:38:58.835578+0000","last_undegraded":"2024-01-22T05:38:58.835578+0000","last_fullsized":"2024-01-22T05:38:58.835578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840467+0000","last_change":"2024-01-22T05:38:58.833696+0000","last_active":"2024-01-22T05:38:58.840467+0000","last_peered":"2024-01-22T05:38:58.840467+0000","last_clean":"2024-01-22T05:38:58.840467+0000","last_became_active":"2024-01-22T05:38:58.833270+0000","last_became_peered":"2024-01-22T05:38:58.833270+0000","last_unstale":"2024-01-22T05:38:58.840467+0000","last_undegraded":"2024-01-22T05:38:58.840467+0000","last_fullsized":"2024-01-22T05:38:58.840467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.821582+0000","last_change":"2024-01-22T05:38:58.366463+0000","last_active":"2024-01-22T05:38:58.821582+0000","last_peered":"2024-01-22T05:38:58.821582+0000","last_clean":"2024-01-22T05:38:58.821582+0000","last_became_active":"2024-01-22T05:38:58.366143+0000","last_became_peered":"2024-01-22T05:38:58.366143+0000","last_unstale":"2024-01-22T05:38:58.821582+0000","last_undegraded":"2024-01-22T05:38:58.821582+0000","last_fullsized":"2024-01-22T05:38:58.821582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842627+0000","last_change":"2024-01-22T05:38:58.837742+0000","last_active":"2024-01-22T05:38:58.842627+0000","last_peered":"2024-01-22T05:38:58.842627+0000","last_clean":"2024-01-22T05:38:58.842627+0000","last_became_active":"2024-01-22T05:38:58.834899+0000","last_became_peered":"2024-01-22T05:38:58.834899+0000","last_unstale":"2024-01-22T05:38:58.842627+0000","last_undegraded":"2024-01-22T05:38:58.842627+0000","last_fullsized":"2024-01-22T05:38:58.842627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809669+0000","last_change":"2024-01-22T05:38:58.363132+0000","last_active":"2024-01-22T05:38:58.809669+0000","last_peered":"2024-01-22T05:38:58.809669+0000","last_clean":"2024-01-22T05:38:58.809669+0000","last_became_active":"2024-01-22T05:38:58.362749+0000","last_became_peered":"2024-01-22T05:38:58.362749+0000","last_unstale":"2024-01-22T05:38:58.809669+0000","last_undegraded":"2024-01-22T05:38:58.809669+0000","last_fullsized":"2024-01-22T05:38:58.809669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840649+0000","last_change":"2024-01-22T05:38:58.833736+0000","last_active":"2024-01-22T05:38:58.840649+0000","last_peered":"2024-01-22T05:38:58.840649+0000","last_clean":"2024-01-22T05:38:58.840649+0000","last_became_active":"2024-01-22T05:38:58.832670+0000","last_became_peered":"2024-01-22T05:38:58.832670+0000","last_unstale":"2024-01-22T05:38:58.840649+0000","last_undegraded":"2024-01-22T05:38:58.840649+0000","last_fullsized":"2024-01-22T05:38:58.840649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837329+0000","last_change":"2024-01-22T05:38:58.378156+0000","last_active":"2024-01-22T05:38:58.837329+0000","last_peered":"2024-01-22T05:38:58.837329+0000","last_clean":"2024-01-22T05:38:58.837329+0000","last_became_active":"2024-01-22T05:38:58.377732+0000","last_became_peered":"2024-01-22T05:38:58.377732+0000","last_unstale":"2024-01-22T05:38:58.837329+0000","last_undegraded":"2024-01-22T05:38:58.837329+0000","last_fullsized":"2024-01-22T05:38:58.837329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835962+0000","last_change":"2024-01-22T05:38:58.827520+0000","last_active":"2024-01-22T05:38:58.835962+0000","last_peered":"2024-01-22T05:38:58.835962+0000","last_clean":"2024-01-22T05:38:58.835962+0000","last_became_active":"2024-01-22T05:38:58.823709+0000","last_became_peered":"2024-01-22T05:38:58.823709+0000","last_unstale":"2024-01-22T05:38:58.835962+0000","last_undegraded":"2024-01-22T05:38:58.835962+0000","last_fullsized":"2024-01-22T05:38:58.835962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.836660+0000","last_change":"2024-01-22T05:38:58.365936+0000","last_active":"2024-01-22T05:38:58.836660+0000","last_peered":"2024-01-22T05:38:58.836660+0000","last_clean":"2024-01-22T05:38:58.836660+0000","last_became_active":"2024-01-22T05:38:58.365460+0000","last_became_peered":"2024-01-22T05:38:58.365460+0000","last_unstale":"2024-01-22T05:38:58.836660+0000","last_undegraded":"2024-01-22T05:38:58.836660+0000","last_fullsized":"2024-01-22T05:38:58.836660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839770+0000","last_change":"2024-01-22T05:38:58.834525+0000","last_active":"2024-01-22T05:38:58.839770+0000","last_peered":"2024-01-22T05:38:58.839770+0000","last_clean":"2024-01-22T05:38:58.839770+0000","last_became_active":"2024-01-22T05:38:58.833908+0000","last_became_peered":"2024-01-22T05:38:58.833908+0000","last_unstale":"2024-01-22T05:38:58.839770+0000","last_undegraded":"2024-01-22T05:38:58.839770+0000","last_fullsized":"2024-01-22T05:38:58.839770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3a","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.831654+0000","last_change":"2024-01-22T05:38:58.362648+0000","last_active":"2024-01-22T05:38:58.831654+0000","last_peered":"2024-01-22T05:38:58.831654+0000","last_clean":"2024-01-22T05:38:58.831654+0000","last_became_active":"2024-01-22T05:38:58.362332+0000","last_became_peered":"2024-01-22T05:38:58.362332+0000","last_unstale":"2024-01-22T05:38:58.831654+0000","last_undegraded":"2024-01-22T05:38:58.831654+0000","last_fullsized":"2024-01-22T05:38:58.831654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.841698+0000","last_change":"2024-01-22T05:38:58.832337+0000","last_active":"2024-01-22T05:38:58.841698+0000","last_peered":"2024-01-22T05:38:58.841698+0000","last_clean":"2024-01-22T05:38:58.841698+0000","last_became_active":"2024-01-22T05:38:58.832030+0000","last_became_peered":"2024-01-22T05:38:58.832030+0000","last_unstale":"2024-01-22T05:38:58.841698+0000","last_undegraded":"2024-01-22T05:38:58.841698+0000","last_fullsized":"2024-01-22T05:38:58.841698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.816400+0000","last_change":"2024-01-22T05:38:58.365475+0000","last_active":"2024-01-22T05:38:58.816400+0000","last_peered":"2024-01-22T05:38:58.816400+0000","last_clean":"2024-01-22T05:38:58.816400+0000","last_became_active":"2024-01-22T05:38:58.362778+0000","last_became_peered":"2024-01-22T05:38:58.362778+0000","last_unstale":"2024-01-22T05:38:58.816400+0000","last_undegraded":"2024-01-22T05:38:58.816400+0000","last_fullsized":"2024-01-22T05:38:58.816400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.843364+0000","last_change":"2024-01-22T05:38:58.841157+0000","last_active":"2024-01-22T05:38:58.843364+0000","last_peered":"2024-01-22T05:38:58.843364+0000","last_clean":"2024-01-22T05:38:58.843364+0000","last_became_active":"2024-01-22T05:38:58.840863+0000","last_became_peered":"2024-01-22T05:38:58.840863+0000","last_unstale":"2024-01-22T05:38:58.843364+0000","last_undegraded":"2024-01-22T05:38:58.843364+0000","last_fullsized":"2024-01-22T05:38:58.843364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817246+0000","last_change":"2024-01-22T05:38:58.376552+0000","last_active":"2024-01-22T05:38:58.817246+0000","last_peered":"2024-01-22T05:38:58.817246+0000","last_clean":"2024-01-22T05:38:58.817246+0000","last_became_active":"2024-01-22T05:38:58.374979+0000","last_became_peered":"2024-01-22T05:38:58.374979+0000","last_unstale":"2024-01-22T05:38:58.817246+0000","last_undegraded":"2024-01-22T05:38:58.817246+0000","last_fullsized":"2024-01-22T05:38:58.817246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842983+0000","last_change":"2024-01-22T05:38:58.840991+0000","last_active":"2024-01-22T05:38:58.842983+0000","last_peered":"2024-01-22T05:38:58.842983+0000","last_clean":"2024-01-22T05:38:58.842983+0000","last_became_active":"2024-01-22T05:38:58.840708+0000","last_became_peered":"2024-01-22T05:38:58.840708+0000","last_unstale":"2024-01-22T05:38:58.842983+0000","last_undegraded":"2024-01-22T05:38:58.842983+0000","last_fullsized":"2024-01-22T05:38:58.842983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809562+0000","last_change":"2024-01-22T05:38:58.368820+0000","last_active":"2024-01-22T05:38:58.809562+0000","last_peered":"2024-01-22T05:38:58.809562+0000","last_clean":"2024-01-22T05:38:58.809562+0000","last_became_active":"2024-01-22T05:38:58.368478+0000","last_became_peered":"2024-01-22T05:38:58.368478+0000","last_unstale":"2024-01-22T05:38:58.809562+0000","last_undegraded":"2024-01-22T05:38:58.809562+0000","last_fullsized":"2024-01-22T05:38:58.809562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.829803+0000","last_change":"2024-01-22T05:38:58.818288+0000","last_active":"2024-01-22T05:38:58.829803+0000","last_peered":"2024-01-22T05:38:58.829803+0000","last_clean":"2024-01-22T05:38:58.829803+0000","last_became_active":"2024-01-22T05:38:58.817870+0000","last_became_peered":"2024-01-22T05:38:58.817870+0000","last_unstale":"2024-01-22T05:38:58.829803+0000","last_undegraded":"2024-01-22T05:38:58.829803+0000","last_fullsized":"2024-01-22T05:38:58.829803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.815459+0000","last_change":"2024-01-22T05:38:58.370361+0000","last_active":"2024-01-22T05:38:58.815459+0000","last_peered":"2024-01-22T05:38:58.815459+0000","last_clean":"2024-01-22T05:38:58.815459+0000","last_became_active":"2024-01-22T05:38:58.369992+0000","last_became_peered":"2024-01-22T05:38:58.369992+0000","last_unstale":"2024-01-22T05:38:58.815459+0000","last_undegraded":"2024-01-22T05:38:58.815459+0000","last_fullsized":"2024-01-22T05:38:58.815459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835845+0000","last_change":"2024-01-22T05:38:58.823038+0000","last_active":"2024-01-22T05:38:58.835845+0000","last_peered":"2024-01-22T05:38:58.835845+0000","last_clean":"2024-01-22T05:38:58.835845+0000","last_became_active":"2024-01-22T05:38:58.822766+0000","last_became_peered":"2024-01-22T05:38:58.822766+0000","last_unstale":"2024-01-22T05:38:58.835845+0000","last_undegraded":"2024-01-22T05:38:58.835845+0000","last_fullsized":"2024-01-22T05:38:58.835845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.818331+0000","last_change":"2024-01-22T05:38:58.377150+0000","last_active":"2024-01-22T05:38:58.818331+0000","last_peered":"2024-01-22T05:38:58.818331+0000","last_clean":"2024-01-22T05:38:58.818331+0000","last_became_active":"2024-01-22T05:38:58.375569+0000","last_became_peered":"2024-01-22T05:38:58.375569+0000","last_unstale":"2024-01-22T05:38:58.818331+0000","last_undegraded":"2024-01-22T05:38:58.818331+0000","last_fullsized":"2024-01-22T05:38:58.818331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842821+0000","last_change":"2024-01-22T05:38:58.839088+0000","last_active":"2024-01-22T05:38:58.842821+0000","last_peered":"2024-01-22T05:38:58.842821+0000","last_clean":"2024-01-22T05:38:58.842821+0000","last_became_active":"2024-01-22T05:38:58.838589+0000","last_became_peered":"2024-01-22T05:38:58.838589+0000","last_unstale":"2024-01-22T05:38:58.842821+0000","last_undegraded":"2024-01-22T05:38:58.842821+0000","last_fullsized":"2024-01-22T05:38:58.842821+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"35'4","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.843601+0000","last_change":"2024-01-22T05:38:58.373602+0000","last_active":"2024-01-22T05:38:58.843601+0000","last_peered":"2024-01-22T05:38:58.843601+0000","last_clean":"2024-01-22T05:38:58.843601+0000","last_became_active":"2024-01-22T05:38:58.372558+0000","last_became_peered":"2024-01-22T05:38:58.372558+0000","last_unstale":"2024-01-22T05:38:58.843601+0000","last_undegraded":"2024-01-22T05:38:58.843601+0000","last_fullsized":"2024-01-22T05:38:58.843601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839415+0000","last_change":"2024-01-22T05:38:58.831581+0000","last_active":"2024-01-22T05:38:58.839415+0000","last_peered":"2024-01-22T05:38:58.839415+0000","last_clean":"2024-01-22T05:38:58.839415+0000","last_became_active":"2024-01-22T05:38:58.831305+0000","last_became_peered":"2024-01-22T05:38:58.831305+0000","last_unstale":"2024-01-22T05:38:58.839415+0000","last_undegraded":"2024-01-22T05:38:58.839415+0000","last_fullsized":"2024-01-22T05:38:58.839415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835629+0000","last_change":"2024-01-22T05:38:58.372042+0000","last_active":"2024-01-22T05:38:58.835629+0000","last_peered":"2024-01-22T05:38:58.835629+0000","last_clean":"2024-01-22T05:38:58.835629+0000","last_became_active":"2024-01-22T05:38:58.371738+0000","last_became_peered":"2024-01-22T05:38:58.371738+0000","last_unstale":"2024-01-22T05:38:58.835629+0000","last_undegraded":"2024-01-22T05:38:58.835629+0000","last_fullsized":"2024-01-22T05:38:58.835629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840248+0000","last_change":"2024-01-22T05:38:58.834861+0000","last_active":"2024-01-22T05:38:58.840248+0000","last_peered":"2024-01-22T05:38:58.840248+0000","last_clean":"2024-01-22T05:38:58.840248+0000","last_became_active":"2024-01-22T05:38:58.834503+0000","last_became_peered":"2024-01-22T05:38:58.834503+0000","last_unstale":"2024-01-22T05:38:58.840248+0000","last_undegraded":"2024-01-22T05:38:58.840248+0000","last_fullsized":"2024-01-22T05:38:58.840248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.811724+0000","last_change":"2024-01-22T05:38:58.368098+0000","last_active":"2024-01-22T05:38:58.811724+0000","last_peered":"2024-01-22T05:38:58.811724+0000","last_clean":"2024-01-22T05:38:58.811724+0000","last_became_active":"2024-01-22T05:38:58.367702+0000","last_became_peered":"2024-01-22T05:38:58.367702+0000","last_unstale":"2024-01-22T05:38:58.811724+0000","last_undegraded":"2024-01-22T05:38:58.811724+0000","last_fullsized":"2024-01-22T05:38:58.811724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840189+0000","last_change":"2024-01-22T05:38:58.839312+0000","last_active":"2024-01-22T05:38:58.840189+0000","last_peered":"2024-01-22T05:38:58.840189+0000","last_clean":"2024-01-22T05:38:58.840189+0000","last_became_active":"2024-01-22T05:38:58.839050+0000","last_became_peered":"2024-01-22T05:38:58.839050+0000","last_unstale":"2024-01-22T05:38:58.840189+0000","last_undegraded":"2024-01-22T05:38:58.840189+0000","last_fullsized":"2024-01-22T05:38:58.840189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809004+0000","last_change":"2024-01-22T05:38:58.367078+0000","last_active":"2024-01-22T05:38:58.809004+0000","last_peered":"2024-01-22T05:38:58.809004+0000","last_clean":"2024-01-22T05:38:58.809004+0000","last_became_active":"2024-01-22T05:38:58.366654+0000","last_became_peered":"2024-01-22T05:38:58.366654+0000","last_unstale":"2024-01-22T05:38:58.809004+0000","last_undegraded":"2024-01-22T05:38:58.809004+0000","last_fullsized":"2024-01-22T05:38:58.809004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839897+0000","last_change":"2024-01-22T05:38:58.837528+0000","last_active":"2024-01-22T05:38:58.839897+0000","last_peered":"2024-01-22T05:38:58.839897+0000","last_clean":"2024-01-22T05:38:58.839897+0000","last_became_active":"2024-01-22T05:38:58.836252+0000","last_became_peered":"2024-01-22T05:38:58.836252+0000","last_unstale":"2024-01-22T05:38:58.839897+0000","last_undegraded":"2024-01-22T05:38:58.839897+0000","last_fullsized":"2024-01-22T05:38:58.839897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"35'4","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842791+0000","last_change":"2024-01-22T05:38:58.360377+0000","last_active":"2024-01-22T05:38:58.842791+0000","last_peered":"2024-01-22T05:38:58.842791+0000","last_clean":"2024-01-22T05:38:58.842791+0000","last_became_active":"2024-01-22T05:38:58.360053+0000","last_became_peered":"2024-01-22T05:38:58.360053+0000","last_unstale":"2024-01-22T05:38:58.842791+0000","last_undegraded":"2024-01-22T05:38:58.842791+0000","last_fullsized":"2024-01-22T05:38:58.842791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.831457+0000","last_change":"2024-01-22T05:38:58.827791+0000","last_active":"2024-01-22T05:38:58.831457+0000","last_peered":"2024-01-22T05:38:58.831457+0000","last_clean":"2024-01-22T05:38:58.831457+0000","last_became_active":"2024-01-22T05:38:58.827493+0000","last_became_peered":"2024-01-22T05:38:58.827493+0000","last_unstale":"2024-01-22T05:38:58.831457+0000","last_undegraded":"2024-01-22T05:38:58.831457+0000","last_fullsized":"2024-01-22T05:38:58.831457+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.819764+0000","last_change":"2024-01-22T05:38:58.374260+0000","last_active":"2024-01-22T05:38:58.819764+0000","last_peered":"2024-01-22T05:38:58.819764+0000","last_clean":"2024-01-22T05:38:58.819764+0000","last_became_active":"2024-01-22T05:38:58.373956+0000","last_became_peered":"2024-01-22T05:38:58.373956+0000","last_unstale":"2024-01-22T05:38:58.819764+0000","last_undegraded":"2024-01-22T05:38:58.819764+0000","last_fullsized":"2024-01-22T05:38:58.819764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839193+0000","last_change":"2024-01-22T05:38:58.831041+0000","last_active":"2024-01-22T05:38:58.839193+0000","last_peered":"2024-01-22T05:38:58.839193+0000","last_clean":"2024-01-22T05:38:58.839193+0000","last_became_active":"2024-01-22T05:38:58.830041+0000","last_became_peered":"2024-01-22T05:38:58.830041+0000","last_unstale":"2024-01-22T05:38:58.839193+0000","last_undegraded":"2024-01-22T05:38:58.839193+0000","last_fullsized":"2024-01-22T05:38:58.839193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.825960+0000","last_change":"2024-01-22T05:38:58.372654+0000","last_active":"2024-01-22T05:38:58.825960+0000","last_peered":"2024-01-22T05:38:58.825960+0000","last_clean":"2024-01-22T05:38:58.825960+0000","last_became_active":"2024-01-22T05:38:58.372324+0000","last_became_peered":"2024-01-22T05:38:58.372324+0000","last_unstale":"2024-01-22T05:38:58.825960+0000","last_undegraded":"2024-01-22T05:38:58.825960+0000","last_fullsized":"2024-01-22T05:38:58.825960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837262+0000","last_change":"2024-01-22T05:38:58.822273+0000","last_active":"2024-01-22T05:38:58.837262+0000","last_peered":"2024-01-22T05:38:58.837262+0000","last_clean":"2024-01-22T05:38:58.837262+0000","last_became_active":"2024-01-22T05:38:58.821979+0000","last_became_peered":"2024-01-22T05:38:58.821979+0000","last_unstale":"2024-01-22T05:38:58.837262+0000","last_undegraded":"2024-01-22T05:38:58.837262+0000","last_fullsized":"2024-01-22T05:38:58.837262+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840361+0000","last_change":"2024-01-22T05:38:58.360616+0000","last_active":"2024-01-22T05:38:58.840361+0000","last_peered":"2024-01-22T05:38:58.840361+0000","last_clean":"2024-01-22T05:38:58.840361+0000","last_became_active":"2024-01-22T05:38:58.358871+0000","last_became_peered":"2024-01-22T05:38:58.358871+0000","last_unstale":"2024-01-22T05:38:58.840361+0000","last_undegraded":"2024-01-22T05:38:58.840361+0000","last_fullsized":"2024-01-22T05:38:58.840361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837292+0000","last_change":"2024-01-22T05:38:58.823286+0000","last_active":"2024-01-22T05:38:58.837292+0000","last_peered":"2024-01-22T05:38:58.837292+0000","last_clean":"2024-01-22T05:38:58.837292+0000","last_became_active":"2024-01-22T05:38:58.821943+0000","last_became_peered":"2024-01-22T05:38:58.821943+0000","last_unstale":"2024-01-22T05:38:58.837292+0000","last_undegraded":"2024-01-22T05:38:58.837292+0000","last_fullsized":"2024-01-22T05:38:58.837292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.821717+0000","last_change":"2024-01-22T05:38:58.379100+0000","last_active":"2024-01-22T05:38:58.821717+0000","last_peered":"2024-01-22T05:38:58.821717+0000","last_clean":"2024-01-22T05:38:58.821717+0000","last_became_active":"2024-01-22T05:38:58.378778+0000","last_became_peered":"2024-01-22T05:38:58.378778+0000","last_unstale":"2024-01-22T05:38:58.821717+0000","last_undegraded":"2024-01-22T05:38:58.821717+0000","last_fullsized":"2024-01-22T05:38:58.821717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835946+0000","last_change":"2024-01-22T05:38:58.827290+0000","last_active":"2024-01-22T05:38:58.835946+0000","last_peered":"2024-01-22T05:38:58.835946+0000","last_clean":"2024-01-22T05:38:58.835946+0000","last_became_active":"2024-01-22T05:38:58.825148+0000","last_became_peered":"2024-01-22T05:38:58.825148+0000","last_unstale":"2024-01-22T05:38:58.835946+0000","last_undegraded":"2024-01-22T05:38:58.835946+0000","last_fullsized":"2024-01-22T05:38:58.835946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.833861+0000","last_change":"2024-01-22T05:38:58.378378+0000","last_active":"2024-01-22T05:38:58.833861+0000","last_peered":"2024-01-22T05:38:58.833861+0000","last_clean":"2024-01-22T05:38:58.833861+0000","last_became_active":"2024-01-22T05:38:58.377974+0000","last_became_peered":"2024-01-22T05:38:58.377974+0000","last_unstale":"2024-01-22T05:38:58.833861+0000","last_undegraded":"2024-01-22T05:38:58.833861+0000","last_fullsized":"2024-01-22T05:38:58.833861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837534+0000","last_change":"2024-01-22T05:38:58.826810+0000","last_active":"2024-01-22T05:38:58.837534+0000","last_peered":"2024-01-22T05:38:58.837534+0000","last_clean":"2024-01-22T05:38:58.837534+0000","last_became_active":"2024-01-22T05:38:58.826523+0000","last_became_peered":"2024-01-22T05:38:58.826523+0000","last_unstale":"2024-01-22T05:38:58.837534+0000","last_undegraded":"2024-01-22T05:38:58.837534+0000","last_fullsized":"2024-01-22T05:38:58.837534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.816809+0000","last_change":"2024-01-22T05:38:58.373974+0000","last_active":"2024-01-22T05:38:58.816809+0000","last_peered":"2024-01-22T05:38:58.816809+0000","last_clean":"2024-01-22T05:38:58.816809+0000","last_became_active":"2024-01-22T05:38:58.373686+0000","last_became_peered":"2024-01-22T05:38:58.373686+0000","last_unstale":"2024-01-22T05:38:58.816809+0000","last_undegraded":"2024-01-22T05:38:58.816809+0000","last_fullsized":"2024-01-22T05:38:58.816809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839771+0000","last_change":"2024-01-22T05:38:58.833373+0000","last_active":"2024-01-22T05:38:58.839771+0000","last_peered":"2024-01-22T05:38:58.839771+0000","last_clean":"2024-01-22T05:38:58.839771+0000","last_became_active":"2024-01-22T05:38:58.832332+0000","last_became_peered":"2024-01-22T05:38:58.832332+0000","last_unstale":"2024-01-22T05:38:58.839771+0000","last_undegraded":"2024-01-22T05:38:58.839771+0000","last_fullsized":"2024-01-22T05:38:58.839771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.823629+0000","last_change":"2024-01-22T05:38:58.362754+0000","last_active":"2024-01-22T05:38:58.823629+0000","last_peered":"2024-01-22T05:38:58.823629+0000","last_clean":"2024-01-22T05:38:58.823629+0000","last_became_active":"2024-01-22T05:38:58.362469+0000","last_became_peered":"2024-01-22T05:38:58.362469+0000","last_unstale":"2024-01-22T05:38:58.823629+0000","last_undegraded":"2024-01-22T05:38:58.823629+0000","last_fullsized":"2024-01-22T05:38:58.823629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839845+0000","last_change":"2024-01-22T05:38:58.832809+0000","last_active":"2024-01-22T05:38:58.839845+0000","last_peered":"2024-01-22T05:38:58.839845+0000","last_clean":"2024-01-22T05:38:58.839845+0000","last_became_active":"2024-01-22T05:38:58.832015+0000","last_became_peered":"2024-01-22T05:38:58.832015+0000","last_unstale":"2024-01-22T05:38:58.839845+0000","last_undegraded":"2024-01-22T05:38:58.839845+0000","last_fullsized":"2024-01-22T05:38:58.839845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817147+0000","last_change":"2024-01-22T05:38:58.371239+0000","last_active":"2024-01-22T05:38:58.817147+0000","last_peered":"2024-01-22T05:38:58.817147+0000","last_clean":"2024-01-22T05:38:58.817147+0000","last_became_active":"2024-01-22T05:38:58.371022+0000","last_became_peered":"2024-01-22T05:38:58.371022+0000","last_unstale":"2024-01-22T05:38:58.817147+0000","last_undegraded":"2024-01-22T05:38:58.817147+0000","last_fullsized":"2024-01-22T05:38:58.817147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839435+0000","last_change":"2024-01-22T05:38:58.833048+0000","last_active":"2024-01-22T05:38:58.839435+0000","last_peered":"2024-01-22T05:38:58.839435+0000","last_clean":"2024-01-22T05:38:58.839435+0000","last_became_active":"2024-01-22T05:38:58.832784+0000","last_became_peered":"2024-01-22T05:38:58.832784+0000","last_unstale":"2024-01-22T05:38:58.839435+0000","last_undegraded":"2024-01-22T05:38:58.839435+0000","last_fullsized":"2024-01-22T05:38:58.839435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.812867+0000","last_change":"2024-01-22T05:38:58.364864+0000","last_active":"2024-01-22T05:38:58.812867+0000","last_peered":"2024-01-22T05:38:58.812867+0000","last_clean":"2024-01-22T05:38:58.812867+0000","last_became_active":"2024-01-22T05:38:58.364552+0000","last_became_peered":"2024-01-22T05:38:58.364552+0000","last_unstale":"2024-01-22T05:38:58.812867+0000","last_undegraded":"2024-01-22T05:38:58.812867+0000","last_fullsized":"2024-01-22T05:38:58.812867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.831232+0000","last_change":"2024-01-22T05:38:58.822690+0000","last_active":"2024-01-22T05:38:58.831232+0000","last_peered":"2024-01-22T05:38:58.831232+0000","last_clean":"2024-01-22T05:38:58.831232+0000","last_became_active":"2024-01-22T05:38:58.822363+0000","last_became_peered":"2024-01-22T05:38:58.822363+0000","last_unstale":"2024-01-22T05:38:58.831232+0000","last_undegraded":"2024-01-22T05:38:58.831232+0000","last_fullsized":"2024-01-22T05:38:58.831232+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.815127+0000","last_change":"2024-01-22T05:38:58.375633+0000","last_active":"2024-01-22T05:38:58.815127+0000","last_peered":"2024-01-22T05:38:58.815127+0000","last_clean":"2024-01-22T05:38:58.815127+0000","last_became_active":"2024-01-22T05:38:58.375280+0000","last_became_peered":"2024-01-22T05:38:58.375280+0000","last_unstale":"2024-01-22T05:38:58.815127+0000","last_undegraded":"2024-01-22T05:38:58.815127+0000","last_fullsized":"2024-01-22T05:38:58.815127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835900+0000","last_change":"2024-01-22T05:38:58.829229+0000","last_active":"2024-01-22T05:38:58.835900+0000","last_peered":"2024-01-22T05:38:58.835900+0000","last_clean":"2024-01-22T05:38:58.835900+0000","last_became_active":"2024-01-22T05:38:58.828914+0000","last_became_peered":"2024-01-22T05:38:58.828914+0000","last_unstale":"2024-01-22T05:38:58.835900+0000","last_undegraded":"2024-01-22T05:38:58.835900+0000","last_fullsized":"2024-01-22T05:38:58.835900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.818627+0000","last_change":"2024-01-22T05:38:58.366994+0000","last_active":"2024-01-22T05:38:58.818627+0000","last_peered":"2024-01-22T05:38:58.818627+0000","last_clean":"2024-01-22T05:38:58.818627+0000","last_became_active":"2024-01-22T05:38:58.366670+0000","last_became_peered":"2024-01-22T05:38:58.366670+0000","last_unstale":"2024-01-22T05:38:58.818627+0000","last_undegraded":"2024-01-22T05:38:58.818627+0000","last_fullsized":"2024-01-22T05:38:58.818627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839402+0000","last_change":"2024-01-22T05:38:58.833045+0000","last_active":"2024-01-22T05:38:58.839402+0000","last_peered":"2024-01-22T05:38:58.839402+0000","last_clean":"2024-01-22T05:38:58.839402+0000","last_became_active":"2024-01-22T05:38:58.832759+0000","last_became_peered":"2024-01-22T05:38:58.832759+0000","last_unstale":"2024-01-22T05:38:58.839402+0000","last_undegraded":"2024-01-22T05:38:58.839402+0000","last_fullsized":"2024-01-22T05:38:58.839402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817278+0000","last_change":"2024-01-22T05:38:58.376873+0000","last_active":"2024-01-22T05:38:58.817278+0000","last_peered":"2024-01-22T05:38:58.817278+0000","last_clean":"2024-01-22T05:38:58.817278+0000","last_became_active":"2024-01-22T05:38:58.376092+0000","last_became_peered":"2024-01-22T05:38:58.376092+0000","last_unstale":"2024-01-22T05:38:58.817278+0000","last_undegraded":"2024-01-22T05:38:58.817278+0000","last_fullsized":"2024-01-22T05:38:58.817278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835925+0000","last_change":"2024-01-22T05:38:58.826814+0000","last_active":"2024-01-22T05:38:58.835925+0000","last_peered":"2024-01-22T05:38:58.835925+0000","last_clean":"2024-01-22T05:38:58.835925+0000","last_became_active":"2024-01-22T05:38:58.824735+0000","last_became_peered":"2024-01-22T05:38:58.824735+0000","last_unstale":"2024-01-22T05:38:58.835925+0000","last_undegraded":"2024-01-22T05:38:58.835925+0000","last_fullsized":"2024-01-22T05:38:58.835925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809061+0000","last_change":"2024-01-22T05:38:58.366762+0000","last_active":"2024-01-22T05:38:58.809061+0000","last_peered":"2024-01-22T05:38:58.809061+0000","last_clean":"2024-01-22T05:38:58.809061+0000","last_became_active":"2024-01-22T05:38:58.366473+0000","last_became_peered":"2024-01-22T05:38:58.366473+0000","last_unstale":"2024-01-22T05:38:58.809061+0000","last_undegraded":"2024-01-22T05:38:58.809061+0000","last_fullsized":"2024-01-22T05:38:58.809061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839791+0000","last_change":"2024-01-22T05:38:58.834707+0000","last_active":"2024-01-22T05:38:58.839791+0000","last_peered":"2024-01-22T05:38:58.839791+0000","last_clean":"2024-01-22T05:38:58.839791+0000","last_became_active":"2024-01-22T05:38:58.834257+0000","last_became_peered":"2024-01-22T05:38:58.834257+0000","last_unstale":"2024-01-22T05:38:58.839791+0000","last_undegraded":"2024-01-22T05:38:58.839791+0000","last_fullsized":"2024-01-22T05:38:58.839791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809908+0000","last_change":"2024-01-22T05:38:58.364092+0000","last_active":"2024-01-22T05:38:58.809908+0000","last_peered":"2024-01-22T05:38:58.809908+0000","last_clean":"2024-01-22T05:38:58.809908+0000","last_became_active":"2024-01-22T05:38:58.363806+0000","last_became_peered":"2024-01-22T05:38:58.363806+0000","last_unstale":"2024-01-22T05:38:58.809908+0000","last_undegraded":"2024-01-22T05:38:58.809908+0000","last_fullsized":"2024-01-22T05:38:58.809908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840226+0000","last_change":"2024-01-22T05:38:58.835958+0000","last_active":"2024-01-22T05:38:58.840226+0000","last_peered":"2024-01-22T05:38:58.840226+0000","last_clean":"2024-01-22T05:38:58.840226+0000","last_became_active":"2024-01-22T05:38:58.835634+0000","last_became_peered":"2024-01-22T05:38:58.835634+0000","last_unstale":"2024-01-22T05:38:58.840226+0000","last_undegraded":"2024-01-22T05:38:58.840226+0000","last_fullsized":"2024-01-22T05:38:58.840226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.816516+0000","last_change":"2024-01-22T05:38:58.358508+0000","last_active":"2024-01-22T05:38:58.816516+0000","last_peered":"2024-01-22T05:38:58.816516+0000","last_clean":"2024-01-22T05:38:58.816516+0000","last_became_active":"2024-01-22T05:38:58.358182+0000","last_became_peered":"2024-01-22T05:38:58.358182+0000","last_unstale":"2024-01-22T05:38:58.816516+0000","last_undegraded":"2024-01-22T05:38:58.816516+0000","last_fullsized":"2024-01-22T05:38:58.816516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837724+0000","last_change":"2024-01-22T05:38:58.824198+0000","last_active":"2024-01-22T05:38:58.837724+0000","last_peered":"2024-01-22T05:38:58.837724+0000","last_clean":"2024-01-22T05:38:58.837724+0000","last_became_active":"2024-01-22T05:38:58.823912+0000","last_became_peered":"2024-01-22T05:38:58.823912+0000","last_unstale":"2024-01-22T05:38:58.837724+0000","last_undegraded":"2024-01-22T05:38:58.837724+0000","last_fullsized":"2024-01-22T05:38:58.837724+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.816338+0000","last_change":"2024-01-22T05:38:58.374649+0000","last_active":"2024-01-22T05:38:58.816338+0000","last_peered":"2024-01-22T05:38:58.816338+0000","last_clean":"2024-01-22T05:38:58.816338+0000","last_became_active":"2024-01-22T05:38:58.374342+0000","last_became_peered":"2024-01-22T05:38:58.374342+0000","last_unstale":"2024-01-22T05:38:58.816338+0000","last_undegraded":"2024-01-22T05:38:58.816338+0000","last_fullsized":"2024-01-22T05:38:58.816338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837555+0000","last_change":"2024-01-22T05:38:58.824092+0000","last_active":"2024-01-22T05:38:58.837555+0000","last_peered":"2024-01-22T05:38:58.837555+0000","last_clean":"2024-01-22T05:38:58.837555+0000","last_became_active":"2024-01-22T05:38:58.823758+0000","last_became_peered":"2024-01-22T05:38:58.823758+0000","last_unstale":"2024-01-22T05:38:58.837555+0000","last_undegraded":"2024-01-22T05:38:58.837555+0000","last_fullsized":"2024-01-22T05:38:58.837555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.830904+0000","last_change":"2024-01-22T05:38:58.367975+0000","last_active":"2024-01-22T05:38:58.830904+0000","last_peered":"2024-01-22T05:38:58.830904+0000","last_clean":"2024-01-22T05:38:58.830904+0000","last_became_active":"2024-01-22T05:38:58.360410+0000","last_became_peered":"2024-01-22T05:38:58.360410+0000","last_unstale":"2024-01-22T05:38:58.830904+0000","last_undegraded":"2024-01-22T05:38:58.830904+0000","last_fullsized":"2024-01-22T05:38:58.830904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842260+0000","last_change":"2024-01-22T05:38:58.832813+0000","last_active":"2024-01-22T05:38:58.842260+0000","last_peered":"2024-01-22T05:38:58.842260+0000","last_clean":"2024-01-22T05:38:58.842260+0000","last_became_active":"2024-01-22T05:38:58.832496+0000","last_became_peered":"2024-01-22T05:38:58.832496+0000","last_unstale":"2024-01-22T05:38:58.842260+0000","last_undegraded":"2024-01-22T05:38:58.842260+0000","last_fullsized":"2024-01-22T05:38:58.842260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.838445+0000","last_change":"2024-01-22T05:38:58.374567+0000","last_active":"2024-01-22T05:38:58.838445+0000","last_peered":"2024-01-22T05:38:58.838445+0000","last_clean":"2024-01-22T05:38:58.838445+0000","last_became_active":"2024-01-22T05:38:58.374243+0000","last_became_peered":"2024-01-22T05:38:58.374243+0000","last_unstale":"2024-01-22T05:38:58.838445+0000","last_undegraded":"2024-01-22T05:38:58.838445+0000","last_fullsized":"2024-01-22T05:38:58.838445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837473+0000","last_change":"2024-01-22T05:38:58.824685+0000","last_active":"2024-01-22T05:38:58.837473+0000","last_peered":"2024-01-22T05:38:58.837473+0000","last_clean":"2024-01-22T05:38:58.837473+0000","last_became_active":"2024-01-22T05:38:58.824396+0000","last_became_peered":"2024-01-22T05:38:58.824396+0000","last_unstale":"2024-01-22T05:38:58.837473+0000","last_undegraded":"2024-01-22T05:38:58.837473+0000","last_fullsized":"2024-01-22T05:38:58.837473+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.834092+0000","last_change":"2024-01-22T05:38:58.375885+0000","last_active":"2024-01-22T05:38:58.834092+0000","last_peered":"2024-01-22T05:38:58.834092+0000","last_clean":"2024-01-22T05:38:58.834092+0000","last_became_active":"2024-01-22T05:38:58.375491+0000","last_became_peered":"2024-01-22T05:38:58.375491+0000","last_unstale":"2024-01-22T05:38:58.834092+0000","last_undegraded":"2024-01-22T05:38:58.834092+0000","last_fullsized":"2024-01-22T05:38:58.834092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842277+0000","last_change":"2024-01-22T05:38:58.834676+0000","last_active":"2024-01-22T05:38:58.842277+0000","last_peered":"2024-01-22T05:38:58.842277+0000","last_clean":"2024-01-22T05:38:58.842277+0000","last_became_active":"2024-01-22T05:38:58.833725+0000","last_became_peered":"2024-01-22T05:38:58.833725+0000","last_unstale":"2024-01-22T05:38:58.842277+0000","last_undegraded":"2024-01-22T05:38:58.842277+0000","last_fullsized":"2024-01-22T05:38:58.842277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817388+0000","last_change":"2024-01-22T05:38:58.370903+0000","last_active":"2024-01-22T05:38:58.817388+0000","last_peered":"2024-01-22T05:38:58.817388+0000","last_clean":"2024-01-22T05:38:58.817388+0000","last_became_active":"2024-01-22T05:38:58.370444+0000","last_became_peered":"2024-01-22T05:38:58.370444+0000","last_unstale":"2024-01-22T05:38:58.817388+0000","last_undegraded":"2024-01-22T05:38:58.817388+0000","last_fullsized":"2024-01-22T05:38:58.817388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840725+0000","last_change":"2024-01-22T05:38:58.831111+0000","last_active":"2024-01-22T05:38:58.840725+0000","last_peered":"2024-01-22T05:38:58.840725+0000","last_clean":"2024-01-22T05:38:58.840725+0000","last_became_active":"2024-01-22T05:38:58.830419+0000","last_became_peered":"2024-01-22T05:38:58.830419+0000","last_unstale":"2024-01-22T05:38:58.840725+0000","last_undegraded":"2024-01-22T05:38:58.840725+0000","last_fullsized":"2024-01-22T05:38:58.840725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.816331+0000","last_change":"2024-01-22T05:38:58.361324+0000","last_active":"2024-01-22T05:38:58.816331+0000","last_peered":"2024-01-22T05:38:58.816331+0000","last_clean":"2024-01-22T05:38:58.816331+0000","last_became_active":"2024-01-22T05:38:58.360984+0000","last_became_peered":"2024-01-22T05:38:58.360984+0000","last_unstale":"2024-01-22T05:38:58.816331+0000","last_undegraded":"2024-01-22T05:38:58.816331+0000","last_fullsized":"2024-01-22T05:38:58.816331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.831258+0000","last_change":"2024-01-22T05:38:58.825568+0000","last_active":"2024-01-22T05:38:58.831258+0000","last_peered":"2024-01-22T05:38:58.831258+0000","last_clean":"2024-01-22T05:38:58.831258+0000","last_became_active":"2024-01-22T05:38:58.823518+0000","last_became_peered":"2024-01-22T05:38:58.823518+0000","last_unstale":"2024-01-22T05:38:58.831258+0000","last_undegraded":"2024-01-22T05:38:58.831258+0000","last_fullsized":"2024-01-22T05:38:58.831258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809846+0000","last_change":"2024-01-22T05:38:58.368904+0000","last_active":"2024-01-22T05:38:58.809846+0000","last_peered":"2024-01-22T05:38:58.809846+0000","last_clean":"2024-01-22T05:38:58.809846+0000","last_became_active":"2024-01-22T05:38:58.368623+0000","last_became_peered":"2024-01-22T05:38:58.368623+0000","last_unstale":"2024-01-22T05:38:58.809846+0000","last_undegraded":"2024-01-22T05:38:58.809846+0000","last_fullsized":"2024-01-22T05:38:58.809846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840902+0000","last_change":"2024-01-22T05:38:58.837087+0000","last_active":"2024-01-22T05:38:58.840902+0000","last_peered":"2024-01-22T05:38:58.840902+0000","last_clean":"2024-01-22T05:38:58.840902+0000","last_became_active":"2024-01-22T05:38:58.836783+0000","last_became_peered":"2024-01-22T05:38:58.836783+0000","last_unstale":"2024-01-22T05:38:58.840902+0000","last_undegraded":"2024-01-22T05:38:58.840902+0000","last_fullsized":"2024-01-22T05:38:58.840902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817316+0000","last_change":"2024-01-22T05:38:58.365301+0000","last_active":"2024-01-22T05:38:58.817316+0000","last_peered":"2024-01-22T05:38:58.817316+0000","last_clean":"2024-01-22T05:38:58.817316+0000","last_became_active":"2024-01-22T05:38:58.364971+0000","last_became_peered":"2024-01-22T05:38:58.364971+0000","last_unstale":"2024-01-22T05:38:58.817316+0000","last_undegraded":"2024-01-22T05:38:58.817316+0000","last_fullsized":"2024-01-22T05:38:58.817316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842127+0000","last_change":"2024-01-22T05:38:58.832647+0000","last_active":"2024-01-22T05:38:58.842127+0000","last_peered":"2024-01-22T05:38:58.842127+0000","last_clean":"2024-01-22T05:38:58.842127+0000","last_became_active":"2024-01-22T05:38:58.832260+0000","last_became_peered":"2024-01-22T05:38:58.832260+0000","last_unstale":"2024-01-22T05:38:58.842127+0000","last_undegraded":"2024-01-22T05:38:58.842127+0000","last_fullsized":"2024-01-22T05:38:58.842127+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.810001+0000","last_change":"2024-01-22T05:38:58.367398+0000","last_active":"2024-01-22T05:38:58.810001+0000","last_peered":"2024-01-22T05:38:58.810001+0000","last_clean":"2024-01-22T05:38:58.810001+0000","last_became_active":"2024-01-22T05:38:58.367042+0000","last_became_peered":"2024-01-22T05:38:58.367042+0000","last_unstale":"2024-01-22T05:38:58.810001+0000","last_undegraded":"2024-01-22T05:38:58.810001+0000","last_fullsized":"2024-01-22T05:38:58.810001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.844478+0000","last_change":"2024-01-22T05:38:58.840590+0000","last_active":"2024-01-22T05:38:58.844478+0000","last_peered":"2024-01-22T05:38:58.844478+0000","last_clean":"2024-01-22T05:38:58.844478+0000","last_became_active":"2024-01-22T05:38:58.839763+0000","last_became_peered":"2024-01-22T05:38:58.839763+0000","last_unstale":"2024-01-22T05:38:58.844478+0000","last_undegraded":"2024-01-22T05:38:58.844478+0000","last_fullsized":"2024-01-22T05:38:58.844478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.812981+0000","last_change":"2024-01-22T05:38:58.356067+0000","last_active":"2024-01-22T05:38:58.812981+0000","last_peered":"2024-01-22T05:38:58.812981+0000","last_clean":"2024-01-22T05:38:58.812981+0000","last_became_active":"2024-01-22T05:38:58.355681+0000","last_became_peered":"2024-01-22T05:38:58.355681+0000","last_unstale":"2024-01-22T05:38:58.812981+0000","last_undegraded":"2024-01-22T05:38:58.812981+0000","last_fullsized":"2024-01-22T05:38:58.812981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.838285+0000","last_change":"2024-01-22T05:38:58.830673+0000","last_active":"2024-01-22T05:38:58.838285+0000","last_peered":"2024-01-22T05:38:58.838285+0000","last_clean":"2024-01-22T05:38:58.838285+0000","last_became_active":"2024-01-22T05:38:58.830394+0000","last_became_peered":"2024-01-22T05:38:58.830394+0000","last_unstale":"2024-01-22T05:38:58.838285+0000","last_undegraded":"2024-01-22T05:38:58.838285+0000","last_fullsized":"2024-01-22T05:38:58.838285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.819493+0000","last_change":"2024-01-22T05:38:58.376151+0000","last_active":"2024-01-22T05:38:58.819493+0000","last_peered":"2024-01-22T05:38:58.819493+0000","last_clean":"2024-01-22T05:38:58.819493+0000","last_became_active":"2024-01-22T05:38:58.375882+0000","last_became_peered":"2024-01-22T05:38:58.375882+0000","last_unstale":"2024-01-22T05:38:58.819493+0000","last_undegraded":"2024-01-22T05:38:58.819493+0000","last_fullsized":"2024-01-22T05:38:58.819493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.830741+0000","last_change":"2024-01-22T05:38:58.820066+0000","last_active":"2024-01-22T05:38:58.830741+0000","last_peered":"2024-01-22T05:38:58.830741+0000","last_clean":"2024-01-22T05:38:58.830741+0000","last_became_active":"2024-01-22T05:38:58.819724+0000","last_became_peered":"2024-01-22T05:38:58.819724+0000","last_unstale":"2024-01-22T05:38:58.830741+0000","last_undegraded":"2024-01-22T05:38:58.830741+0000","last_fullsized":"2024-01-22T05:38:58.830741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837765+0000","last_change":"2024-01-22T05:38:58.378650+0000","last_active":"2024-01-22T05:38:58.837765+0000","last_peered":"2024-01-22T05:38:58.837765+0000","last_clean":"2024-01-22T05:38:58.837765+0000","last_became_active":"2024-01-22T05:38:58.377503+0000","last_became_peered":"2024-01-22T05:38:58.377503+0000","last_unstale":"2024-01-22T05:38:58.837765+0000","last_undegraded":"2024-01-22T05:38:58.837765+0000","last_fullsized":"2024-01-22T05:38:58.837765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839829+0000","last_change":"2024-01-22T05:38:58.834871+0000","last_active":"2024-01-22T05:38:58.839829+0000","last_peered":"2024-01-22T05:38:58.839829+0000","last_clean":"2024-01-22T05:38:58.839829+0000","last_became_active":"2024-01-22T05:38:58.834551+0000","last_became_peered":"2024-01-22T05:38:58.834551+0000","last_unstale":"2024-01-22T05:38:58.839829+0000","last_undegraded":"2024-01-22T05:38:58.839829+0000","last_fullsized":"2024-01-22T05:38:58.839829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840605+0000","last_change":"2024-01-22T05:38:58.367713+0000","last_active":"2024-01-22T05:38:58.840605+0000","last_peered":"2024-01-22T05:38:58.840605+0000","last_clean":"2024-01-22T05:38:58.840605+0000","last_became_active":"2024-01-22T05:38:58.367354+0000","last_became_peered":"2024-01-22T05:38:58.367354+0000","last_unstale":"2024-01-22T05:38:58.840605+0000","last_undegraded":"2024-01-22T05:38:58.840605+0000","last_fullsized":"2024-01-22T05:38:58.840605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840704+0000","last_change":"2024-01-22T05:38:58.830803+0000","last_active":"2024-01-22T05:38:58.840704+0000","last_peered":"2024-01-22T05:38:58.840704+0000","last_clean":"2024-01-22T05:38:58.840704+0000","last_became_active":"2024-01-22T05:38:58.830143+0000","last_became_peered":"2024-01-22T05:38:58.830143+0000","last_unstale":"2024-01-22T05:38:58.840704+0000","last_undegraded":"2024-01-22T05:38:58.840704+0000","last_fullsized":"2024-01-22T05:38:58.840704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835256+0000","last_change":"2024-01-22T05:38:58.365090+0000","last_active":"2024-01-22T05:38:58.835256+0000","last_peered":"2024-01-22T05:38:58.835256+0000","last_clean":"2024-01-22T05:38:58.835256+0000","last_became_active":"2024-01-22T05:38:58.364815+0000","last_became_peered":"2024-01-22T05:38:58.364815+0000","last_unstale":"2024-01-22T05:38:58.835256+0000","last_undegraded":"2024-01-22T05:38:58.835256+0000","last_fullsized":"2024-01-22T05:38:58.835256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837899+0000","last_change":"2024-01-22T05:38:58.830004+0000","last_active":"2024-01-22T05:38:58.837899+0000","last_peered":"2024-01-22T05:38:58.837899+0000","last_clean":"2024-01-22T05:38:58.837899+0000","last_became_active":"2024-01-22T05:38:58.829234+0000","last_became_peered":"2024-01-22T05:38:58.829234+0000","last_unstale":"2024-01-22T05:38:58.837899+0000","last_undegraded":"2024-01-22T05:38:58.837899+0000","last_fullsized":"2024-01-22T05:38:58.837899+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.820190+0000","last_change":"2024-01-22T05:38:58.365417+0000","last_active":"2024-01-22T05:38:58.820190+0000","last_peered":"2024-01-22T05:38:58.820190+0000","last_clean":"2024-01-22T05:38:58.820190+0000","last_became_active":"2024-01-22T05:38:58.365107+0000","last_became_peered":"2024-01-22T05:38:58.365107+0000","last_unstale":"2024-01-22T05:38:58.820190+0000","last_undegraded":"2024-01-22T05:38:58.820190+0000","last_fullsized":"2024-01-22T05:38:58.820190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840434+0000","last_change":"2024-01-22T05:38:58.837609+0000","last_active":"2024-01-22T05:38:58.840434+0000","last_peered":"2024-01-22T05:38:58.840434+0000","last_clean":"2024-01-22T05:38:58.840434+0000","last_became_active":"2024-01-22T05:38:58.835720+0000","last_became_peered":"2024-01-22T05:38:58.835720+0000","last_unstale":"2024-01-22T05:38:58.840434+0000","last_undegraded":"2024-01-22T05:38:58.840434+0000","last_fullsized":"2024-01-22T05:38:58.840434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817881+0000","last_change":"2024-01-22T05:38:58.363358+0000","last_active":"2024-01-22T05:38:58.817881+0000","last_peered":"2024-01-22T05:38:58.817881+0000","last_clean":"2024-01-22T05:38:58.817881+0000","last_became_active":"2024-01-22T05:38:58.363112+0000","last_became_peered":"2024-01-22T05:38:58.363112+0000","last_unstale":"2024-01-22T05:38:58.817881+0000","last_undegraded":"2024-01-22T05:38:58.817881+0000","last_fullsized":"2024-01-22T05:38:58.817881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842352+0000","last_change":"2024-01-22T05:38:58.837151+0000","last_active":"2024-01-22T05:38:58.842352+0000","last_peered":"2024-01-22T05:38:58.842352+0000","last_clean":"2024-01-22T05:38:58.842352+0000","last_became_active":"2024-01-22T05:38:58.836800+0000","last_became_peered":"2024-01-22T05:38:58.836800+0000","last_unstale":"2024-01-22T05:38:58.842352+0000","last_undegraded":"2024-01-22T05:38:58.842352+0000","last_fullsized":"2024-01-22T05:38:58.842352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839976+0000","last_change":"2024-01-22T05:38:58.365152+0000","last_active":"2024-01-22T05:38:58.839976+0000","last_peered":"2024-01-22T05:38:58.839976+0000","last_clean":"2024-01-22T05:38:58.839976+0000","last_became_active":"2024-01-22T05:38:58.364822+0000","last_became_peered":"2024-01-22T05:38:58.364822+0000","last_unstale":"2024-01-22T05:38:58.839976+0000","last_undegraded":"2024-01-22T05:38:58.839976+0000","last_fullsized":"2024-01-22T05:38:58.839976+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.843291+0000","last_change":"2024-01-22T05:38:58.839794+0000","last_active":"2024-01-22T05:38:58.843291+0000","last_peered":"2024-01-22T05:38:58.843291+0000","last_clean":"2024-01-22T05:38:58.843291+0000","last_became_active":"2024-01-22T05:38:58.839351+0000","last_became_peered":"2024-01-22T05:38:58.839351+0000","last_unstale":"2024-01-22T05:38:58.843291+0000","last_undegraded":"2024-01-22T05:38:58.843291+0000","last_fullsized":"2024-01-22T05:38:58.843291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.836894+0000","last_change":"2024-01-22T05:38:58.372223+0000","last_active":"2024-01-22T05:38:58.836894+0000","last_peered":"2024-01-22T05:38:58.836894+0000","last_clean":"2024-01-22T05:38:58.836894+0000","last_became_active":"2024-01-22T05:38:58.371974+0000","last_became_peered":"2024-01-22T05:38:58.371974+0000","last_unstale":"2024-01-22T05:38:58.836894+0000","last_undegraded":"2024-01-22T05:38:58.836894+0000","last_fullsized":"2024-01-22T05:38:58.836894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.839320+0000","last_change":"2024-01-22T05:38:58.832104+0000","last_active":"2024-01-22T05:38:58.839320+0000","last_peered":"2024-01-22T05:38:58.839320+0000","last_clean":"2024-01-22T05:38:58.839320+0000","last_became_active":"2024-01-22T05:38:58.831843+0000","last_became_peered":"2024-01-22T05:38:58.831843+0000","last_unstale":"2024-01-22T05:38:58.839320+0000","last_undegraded":"2024-01-22T05:38:58.839320+0000","last_fullsized":"2024-01-22T05:38:58.839320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837427+0000","last_change":"2024-01-22T05:38:58.370583+0000","last_active":"2024-01-22T05:38:58.837427+0000","last_peered":"2024-01-22T05:38:58.837427+0000","last_clean":"2024-01-22T05:38:58.837427+0000","last_became_active":"2024-01-22T05:38:58.370263+0000","last_became_peered":"2024-01-22T05:38:58.370263+0000","last_unstale":"2024-01-22T05:38:58.837427+0000","last_undegraded":"2024-01-22T05:38:58.837427+0000","last_fullsized":"2024-01-22T05:38:58.837427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.822939+0000","last_change":"2024-01-22T05:38:58.820755+0000","last_active":"2024-01-22T05:38:58.822939+0000","last_peered":"2024-01-22T05:38:58.822939+0000","last_clean":"2024-01-22T05:38:58.822939+0000","last_became_active":"2024-01-22T05:38:58.820462+0000","last_became_peered":"2024-01-22T05:38:58.820462+0000","last_unstale":"2024-01-22T05:38:58.822939+0000","last_undegraded":"2024-01-22T05:38:58.822939+0000","last_fullsized":"2024-01-22T05:38:58.822939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.823508+0000","last_change":"2024-01-22T05:38:58.364871+0000","last_active":"2024-01-22T05:38:58.823508+0000","last_peered":"2024-01-22T05:38:58.823508+0000","last_clean":"2024-01-22T05:38:58.823508+0000","last_became_active":"2024-01-22T05:38:58.364602+0000","last_became_peered":"2024-01-22T05:38:58.364602+0000","last_unstale":"2024-01-22T05:38:58.823508+0000","last_undegraded":"2024-01-22T05:38:58.823508+0000","last_fullsized":"2024-01-22T05:38:58.823508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840637+0000","last_change":"2024-01-22T05:38:58.835063+0000","last_active":"2024-01-22T05:38:58.840637+0000","last_peered":"2024-01-22T05:38:58.840637+0000","last_clean":"2024-01-22T05:38:58.840637+0000","last_became_active":"2024-01-22T05:38:58.834706+0000","last_became_peered":"2024-01-22T05:38:58.834706+0000","last_unstale":"2024-01-22T05:38:58.840637+0000","last_undegraded":"2024-01-22T05:38:58.840637+0000","last_fullsized":"2024-01-22T05:38:58.840637+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.818409+0000","last_change":"2024-01-22T05:38:58.358371+0000","last_active":"2024-01-22T05:38:58.818409+0000","last_peered":"2024-01-22T05:38:58.818409+0000","last_clean":"2024-01-22T05:38:58.818409+0000","last_became_active":"2024-01-22T05:38:58.358051+0000","last_became_peered":"2024-01-22T05:38:58.358051+0000","last_unstale":"2024-01-22T05:38:58.818409+0000","last_undegraded":"2024-01-22T05:38:58.818409+0000","last_fullsized":"2024-01-22T05:38:58.818409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.840193+0000","last_change":"2024-01-22T05:38:58.835413+0000","last_active":"2024-01-22T05:38:58.840193+0000","last_peered":"2024-01-22T05:38:58.840193+0000","last_clean":"2024-01-22T05:38:58.840193+0000","last_became_active":"2024-01-22T05:38:58.834583+0000","last_became_peered":"2024-01-22T05:38:58.834583+0000","last_unstale":"2024-01-22T05:38:58.840193+0000","last_undegraded":"2024-01-22T05:38:58.840193+0000","last_fullsized":"2024-01-22T05:38:58.840193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.830469+0000","last_change":"2024-01-22T05:38:58.354124+0000","last_active":"2024-01-22T05:38:58.830469+0000","last_peered":"2024-01-22T05:38:58.830469+0000","last_clean":"2024-01-22T05:38:58.830469+0000","last_became_active":"2024-01-22T05:38:58.353839+0000","last_became_peered":"2024-01-22T05:38:58.353839+0000","last_unstale":"2024-01-22T05:38:58.830469+0000","last_undegraded":"2024-01-22T05:38:58.830469+0000","last_fullsized":"2024-01-22T05:38:58.830469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835501+0000","last_change":"2024-01-22T05:38:58.828014+0000","last_active":"2024-01-22T05:38:58.835501+0000","last_peered":"2024-01-22T05:38:58.835501+0000","last_clean":"2024-01-22T05:38:58.835501+0000","last_became_active":"2024-01-22T05:38:58.827725+0000","last_became_peered":"2024-01-22T05:38:58.827725+0000","last_unstale":"2024-01-22T05:38:58.835501+0000","last_undegraded":"2024-01-22T05:38:58.835501+0000","last_fullsized":"2024-01-22T05:38:58.835501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.820293+0000","last_change":"2024-01-22T05:38:58.379002+0000","last_active":"2024-01-22T05:38:58.820293+0000","last_peered":"2024-01-22T05:38:58.820293+0000","last_clean":"2024-01-22T05:38:58.820293+0000","last_became_active":"2024-01-22T05:38:58.378720+0000","last_became_peered":"2024-01-22T05:38:58.378720+0000","last_unstale":"2024-01-22T05:38:58.820293+0000","last_undegraded":"2024-01-22T05:38:58.820293+0000","last_fullsized":"2024-01-22T05:38:58.820293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.829579+0000","last_change":"2024-01-22T05:38:58.815983+0000","last_active":"2024-01-22T05:38:58.829579+0000","last_peered":"2024-01-22T05:38:58.829579+0000","last_clean":"2024-01-22T05:38:58.829579+0000","last_became_active":"2024-01-22T05:38:58.815720+0000","last_became_peered":"2024-01-22T05:38:58.815720+0000","last_unstale":"2024-01-22T05:38:58.829579+0000","last_undegraded":"2024-01-22T05:38:58.829579+0000","last_fullsized":"2024-01-22T05:38:58.829579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.810237+0000","last_change":"2024-01-22T05:38:58.364470+0000","last_active":"2024-01-22T05:38:58.810237+0000","last_peered":"2024-01-22T05:38:58.810237+0000","last_clean":"2024-01-22T05:38:58.810237+0000","last_became_active":"2024-01-22T05:38:58.364129+0000","last_became_peered":"2024-01-22T05:38:58.364129+0000","last_unstale":"2024-01-22T05:38:58.810237+0000","last_undegraded":"2024-01-22T05:38:58.810237+0000","last_fullsized":"2024-01-22T05:38:58.810237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.835170+0000","last_change":"2024-01-22T05:38:58.825247+0000","last_active":"2024-01-22T05:38:58.835170+0000","last_peered":"2024-01-22T05:38:58.835170+0000","last_clean":"2024-01-22T05:38:58.835170+0000","last_became_active":"2024-01-22T05:38:58.823249+0000","last_became_peered":"2024-01-22T05:38:58.823249+0000","last_unstale":"2024-01-22T05:38:58.835170+0000","last_undegraded":"2024-01-22T05:38:58.835170+0000","last_fullsized":"2024-01-22T05:38:58.835170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.813934+0000","last_change":"2024-01-22T05:38:58.372078+0000","last_active":"2024-01-22T05:38:58.813934+0000","last_peered":"2024-01-22T05:38:58.813934+0000","last_clean":"2024-01-22T05:38:58.813934+0000","last_became_active":"2024-01-22T05:38:58.371766+0000","last_became_peered":"2024-01-22T05:38:58.371766+0000","last_unstale":"2024-01-22T05:38:58.813934+0000","last_undegraded":"2024-01-22T05:38:58.813934+0000","last_fullsized":"2024-01-22T05:38:58.813934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.841948+0000","last_change":"2024-01-22T05:38:58.832210+0000","last_active":"2024-01-22T05:38:58.841948+0000","last_peered":"2024-01-22T05:38:58.841948+0000","last_clean":"2024-01-22T05:38:58.841948+0000","last_became_active":"2024-01-22T05:38:58.831927+0000","last_became_peered":"2024-01-22T05:38:58.831927+0000","last_unstale":"2024-01-22T05:38:58.841948+0000","last_undegraded":"2024-01-22T05:38:58.841948+0000","last_fullsized":"2024-01-22T05:38:58.841948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817762+0000","last_change":"2024-01-22T05:38:58.365038+0000","last_active":"2024-01-22T05:38:58.817762+0000","last_peered":"2024-01-22T05:38:58.817762+0000","last_clean":"2024-01-22T05:38:58.817762+0000","last_became_active":"2024-01-22T05:38:58.364461+0000","last_became_peered":"2024-01-22T05:38:58.364461+0000","last_unstale":"2024-01-22T05:38:58.817762+0000","last_undegraded":"2024-01-22T05:38:58.817762+0000","last_fullsized":"2024-01-22T05:38:58.817762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.818507+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:38:58.818507+0000","last_peered":"2024-01-22T05:38:58.818507+0000","last_clean":"2024-01-22T05:38:58.818507+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:38:58.818507+0000","last_undegraded":"2024-01-22T05:38:58.818507+0000","last_fullsized":"2024-01-22T05:38:58.818507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.829261+0000","last_change":"2024-01-22T05:38:58.822490+0000","last_active":"2024-01-22T05:38:58.829261+0000","last_peered":"2024-01-22T05:38:58.829261+0000","last_clean":"2024-01-22T05:38:58.829261+0000","last_became_active":"2024-01-22T05:38:58.821876+0000","last_became_peered":"2024-01-22T05:38:58.821876+0000","last_unstale":"2024-01-22T05:38:58.829261+0000","last_undegraded":"2024-01-22T05:38:58.829261+0000","last_fullsized":"2024-01-22T05:38:58.829261+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.823577+0000","last_change":"2024-01-22T05:38:58.366188+0000","last_active":"2024-01-22T05:38:58.823577+0000","last_peered":"2024-01-22T05:38:58.823577+0000","last_clean":"2024-01-22T05:38:58.823577+0000","last_became_active":"2024-01-22T05:38:58.364944+0000","last_became_peered":"2024-01-22T05:38:58.364944+0000","last_unstale":"2024-01-22T05:38:58.823577+0000","last_undegraded":"2024-01-22T05:38:58.823577+0000","last_fullsized":"2024-01-22T05:38:58.823577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.818084+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:38:58.818084+0000","last_peered":"2024-01-22T05:38:58.818084+0000","last_clean":"2024-01-22T05:38:58.818084+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:38:58.818084+0000","last_undegraded":"2024-01-22T05:38:58.818084+0000","last_fullsized":"2024-01-22T05:38:58.818084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.829782+0000","last_change":"2024-01-22T05:38:58.818119+0000","last_active":"2024-01-22T05:38:58.829782+0000","last_peered":"2024-01-22T05:38:58.829782+0000","last_clean":"2024-01-22T05:38:58.829782+0000","last_became_active":"2024-01-22T05:38:58.817514+0000","last_became_peered":"2024-01-22T05:38:58.817514+0000","last_unstale":"2024-01-22T05:38:58.829782+0000","last_undegraded":"2024-01-22T05:38:58.829782+0000","last_fullsized":"2024-01-22T05:38:58.829782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.822841+0000","last_change":"2024-01-22T05:38:58.366852+0000","last_active":"2024-01-22T05:38:58.822841+0000","last_peered":"2024-01-22T05:38:58.822841+0000","last_clean":"2024-01-22T05:38:58.822841+0000","last_became_active":"2024-01-22T05:38:58.366552+0000","last_became_peered":"2024-01-22T05:38:58.366552+0000","last_unstale":"2024-01-22T05:38:58.822841+0000","last_undegraded":"2024-01-22T05:38:58.822841+0000","last_fullsized":"2024-01-22T05:38:58.822841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817615+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:38:58.817615+0000","last_peered":"2024-01-22T05:38:58.817615+0000","last_clean":"2024-01-22T05:38:58.817615+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:38:58.817615+0000","last_undegraded":"2024-01-22T05:38:58.817615+0000","last_fullsized":"2024-01-22T05:38:58.817615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837360+0000","last_change":"2024-01-22T05:38:58.826464+0000","last_active":"2024-01-22T05:38:58.837360+0000","last_peered":"2024-01-22T05:38:58.837360+0000","last_clean":"2024-01-22T05:38:58.837360+0000","last_became_active":"2024-01-22T05:38:58.826070+0000","last_became_peered":"2024-01-22T05:38:58.826070+0000","last_unstale":"2024-01-22T05:38:58.837360+0000","last_undegraded":"2024-01-22T05:38:58.837360+0000","last_fullsized":"2024-01-22T05:38:58.837360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809083+0000","last_change":"2024-01-22T05:38:58.362171+0000","last_active":"2024-01-22T05:38:58.809083+0000","last_peered":"2024-01-22T05:38:58.809083+0000","last_clean":"2024-01-22T05:38:58.809083+0000","last_became_active":"2024-01-22T05:38:58.361374+0000","last_became_peered":"2024-01-22T05:38:58.361374+0000","last_unstale":"2024-01-22T05:38:58.809083+0000","last_undegraded":"2024-01-22T05:38:58.809083+0000","last_fullsized":"2024-01-22T05:38:58.809083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.818127+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:38:58.818127+0000","last_peered":"2024-01-22T05:38:58.818127+0000","last_clean":"2024-01-22T05:38:58.818127+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:38:58.818127+0000","last_undegraded":"2024-01-22T05:38:58.818127+0000","last_fullsized":"2024-01-22T05:38:58.818127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.810091+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:38:58.810091+0000","last_peered":"2024-01-22T05:38:58.810091+0000","last_clean":"2024-01-22T05:38:58.810091+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:38:58.810091+0000","last_undegraded":"2024-01-22T05:38:58.810091+0000","last_fullsized":"2024-01-22T05:38:58.810091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.841964+0000","last_change":"2024-01-22T05:38:58.834551+0000","last_active":"2024-01-22T05:38:58.841964+0000","last_peered":"2024-01-22T05:38:58.841964+0000","last_clean":"2024-01-22T05:38:58.841964+0000","last_became_active":"2024-01-22T05:38:58.834272+0000","last_became_peered":"2024-01-22T05:38:58.834272+0000","last_unstale":"2024-01-22T05:38:58.841964+0000","last_undegraded":"2024-01-22T05:38:58.841964+0000","last_fullsized":"2024-01-22T05:38:58.841964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.842850+0000","last_change":"2024-01-22T05:38:58.364456+0000","last_active":"2024-01-22T05:38:58.842850+0000","last_peered":"2024-01-22T05:38:58.842850+0000","last_clean":"2024-01-22T05:38:58.842850+0000","last_became_active":"2024-01-22T05:38:58.363982+0000","last_became_peered":"2024-01-22T05:38:58.363982+0000","last_unstale":"2024-01-22T05:38:58.842850+0000","last_undegraded":"2024-01-22T05:38:58.842850+0000","last_fullsized":"2024-01-22T05:38:58.842850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.816941+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:38:58.816941+0000","last_peered":"2024-01-22T05:38:58.816941+0000","last_clean":"2024-01-22T05:38:58.816941+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:38:58.816941+0000","last_undegraded":"2024-01-22T05:38:58.816941+0000","last_fullsized":"2024-01-22T05:38:58.816941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.843249+0000","last_change":"2024-01-22T05:38:58.839444+0000","last_active":"2024-01-22T05:38:58.843249+0000","last_peered":"2024-01-22T05:38:58.843249+0000","last_clean":"2024-01-22T05:38:58.843249+0000","last_became_active":"2024-01-22T05:38:58.838637+0000","last_became_peered":"2024-01-22T05:38:58.838637+0000","last_unstale":"2024-01-22T05:38:58.843249+0000","last_undegraded":"2024-01-22T05:38:58.843249+0000","last_fullsized":"2024-01-22T05:38:58.843249+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.809147+0000","last_change":"2024-01-22T05:38:58.362210+0000","last_active":"2024-01-22T05:38:58.809147+0000","last_peered":"2024-01-22T05:38:58.809147+0000","last_clean":"2024-01-22T05:38:58.809147+0000","last_became_active":"2024-01-22T05:38:58.361847+0000","last_became_peered":"2024-01-22T05:38:58.361847+0000","last_unstale":"2024-01-22T05:38:58.809147+0000","last_undegraded":"2024-01-22T05:38:58.809147+0000","last_fullsized":"2024-01-22T05:38:58.809147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.818400+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:38:58.818400+0000","last_peered":"2024-01-22T05:38:58.818400+0000","last_clean":"2024-01-22T05:38:58.818400+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:38:58.818400+0000","last_undegraded":"2024-01-22T05:38:58.818400+0000","last_fullsized":"2024-01-22T05:38:58.818400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.837813+0000","last_change":"2024-01-22T05:38:58.830882+0000","last_active":"2024-01-22T05:38:58.837813+0000","last_peered":"2024-01-22T05:38:58.837813+0000","last_clean":"2024-01-22T05:38:58.837813+0000","last_became_active":"2024-01-22T05:38:58.830510+0000","last_became_peered":"2024-01-22T05:38:58.830510+0000","last_unstale":"2024-01-22T05:38:58.837813+0000","last_undegraded":"2024-01-22T05:38:58.837813+0000","last_fullsized":"2024-01-22T05:38:58.837813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.817915+0000","last_change":"2024-01-22T05:38:58.359609+0000","last_active":"2024-01-22T05:38:58.817915+0000","last_peered":"2024-01-22T05:38:58.817915+0000","last_clean":"2024-01-22T05:38:58.817915+0000","last_became_active":"2024-01-22T05:38:58.359258+0000","last_became_peered":"2024-01-22T05:38:58.359258+0000","last_unstale":"2024-01-22T05:38:58.817915+0000","last_undegraded":"2024-01-22T05:38:58.817915+0000","last_fullsized":"2024-01-22T05:38:58.817915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.814970+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:38:58.814970+0000","last_peered":"2024-01-22T05:38:58.814970+0000","last_clean":"2024-01-22T05:38:58.814970+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:38:58.814970+0000","last_undegraded":"2024-01-22T05:38:58.814970+0000","last_fullsized":"2024-01-22T05:38:58.814970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.831088+0000","last_change":"2024-01-22T05:38:58.820717+0000","last_active":"2024-01-22T05:38:58.831088+0000","last_peered":"2024-01-22T05:38:58.831088+0000","last_clean":"2024-01-22T05:38:58.831088+0000","last_became_active":"2024-01-22T05:38:58.820292+0000","last_became_peered":"2024-01-22T05:38:58.820292+0000","last_unstale":"2024-01-22T05:38:58.831088+0000","last_undegraded":"2024-01-22T05:38:58.831088+0000","last_fullsized":"2024-01-22T05:38:58.831088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:58.330326+0000","last_clean_scrub_stamp":"2024-01-22T05:38:58.330326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.813284+0000","last_change":"2024-01-22T05:38:58.369110+0000","last_active":"2024-01-22T05:38:58.813284+0000","last_peered":"2024-01-22T05:38:58.813284+0000","last_clean":"2024-01-22T05:38:58.813284+0000","last_became_active":"2024-01-22T05:38:58.363854+0000","last_became_peered":"2024-01-22T05:38:58.363854+0000","last_unstale":"2024-01-22T05:38:58.813284+0000","last_undegraded":"2024-01-22T05:38:58.813284+0000","last_fullsized":"2024-01-22T05:38:58.813284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:38:57.323341+0000","last_clean_scrub_stamp":"2024-01-22T05:38:57.323341+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-22T05:38:58.819861+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:38:58.819861+0000","last_peered":"2024-01-22T05:38:58.819861+0000","last_clean":"2024-01-22T05:38:58.819861+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:38:58.819861+0000","last_undegraded":"2024-01-22T05:38:58.819861+0000","last_fullsized":"2024-01-22T05:38:58.819861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":169357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.63300000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72499999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71799999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":413696,"data_stored":170213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.81499999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.749},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.69799999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.82899999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":413696,"data_stored":169863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.432},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.46000000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.51800000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":163351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.1180000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.1080000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.1910000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.256},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":1.0549999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":1.242},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":3.145}]},{"osd":7,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":4.2350000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":2.927}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":417792,"data_stored":170271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.438}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.311}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.624},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.68100000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.65700000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":417792,"data_stored":170485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.374},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.496}]},{"osd":3,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40600000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.745},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.77200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":169377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.5},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.441}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.624},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.66300000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":169287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.81499999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.749},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.85199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:39:03.495 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:39:03.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:39:03.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.717+0000 7fc267e00700 1 Processor -- start 2024-01-22T05:39:03.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.717+0000 7fc267e00700 1 -- start start 2024-01-22T05:39:03.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.718+0000 7fc267e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2600a9f60 0x7fc2600aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.718+0000 7fc267e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc2600c1940 0x7fc2600ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.718+0000 7fc267e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc26005e1f0 0x7fc26005e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.718+0000 7fc267e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2600c74b0 con 0x7fc2600a9f60 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.718+0000 7fc267e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2600cab90 con 0x7fc2600c1940 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.718+0000 7fc267e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26005eb70 con 0x7fc26005e1f0 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2600a9f60 0x7fc2600aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2600a9f60 0x7fc2600aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38878/0 (socket says 172.21.15.100:38878) 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 -- 172.21.15.100:0/761893328 learned_addr learned my addr 172.21.15.100:0/761893328 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265e00700 1 --2- 172.21.15.100:0/761893328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc26005e1f0 0x7fc26005e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc264a00700 1 --2- 172.21.15.100:0/761893328 >> v2:172.21.15.169:3300/0 conn(0x7fc2600c1940 0x7fc2600ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 -- 172.21.15.100:0/761893328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc26005e1f0 msgr2=0x7fc26005e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 --2- 172.21.15.100:0/761893328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc26005e1f0 0x7fc26005e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 -- 172.21.15.100:0/761893328 >> v2:172.21.15.169:3300/0 conn(0x7fc2600c1940 msgr2=0x7fc2600ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 --2- 172.21.15.100:0/761893328 >> v2:172.21.15.169:3300/0 conn(0x7fc2600c1940 0x7fc2600ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 -- 172.21.15.100:0/761893328 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260158660 con 0x7fc2600a9f60 2024-01-22T05:39:03.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc265400700 1 --2- 172.21.15.100:0/761893328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600a9f60 0x7fc2600aa340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fc2600c88d0 tx=0x7fc2500090f0).ready entity=mon.0 client_cookie=fbb1a5a1291f597f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:03.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.719+0000 7fc25fe00700 1 -- 172.21.15.100:0/761893328 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000f510 con 0x7fc2600a9f60 2024-01-22T05:39:03.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc25fe00700 1 -- 172.21.15.100:0/761893328 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25000f670 con 0x7fc2600a9f60 2024-01-22T05:39:03.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc25fe00700 1 -- 172.21.15.100:0/761893328 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000f9f0 con 0x7fc2600a9f60 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 -- 172.21.15.100:0/761893328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600a9f60 msgr2=0x7fc2600aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 --2- 172.21.15.100:0/761893328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600a9f60 0x7fc2600aa340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fc2600c88d0 tx=0x7fc2500090f0).stop 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 -- 172.21.15.100:0/761893328 shutdown_connections 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 --2- 172.21.15.100:0/761893328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc26005e1f0 0x7fc26005e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 --2- 172.21.15.100:0/761893328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600a9f60 0x7fc2600aa340 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 --2- 172.21.15.100:0/761893328 >> v2:172.21.15.169:3300/0 conn(0x7fc2600c1940 0x7fc2600ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 -- 172.21.15.100:0/761893328 >> 172.21.15.100:0/761893328 conn(0x7fc2600cada0 msgr2=0x7fc2600cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 -- 172.21.15.100:0/761893328 shutdown_connections 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.720+0000 7fc267e00700 1 -- 172.21.15.100:0/761893328 wait complete. 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.722+0000 7fc267e00700 1 Processor -- start 2024-01-22T05:39:03.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.722+0000 7fc267e00700 1 -- start start 2024-01-22T05:39:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc267e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc26005e1f0 0x7fc260156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc267e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2600a9f60 0x7fc2601555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc267e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600c1940 0x7fc2600c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc267e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc260156880 con 0x7fc2600c1940 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc267e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc260155c70 con 0x7fc26005e1f0 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc267e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc260155f50 con 0x7fc2600a9f60 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600c1940 0x7fc2600c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600c1940 0x7fc2600c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38880/0 (socket says 172.21.15.100:38880) 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 -- 172.21.15.100:0/2649246088 learned_addr learned my addr 172.21.15.100:0/2649246088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265400700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc26005e1f0 0x7fc260156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc264a00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2600a9f60 0x7fc2601555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 -- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2600a9f60 msgr2=0x7fc2601555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2600a9f60 0x7fc2601555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 -- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc26005e1f0 msgr2=0x7fc260156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc26005e1f0 0x7fc260156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 -- 172.21.15.100:0/2649246088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250009370 con 0x7fc2600c1940 2024-01-22T05:39:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.723+0000 7fc265e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600c1940 0x7fc2600c4440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fc258009df0 tx=0x7fc25800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.724+0000 7fc25cc00700 1 -- 172.21.15.100:0/2649246088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258009b50 con 0x7fc2600c1940 2024-01-22T05:39:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.724+0000 7fc25cc00700 1 -- 172.21.15.100:0/2649246088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25800f040 con 0x7fc2600c1940 2024-01-22T05:39:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.724+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc260156230 con 0x7fc2600c1940 2024-01-22T05:39:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.724+0000 7fc25cc00700 1 -- 172.21.15.100:0/2649246088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25800ccb0 con 0x7fc2600c1940 2024-01-22T05:39:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.724+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2600c4930 con 0x7fc2600c1940 2024-01-22T05:39:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.725+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26005fdb0 con 0x7fc2600c1940 2024-01-22T05:39:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.726+0000 7fc25cc00700 1 -- 172.21.15.100:0/2649246088 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc258013610 con 0x7fc2600c1940 2024-01-22T05:39:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.726+0000 7fc25cc00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc23805f150 0x7fc238061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.726+0000 7fc25cc00700 1 -- 172.21.15.100:0/2649246088 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc25807a820 con 0x7fc2600c1940 2024-01-22T05:39:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.727+0000 7fc265400700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc23805f150 0x7fc238061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.727+0000 7fc265400700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc23805f150 0x7fc238061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc250009130 tx=0x7fc250017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:03.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.731+0000 7fc25cc00700 1 -- 172.21.15.100:0/2649246088 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc25804baf0 con 0x7fc2600c1940 2024-01-22T05:39:03.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.965+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc26006abb0 con 0x7fc2600c1940 2024-01-22T05:39:03.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.968+0000 7fc25cc00700 1 -- 172.21.15.100:0/2649246088 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc25804f110 con 0x7fc2600c1940 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc23805f150 msgr2=0x7fc238061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc23805f150 0x7fc238061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc250009130 tx=0x7fc250017000).stop 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600c1940 msgr2=0x7fc2600c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600c1940 0x7fc2600c4440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fc258009df0 tx=0x7fc25800b040).stop 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 shutdown_connections 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc23805f150 0x7fc238061610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc26005e1f0 0x7fc260156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2600c1940 0x7fc2600c4440 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.970+0000 7fc267e00700 1 --2- 172.21.15.100:0/2649246088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2600a9f60 0x7fc2601555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.971+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 >> 172.21.15.100:0/2649246088 conn(0x7fc2600cada0 msgr2=0x7fc2600cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.971+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 shutdown_connections 2024-01-22T05:39:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:03.971+0000 7fc267e00700 1 -- 172.21.15.100:0/2649246088 wait complete. 2024-01-22T05:39:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:39:03.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:04.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.171+0000 7fb0ed400700 1 Processor -- start 2024-01-22T05:39:04.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.171+0000 7fb0ed400700 1 -- start start 2024-01-22T05:39:04.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0ed400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0e80ad2e0 0x7fb0e80bfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:04.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0ed400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb0e80c1750 0x7fb0e80c0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:04.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0ed400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e81544a0 con 0x7fb0e80c5b90 2024-01-22T05:39:04.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0ed400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80c12c0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0ed400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80cb7b0 con 0x7fb0e80c1750 2024-01-22T05:39:04.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0e7e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0e80ad2e0 0x7fb0e80bfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0e7e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0e80ad2e0 0x7fb0e80bfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38896/0 (socket says 172.21.15.100:38896) 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.172+0000 7fb0e7e00700 1 -- 172.21.15.100:0/4063507624 learned_addr learned my addr 172.21.15.100:0/4063507624 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e7400700 1 --2- 172.21.15.100:0/4063507624 >> v2:172.21.15.169:3300/0 conn(0x7fb0e80c1750 0x7fb0e80c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e7e00700 1 -- 172.21.15.100:0/4063507624 >> v2:172.21.15.169:3300/0 conn(0x7fb0e80c1750 msgr2=0x7fb0e80c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e7e00700 1 --2- 172.21.15.100:0/4063507624 >> v2:172.21.15.169:3300/0 conn(0x7fb0e80c1750 0x7fb0e80c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e7e00700 1 -- 172.21.15.100:0/4063507624 >> v1:172.21.15.100:6789/0 conn(0x7fb0e80c5b90 legacy=0x7fb0e80c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e7e00700 1 -- 172.21.15.100:0/4063507624 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80c06b0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e7400700 1 --2- 172.21.15.100:0/4063507624 >> v2:172.21.15.169:3300/0 conn(0x7fb0e80c1750 0x7fb0e80c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e7e00700 1 --2- 172.21.15.100:0/4063507624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80bfb40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fb0e8047600 tx=0x7fb0d80090f0).ready entity=mon.0 client_cookie=d9b40ccf909d5247 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e6a00700 1 -- 172.21.15.100:0/4063507624 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800b600 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e6a00700 1 -- 172.21.15.100:0/4063507624 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800b760 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.173+0000 7fb0e6a00700 1 -- 172.21.15.100:0/4063507624 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800bae0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 -- 172.21.15.100:0/4063507624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 msgr2=0x7fb0e80bfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:04.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 --2- 172.21.15.100:0/4063507624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80bfb40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fb0e8047600 tx=0x7fb0d80090f0).stop 2024-01-22T05:39:04.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 -- 172.21.15.100:0/4063507624 shutdown_connections 2024-01-22T05:39:04.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 --2- 172.21.15.100:0/4063507624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80bfb40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 --2- 172.21.15.100:0/4063507624 >> v2:172.21.15.169:3300/0 conn(0x7fb0e80c1750 0x7fb0e80c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 -- 172.21.15.100:0/4063507624 >> 172.21.15.100:0/4063507624 conn(0x7fb0e805ec70 msgr2=0x7fb0e80cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 -- 172.21.15.100:0/4063507624 shutdown_connections 2024-01-22T05:39:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.174+0000 7fb0ed400700 1 -- 172.21.15.100:0/4063507624 wait complete. 2024-01-22T05:39:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.176+0000 7fb0ed400700 1 Processor -- start 2024-01-22T05:39:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.176+0000 7fb0ed400700 1 -- start start 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.177+0000 7fb0ed400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.177+0000 7fb0ed400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0e80c1750 0x7fb0e80a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.177+0000 7fb0ed400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0e80c5b90 0x7fb0e8158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0ed400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80aa3d0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0ed400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8152250 con 0x7fb0e80c1750 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0ed400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e81687c0 con 0x7fb0e80c5b90 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38912/0 (socket says 172.21.15.100:38912) 2024-01-22T05:39:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 -- 172.21.15.100:0/301536995 learned_addr learned my addr 172.21.15.100:0/301536995 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0e80c1750 0x7fb0e80a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0eca00700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0e80c5b90 0x7fb0e8158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 -- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0e80c5b90 msgr2=0x7fb0e8158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0e80c5b90 0x7fb0e8158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 -- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0e80c1750 msgr2=0x7fb0e80a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0e80c1750 0x7fb0e80a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 -- 172.21.15.100:0/301536995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d8009370 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0e7e00700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80a91b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb0d8009fd0 tx=0x7fb0d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.178+0000 7fb0df400700 1 -- 172.21.15.100:0/301536995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800b8d0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.179+0000 7fb0df400700 1 -- 172.21.15.100:0/301536995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800ba30 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.179+0000 7fb0df400700 1 -- 172.21.15.100:0/301536995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d801b660 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.179+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e80c4de0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.179+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e8168170 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.180+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80607d0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.180+0000 7fb0df400700 1 -- 172.21.15.100:0/301536995 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb0d801b9d0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.182+0000 7fb0df400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb0c005f150 0x7fb0c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.182+0000 7fb0df400700 1 -- 172.21.15.100:0/301536995 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb0d807bc20 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.182+0000 7fb0e7400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb0c005f150 0x7fb0c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.182+0000 7fb0e7400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb0c005f150 0x7fb0c0061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb0e80a9bc0 tx=0x7fb0d0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:04.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.186+0000 7fb0df400700 1 -- 172.21.15.100:0/301536995 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb0d804cf90 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.397+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0e806c5e0 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.398+0000 7fb0df400700 1 -- 172.21.15.100:0/301536995 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fb0d801f020 con 0x7fb0e80ad2e0 2024-01-22T05:39:04.399 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:04.399 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:38:58.799067+0000","modified":"2024-01-22T05:39:01.808491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6834/2612830615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2612830615},{"type":"v1","addr":"172.21.15.169:6834","nonce":2612830615}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:39:04.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb0c005f150 msgr2=0x7fb0c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:04.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb0c005f150 0x7fb0c0061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb0e80a9bc0 tx=0x7fb0d0008040).stop 2024-01-22T05:39:04.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 msgr2=0x7fb0e80a91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:04.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80a91b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb0d8009fd0 tx=0x7fb0d8017000).stop 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 shutdown_connections 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb0c005f150 0x7fb0c0061610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0e80c5b90 0x7fb0e8158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e80ad2e0 0x7fb0e80a91b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 --2- 172.21.15.100:0/301536995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0e80c1750 0x7fb0e80a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 >> 172.21.15.100:0/301536995 conn(0x7fb0e805ec70 msgr2=0x7fb0e8152510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 shutdown_connections 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:04.400+0000 7fb0ed400700 1 -- 172.21.15.100:0/301536995 wait complete. 2024-01-22T05:39:04.402 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-01-22T05:39:04.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:38:58.799067+0000', 'modified': '2024-01-22T05:39:01.808491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4888}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4888': {'gid': 4888, 'name': 'd', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.169:6834/2612830615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6832', 'nonce': 2612830615}, {'type': 'v1', 'addr': '172.21.15.169:6834', 'nonce': 2612830615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:39:04.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:39:04.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-22T05:39:05.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.005+0000 7f5684000700 1 Processor -- start 2024-01-22T05:39:05.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.005+0000 7f5684000700 1 -- start start 2024-01-22T05:39:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.006+0000 7f5684000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 0x7f567c15f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.006+0000 7f5684000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c0c1a40 con 0x7f567c154260 2024-01-22T05:39:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.006+0000 7f5684000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c0cbd30 con 0x7f567c157d80 2024-01-22T05:39:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.006+0000 7f5684000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0c1110 con 0x7f567c0c9c10 2024-01-22T05:39:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f5681600700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f567c154260 0x7f567c0cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53324/0 (socket says 172.21.15.100:53324) 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f5681600700 1 -- 172.21.15.100:0/103166382 learned_addr learned my addr 172.21.15.100:0/103166382 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f5682000700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 0x7f567c15f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866926112 0 0) 0x7f567c0c1a40 con 0x7f567c154260 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f565c0033f0 con 0x7f567c154260 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595350835 0 0) 0x7f565c0033f0 con 0x7f567c154260 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 msgr2=0x7f567c15f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 0x7f567c15f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 >> v1:172.21.15.169:6789/0 conn(0x7f567c157d80 legacy=0x7f567c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c0c13f0 con 0x7f567c154260 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.007+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f566c0015f0 con 0x7f567c154260 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 >> v1:172.21.15.100:6789/0 conn(0x7f567c154260 legacy=0x7f567c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f567be00700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 0x7f565c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f567be00700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c003e40 0x7f565c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f567be00700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f565c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0c1110 con 0x7f565c004b80 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c00b990 con 0x7f565c003e40 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c00bb50 con 0x7f567c0c9c10 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5682000700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f565c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5681600700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 0x7f565c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5680c00700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c003e40 0x7f565c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5682000700 1 -- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 msgr2=0x7f565c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5682000700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0c9c10 0x7f565c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5682000700 1 -- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c003e40 msgr2=0x7f565c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5682000700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c003e40 0x7f565c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.008+0000 7f5682000700 1 -- 172.21.15.100:0/103166382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0033f0 con 0x7f565c004b80 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5682000700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f565c005000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f567c0ca060 tx=0x7f567400b040).ready entity=mon.0 client_cookie=9d491ba4604997ee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674009ac0 con 0x7f565c004b80 2024-01-22T05:39:05.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567400f040 con 0x7f565c004b80 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f567be00700 1 -- 172.21.15.100:0/103166382 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400eca0 con 0x7f565c004b80 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5684000700 1 -- 172.21.15.100:0/103166382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 msgr2=0x7f565c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5684000700 1 --2- 172.21.15.100:0/103166382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f565c005000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f567c0ca060 tx=0x7f567400b040).stop 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5682000700 1 -- 172.21.15.100:0/103166382 reap_dead start 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5684000700 1 -- 172.21.15.100:0/103166382 shutdown_connections 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5684000700 1 -- 172.21.15.100:0/103166382 >> 172.21.15.100:0/103166382 conn(0x7f567c05e9d0 msgr2=0x7f567c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5684000700 1 -- 172.21.15.100:0/103166382 shutdown_connections 2024-01-22T05:39:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.009+0000 7f5684000700 1 -- 172.21.15.100:0/103166382 wait complete. 2024-01-22T05:39:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.011+0000 7f5684000700 1 Processor -- start 2024-01-22T05:39:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.011+0000 7f5684000700 1 -- start start 2024-01-22T05:39:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5684000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f567c14eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5684000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f567c0aaa50 0x7f567c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5684000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0b0810 0x7f567c0a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5684000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1679a0 con 0x7f565c004b80 2024-01-22T05:39:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5684000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c167c80 con 0x7f567c0aaa50 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5684000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c167f60 con 0x7f567c0b0810 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5681600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f567c14eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5681600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f567c14eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38920/0 (socket says 172.21.15.100:38920) 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5681600700 1 -- 172.21.15.100:0/3291618409 learned_addr learned my addr 172.21.15.100:0/3291618409 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5682000700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0b0810 0x7f567c0a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.012+0000 7f5680c00700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f567c0aaa50 0x7f567c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5681600700 1 -- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0b0810 msgr2=0x7f567c0a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5681600700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0b0810 0x7f567c0a83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5681600700 1 -- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f567c0aaa50 msgr2=0x7f567c0b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5681600700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f567c0aaa50 0x7f567c0b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5681600700 1 -- 172.21.15.100:0/3291618409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c168240 con 0x7f565c004b80 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5680c00700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f567c0aaa50 0x7f567c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5681600700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f567c14eeb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f566c00f890 tx=0x7f566c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5678c00700 1 -- 172.21.15.100:0/3291618409 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0070d0 con 0x7f565c004b80 2024-01-22T05:39:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5678c00700 1 -- 172.21.15.100:0/3291618409 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c007230 con 0x7f565c004b80 2024-01-22T05:39:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c168520 con 0x7f565c004b80 2024-01-22T05:39:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5678c00700 1 -- 172.21.15.100:0/3291618409 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c005880 con 0x7f565c004b80 2024-01-22T05:39:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.013+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c14f3a0 con 0x7f565c004b80 2024-01-22T05:39:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.016+0000 7f5678c00700 1 -- 172.21.15.100:0/3291618409 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f566c005c70 con 0x7f565c004b80 2024-01-22T05:39:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.016+0000 7f5678c00700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f565405f180 0x7f5654061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.016+0000 7f5678c00700 1 -- 172.21.15.100:0/3291618409 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f566c079c80 con 0x7f565c004b80 2024-01-22T05:39:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.017+0000 7f5680c00700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f565405f180 0x7f5654061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.017+0000 7f5680c00700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f565405f180 0x7f5654061640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5664007cc0 tx=0x7f5664009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.018+0000 7f569b5bdb80 1 Processor -- start 2024-01-22T05:39:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.019+0000 7f569b5bdb80 1 -- start start 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.019+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.019+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f442b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.019+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f4377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.019+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f3302f0 con 0x55f09f442740 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f3457e0 con 0x55f09f443010 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f09f345920 con 0x55f09f3f69c0 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38922/0 (socket says 172.21.15.100:38922) 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 -- 172.21.15.100:0/868700500 learned_addr learned my addr 172.21.15.100:0/868700500 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:05.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 -- 172.21.15.100:0/868700500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 msgr2=0x55f09f442b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 --2- 172.21.15.100:0/868700500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f442b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 -- 172.21.15.100:0/868700500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 msgr2=0x55f09f4377c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 --2- 172.21.15.100:0/868700500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f4377c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 -- 172.21.15.100:0/868700500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f09f33e720 con 0x55f09f442740 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5681600700 1 --2- 172.21.15.100:0/868700500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41c3d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f566c04eae0 tx=0x7f566c0077a0).ready entity=mon.0 client_cookie=ccabe1d91e44b628 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5670c00700 1 -- 172.21.15.100:0/868700500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c04cfb0 con 0x55f09f442740 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5670c00700 1 -- 172.21.15.100:0/868700500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c054250 con 0x55f09f442740 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.020+0000 7f5670c00700 1 -- 172.21.15.100:0/868700500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c04b320 con 0x55f09f442740 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 -- 172.21.15.100:0/868700500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 msgr2=0x55f09f41c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/868700500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41c3d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f566c04eae0 tx=0x7f566c0077a0).stop 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 -- 172.21.15.100:0/868700500 shutdown_connections 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/868700500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f4377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/868700500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41c3d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/868700500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f442b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:05.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 -- 172.21.15.100:0/868700500 >> 172.21.15.100:0/868700500 conn(0x55f09f25d940 msgr2=0x55f09f43d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 -- 172.21.15.100:0/868700500 shutdown_connections 2024-01-22T05:39:05.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.021+0000 7f569b5bdb80 1 -- 172.21.15.100:0/868700500 wait complete. 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.022+0000 7f569b5bdb80 1 -- start start 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.022+0000 7f569b5bdb80 1 Processor -- start 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f3f69c0 0x55f09f421d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f442740 0x55f09f418470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f436c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f345ba0 con 0x55f09f3f69c0 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f310e60 con 0x55f09f443010 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f09f41db40 con 0x55f09f442740 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f569b5bdb80 10 client.0 ll_register_callbacks cb 0x55f09f2e5ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f5681600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f3f69c0 0x55f09f421d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f5681600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f3f69c0 0x55f09f421d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38930/0 (socket says 172.21.15.100:38930) 2024-01-22T05:39:05.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f5681600700 1 -- 172.21.15.100:0/3468211759 learned_addr learned my addr 172.21.15.100:0/3468211759 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.023+0000 7f5682000700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f436c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5680c00700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f442740 0x55f09f418470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5681600700 1 -- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f442740 msgr2=0x55f09f418470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5681600700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f442740 0x55f09f418470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5681600700 1 -- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 msgr2=0x55f09f436c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5681600700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f436c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5681600700 1 -- 172.21.15.100:0/3468211759 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c14f3a0 con 0x55f09f3f69c0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5680c00700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f442740 0x55f09f418470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5681600700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f3f69c0 0x55f09f421d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f566c04e910 tx=0x7f566c056000).ready entity=mon.0 client_cookie=c4a410b5cbfd0f28 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5669600700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5669600700 1 -- 172.21.15.100:0/3468211759 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c005ab0 con 0x55f09f3f69c0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5669600700 1 -- 172.21.15.100:0/3468211759 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f566c001b90 con 0x55f09f3f69c0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f09f3e81a0 con 0x55f09f3f69c0 2024-01-22T05:39:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5669600700 1 -- 172.21.15.100:0/3468211759 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f566c04aa00 con 0x55f09f3f69c0 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f569b5bdb80 10 client.5133 fetch_fsmap learned FSMap version 14 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f09f339ac0 con 0x55f09f3f69c0 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5669600700 1 -- 172.21.15.100:0/3468211759 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f09f3e81a0 con 0x55f09f3f69c0 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.024+0000 7f5669600700 1 -- 172.21.15.100:0/3468211759 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f566c04ab60 con 0x55f09f3f69c0 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f569b5bdb80 10 client.5133 fetch_fsmap finished waiting for FSMap version 14 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f569b5bdb80 10 client.5133 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f569b5bdb80 20 client.5133 populate_metadata read hostname 'smithi100' 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f41d6d0 0x55f09f41ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f569b5bdb80 4 client.5133 mds_command: new command op to 4888 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 --> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f09f1adef0 con 0x55f09f41d6d0 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f5680c00700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f41d6d0 0x55f09f41ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f5669600700 10 client.5133 ms_handle_connect on v2:172.21.15.169:6832/2612830615 2024-01-22T05:39:05.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.025+0000 7f5680c00700 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f41d6d0 0x55f09f41ab70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=68c043902a27eb51 server_cookie=a179a3ee6c0edf9e in_seq=0 out_seq=0 2024-01-22T05:39:05.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.026+0000 7f5669600700 1 -- 172.21.15.100:0/3468211759 <== mds.0 v2:172.21.15.169:6832/2612830615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55f09f1adef0 con 0x55f09f41d6d0 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.026+0000 7f5669600700 10 client.5133 handle_command_reply: tid=0 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 client.5133 shutdown 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f3f69c0 msgr2=0x55f09f421d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f3f69c0 0x55f09f421d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f566c04e910 tx=0x7f566c056000).stop 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 shutdown_connections 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f41d6d0 0x55f09f41ab70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f436c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f3f69c0 0x55f09f421d90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f5669600700 0 client.5133 ms_handle_reset on v2:172.21.15.169:6832/2612830615 2024-01-22T05:39:05.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3468211759 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f442740 0x55f09f418470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 >> 172.21.15.100:0/3468211759 conn(0x55f09f25d940 msgr2=0x55f09f3f4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 shutdown_connections 2024-01-22T05:39:05.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3468211759 wait complete. 2024-01-22T05:39:05.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.027+0000 7f569b5bdb80 20 client.5133 trim_cache size 0 max 16384 2024-01-22T05:39:05.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.044+0000 7f569b5bdb80 1 Processor -- start 2024-01-22T05:39:05.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.044+0000 7f569b5bdb80 1 -- start start 2024-01-22T05:39:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f4225a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f3eb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f420970 con 0x55f09f442740 2024-01-22T05:39:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f418220 con 0x55f09f443010 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f09f41c490 con 0x55f09f3f69c0 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f5680c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f5680c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38940/0 (socket says 172.21.15.100:38940) 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f5680c00700 1 -- 172.21.15.100:0/3160582842 learned_addr learned my addr 172.21.15.100:0/3160582842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f5682000700 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f3eb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.045+0000 7f5681600700 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f4225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5680c00700 1 -- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 msgr2=0x55f09f4225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5680c00700 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f4225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5680c00700 1 -- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 msgr2=0x55f09f3eb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5680c00700 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f3eb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5680c00700 1 -- 172.21.15.100:0/3160582842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f09f339810 con 0x55f09f442740 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5682000700 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f3eb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5681600700 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f4225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5680c00700 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41aed0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f56640118a0 tx=0x7f566400c000).ready entity=mon.0 client_cookie=c21e36441283d343 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5671600700 1 -- 172.21.15.100:0/3160582842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664024980 con 0x55f09f442740 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5671600700 1 -- 172.21.15.100:0/3160582842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566401c070 con 0x55f09f442740 2024-01-22T05:39:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.046+0000 7f5671600700 1 -- 172.21.15.100:0/3160582842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664024cf0 con 0x55f09f442740 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3160582842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 msgr2=0x55f09f41aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41aed0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f56640118a0 tx=0x7f566400c000).stop 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3160582842 shutdown_connections 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f443010 0x55f09f3eb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f4225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/3160582842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f442740 0x55f09f41aed0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3160582842 >> 172.21.15.100:0/3160582842 conn(0x55f09f25d940 msgr2=0x55f09f43d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3160582842 shutdown_connections 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 -- 172.21.15.100:0/3160582842 wait complete. 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.047+0000 7f569b5bdb80 1 -- start start 2024-01-22T05:39:05.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.048+0000 7f569b5bdb80 1 Processor -- start 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f49d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f442740 0x55f09f43bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f569b5bdb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f443010 0x55f09f43c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f435380 con 0x55f09f443010 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09f43c8d0 con 0x55f09f442740 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f569b5bdb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f09f4a2220 con 0x55f09f3f69c0 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f569b5bdb80 10 client.0 ll_register_callbacks cb 0x55f09f2e5ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f443010 0x55f09f43c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f443010 0x55f09f43c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38952/0 (socket says 172.21.15.100:38952) 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 -- 172.21.15.100:0/2183926770 learned_addr learned my addr 172.21.15.100:0/2183926770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5681600700 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f49d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5680c00700 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f442740 0x55f09f43bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 -- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 msgr2=0x55f09f49d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f49d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 -- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f442740 msgr2=0x55f09f43bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f442740 0x55f09f43bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.049+0000 7f5682000700 1 -- 172.21.15.100:0/2183926770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c0cbd30 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f5682000700 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f443010 0x55f09f43c0f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f5674002230 tx=0x7f567401a000).ready entity=mon.0 client_cookie=8b0b158bdd3d38a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f5669600700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f5669600700 1 -- 172.21.15.100:0/2183926770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674023070 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f5669600700 1 -- 172.21.15.100:0/2183926770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f567401e870 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f566c054250 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f5669600700 1 -- 172.21.15.100:0/2183926770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5674009ac0 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 10 client.5139 fetch_fsmap learned FSMap version 14 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f09f1b31d0 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f5669600700 1 -- 172.21.15.100:0/2183926770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c054250 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f5669600700 1 -- 172.21.15.100:0/2183926770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5674013400 con 0x55f09f443010 2024-01-22T05:39:05.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 10 client.5139 fetch_fsmap finished waiting for FSMap version 14 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 10 client.5139 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 20 client.5139 populate_metadata read hostname 'smithi100' 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f419d70 0x55f09f41a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 4 client.5139 mds_command: new command op to 4888 tid=0[{"prefix": "status"}] 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.050+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 --> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f09f1e3040 con 0x55f09f419d70 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.051+0000 7f5681600700 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f419d70 0x55f09f41a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.051+0000 7f5669600700 10 client.5139 ms_handle_connect on v2:172.21.15.169:6832/2612830615 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.051+0000 7f5681600700 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f419d70 0x55f09f41a150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=243634bc34a81ac9 server_cookie=4643810bda8d7e7e in_seq=0 out_seq=0 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.051+0000 7f5669600700 1 -- 172.21.15.100:0/2183926770 <== mds.0 v2:172.21.15.169:6832/2612830615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f09f1e3040 con 0x55f09f419d70 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.051+0000 7f5669600700 10 client.5139 handle_command_reply: tid=0 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.051+0000 7f569b5bdb80 1 client.5139 shutdown 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f443010 msgr2=0x55f09f43c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f443010 0x55f09f43c0f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f5674002230 tx=0x7f567401a000).stop 2024-01-22T05:39:05.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 shutdown_connections 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:6832/2612830615,v1:172.21.15.169:6834/2612830615] conn(0x55f09f419d70 0x55f09f41a150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f09f443010 0x55f09f43c0f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f09f3f69c0 0x55f09f49d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f5669600700 0 client.5139 ms_handle_reset on v2:172.21.15.169:6832/2612830615 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 --2- 172.21.15.100:0/2183926770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f09f442740 0x55f09f43bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 >> 172.21.15.100:0/2183926770 conn(0x55f09f25d940 msgr2=0x55f09f3f00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 shutdown_connections 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 1 -- 172.21.15.100:0/2183926770 wait complete. 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f569b5bdb80 20 client.5139 trim_cache size 0 max 16384 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:39:05.058 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "2373e7ef-4ea1-4c09-a2b1-243cb5e8dade", 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4888, 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 6.2487232060000002, 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 14, 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 36, 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 36, 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 14.511412862 2024-01-22T05:39:05.059 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:39:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f565405f180 msgr2=0x7f5654061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.052+0000 7f5684000700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f565405f180 0x7f5654061640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5664007cc0 tx=0x7f5664009040).stop 2024-01-22T05:39:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 msgr2=0x7f567c14eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f567c14eeb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f566c00f890 tx=0x7f566c009040).stop 2024-01-22T05:39:05.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 shutdown_connections 2024-01-22T05:39:05.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f565405f180 0x7f5654061640 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f567c0b0810 0x7f567c0a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f565c004b80 0x7f567c14eeb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 --2- 172.21.15.100:0/3291618409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f567c0aaa50 0x7f567c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 >> 172.21.15.100:0/3291618409 conn(0x7f567c05e9d0 msgr2=0x7f567c14fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 shutdown_connections 2024-01-22T05:39:05.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.053+0000 7f5684000700 1 -- 172.21.15.100:0/3291618409 wait complete. 2024-01-22T05:39:05.071 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:39:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.227+0000 7f92bc800700 1 Processor -- start 2024-01-22T05:39:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.227+0000 7f92bc800700 1 -- start start 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.228+0000 7f92bc800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c15a0 0x7f92b40646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.228+0000 7f92bc800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f92b40c1980 0x7f92b40a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.228+0000 7f92bc800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b4155030 con 0x7f92b4064b90 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.228+0000 7f92bc800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b40c0cd0 con 0x7f92b40c1980 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.228+0000 7f92bc800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b40650f0 con 0x7f92b40c15a0 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92ba800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f92b4064b90 0x7f92b4157bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53336/0 (socket says 172.21.15.100:53336) 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92ba800700 1 -- 172.21.15.100:0/1467659621 learned_addr learned my addr 172.21.15.100:0/1467659621 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b9e00700 1 --2- 172.21.15.100:0/1467659621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c15a0 0x7f92b40646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b9400700 1 --2- 172.21.15.100:0/1467659621 >> v2:172.21.15.169:3300/0 conn(0x7f92b40c1980 0x7f92b40a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b8a00700 1 -- 172.21.15.100:0/1467659621 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929351416 0 0) 0x7f92b4155030 con 0x7f92b4064b90 2024-01-22T05:39:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b8a00700 1 -- 172.21.15.100:0/1467659621 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92940033f0 con 0x7f92b4064b90 2024-01-22T05:39:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b9e00700 1 -- 172.21.15.100:0/1467659621 >> v2:172.21.15.169:3300/0 conn(0x7f92b40c1980 msgr2=0x7f92b40a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b9e00700 1 --2- 172.21.15.100:0/1467659621 >> v2:172.21.15.169:3300/0 conn(0x7f92b40c1980 0x7f92b40a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b9e00700 1 -- 172.21.15.100:0/1467659621 >> v1:172.21.15.100:6789/0 conn(0x7f92b4064b90 legacy=0x7f92b4157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b9e00700 1 -- 172.21.15.100:0/1467659621 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4154700 con 0x7f92b40c15a0 2024-01-22T05:39:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.229+0000 7f92b9400700 1 --2- 172.21.15.100:0/1467659621 >> v2:172.21.15.169:3300/0 conn(0x7f92b40c1980 0x7f92b40a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92b9e00700 1 --2- 172.21.15.100:0/1467659621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c15a0 0x7f92b40646a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f92a4009760 tx=0x7f92a4009060).ready entity=mon.2 client_cookie=ede71a4e87478c5b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92b8a00700 1 -- 172.21.15.100:0/1467659621 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a400d4a0 con 0x7f92b40c15a0 2024-01-22T05:39:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92b8a00700 1 -- 172.21.15.100:0/1467659621 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a400d600 con 0x7f92b40c15a0 2024-01-22T05:39:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92b8a00700 1 -- 172.21.15.100:0/1467659621 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a400d980 con 0x7f92b40c15a0 2024-01-22T05:39:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92bc800700 1 -- 172.21.15.100:0/1467659621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c15a0 msgr2=0x7f92b40646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92bc800700 1 --2- 172.21.15.100:0/1467659621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c15a0 0x7f92b40646a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f92a4009760 tx=0x7f92a4009060).stop 2024-01-22T05:39:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92bc800700 1 -- 172.21.15.100:0/1467659621 shutdown_connections 2024-01-22T05:39:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92bc800700 1 --2- 172.21.15.100:0/1467659621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c15a0 0x7f92b40646a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92bc800700 1 --2- 172.21.15.100:0/1467659621 >> v2:172.21.15.169:3300/0 conn(0x7f92b40c1980 0x7f92b40a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.230+0000 7f92bc800700 1 -- 172.21.15.100:0/1467659621 >> 172.21.15.100:0/1467659621 conn(0x7f92b40cb7f0 msgr2=0x7f92b40c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.231+0000 7f92bc800700 1 -- 172.21.15.100:0/1467659621 shutdown_connections 2024-01-22T05:39:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.231+0000 7f92bc800700 1 -- 172.21.15.100:0/1467659621 wait complete. 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.232+0000 7f92bc800700 1 Processor -- start 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.232+0000 7f92bc800700 1 -- start start 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92bc800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b4064b90 0x7f92b4150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92bc800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92b40c15a0 0x7f92b40c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92bc800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c1980 0x7f92b4151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92bc800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b40ae870 con 0x7f92b40c15a0 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92bc800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b4150f60 con 0x7f92b4064b90 2024-01-22T05:39:05.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92bc800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b40c2630 con 0x7f92b40c1980 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92b9400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92b40c15a0 0x7f92b40c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92b9400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92b40c15a0 0x7f92b40c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38966/0 (socket says 172.21.15.100:38966) 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.233+0000 7f92b9400700 1 -- 172.21.15.100:0/2191117819 learned_addr learned my addr 172.21.15.100:0/2191117819 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9e00700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b4064b90 0x7f92b4150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92ba800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c1980 0x7f92b4151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9400700 1 -- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c1980 msgr2=0x7f92b4151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9400700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c1980 0x7f92b4151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9400700 1 -- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b4064b90 msgr2=0x7f92b4150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9400700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b4064b90 0x7f92b4150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9400700 1 -- 172.21.15.100:0/2191117819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0092a0 con 0x7f92b40c15a0 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92ba800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c1980 0x7f92b4151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:05.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9e00700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b4064b90 0x7f92b4150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:05.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b9400700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92b40c15a0 0x7f92b40c1e00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f929c00e950 tx=0x7f929c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b1600700 1 -- 172.21.15.100:0/2191117819 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c00c7f0 con 0x7f92b40c15a0 2024-01-22T05:39:05.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b1600700 1 -- 172.21.15.100:0/2191117819 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c00c950 con 0x7f92b40c15a0 2024-01-22T05:39:05.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a40092a0 con 0x7f92b40c15a0 2024-01-22T05:39:05.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92b1600700 1 -- 172.21.15.100:0/2191117819 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c00ccd0 con 0x7f92b40c15a0 2024-01-22T05:39:05.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.234+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b40c2bf0 con 0x7f92b40c15a0 2024-01-22T05:39:05.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.235+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b40475e0 con 0x7f92b40c15a0 2024-01-22T05:39:05.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.236+0000 7f92b1600700 1 -- 172.21.15.100:0/2191117819 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f929c012600 con 0x7f92b40c15a0 2024-01-22T05:39:05.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.237+0000 7f92b1600700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f928c05f150 0x7f928c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:05.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.237+0000 7f92b1600700 1 -- 172.21.15.100:0/2191117819 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f929c07a700 con 0x7f92b40c15a0 2024-01-22T05:39:05.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.237+0000 7f92b9e00700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f928c05f150 0x7f928c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:05.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.238+0000 7f92b9e00700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f928c05f150 0x7f928c061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f92a400d260 tx=0x7f92a4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.241+0000 7f92b1600700 1 -- 172.21.15.100:0/2191117819 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f929c04b9d0 con 0x7f92b40c15a0 2024-01-22T05:39:05.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.452+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92b41549e0 con 0x7f92b40c15a0 2024-01-22T05:39:05.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.453+0000 7f92b1600700 1 -- 172.21.15.100:0/2191117819 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f929c04eff0 con 0x7f92b40c15a0 2024-01-22T05:39:05.454 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f928c05f150 msgr2=0x7f928c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f928c05f150 0x7f928c061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f92a400d260 tx=0x7f92a4016000).stop 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92b40c15a0 msgr2=0x7f92b40c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92b40c15a0 0x7f92b40c1e00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f929c00e950 tx=0x7f929c009060).stop 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 shutdown_connections 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f928c05f150 0x7f928c061610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b4064b90 0x7f92b4150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b40c1980 0x7f92b4151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 --2- 172.21.15.100:0/2191117819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92b40c15a0 0x7f92b40c1e00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:05.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 >> 172.21.15.100:0/2191117819 conn(0x7f92b40cb7f0 msgr2=0x7f92b40c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:05.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 shutdown_connections 2024-01-22T05:39:05.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:05.455+0000 7f92bc800700 1 -- 172.21.15.100:0/2191117819 wait complete. 2024-01-22T05:39:05.470 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:39:05.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:39:05.470 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:39:05.470 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:39:05.470 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:05.471 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:39:05.471 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:39:05.471 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:39:05.471 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:05.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:05.471 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:39:05.516 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:39:05.516 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:39:05.516 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:39:05.516 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:05.516 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:39:05.516 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:05.516 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40846sec preferred_lft 40846sec 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:05.517 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f05d:9bff:feba:b90d/64 scope link 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::1c0c:7cff:fe73:80ca/64 scope link 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether e6:39:c6:eb:cb:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::e439:c6ff:feeb:cbd7/64 scope link 2024-01-22T05:39:05.518 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:05.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:05.519 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:39:05.620 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:39:05.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:05.624 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:39:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:39:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:39:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:39:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:39:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:39:05.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:05.672 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:39:05.672 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:39:05.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:39:05.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:39:05.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:39:05.672 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:39:05.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:05.871 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:39:05.914 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:39:05.914 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:39:05.915 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:05.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:05.916 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-22T05:39:06.022 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-22T05:39:06.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:06.023 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:06.067 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:06.067 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:06.176 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:06.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:06.239 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:06.242 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:06.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:06.243 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:06.286 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:39:06.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:06.331 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:06.401 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:06.401 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:06.468 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:06.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:06.469 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:06.487 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-01-22T05:39:06.486+0000 7f180edcb3c0 -1 init, newargv = 0x562eaa6b5150 newargc=15 2024-01-22T05:39:06.487 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[83097]: starting ceph client 2024-01-22T05:39:06.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[83097]: starting fuse 2024-01-22T05:39:06.517 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:39:06.517 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-22T05:39:06.517 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:39:06.517 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:06.518 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-01-22T05:39:06.519 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:39:06.698 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.83097.asok 2024-01-22T05:39:06.876 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.83097.asok 2024-01-22T05:39:06.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:06.876 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.83097.asok status 2024-01-22T05:39:07.088 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:39:07.088 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:39:07.088 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:39:07.088 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:39:07.088 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "83097", 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4820, 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4820 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:07.089 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2939255516 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2939255516 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4820 172.21.15.100:0/2939255516", 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "172.21.15.100:0/2939255516", 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 14, 2024-01-22T05:39:07.090 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 36, 2024-01-22T05:39:07.091 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:39:07.091 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:39:07.091 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:39:07.091 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:39:07.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:07.103 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:39:07.103 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:07.148 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:39:07.148 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:07.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:07.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:07.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-01-22T05:39:07.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.442+0000 7fb855200700 1 Processor -- start 2024-01-22T05:39:07.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.442+0000 7fb855200700 1 -- start start 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb855200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb85005e900 0x7fb8500aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb855200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8500c74b0 con 0x7fb8500a9f60 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb855200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb850158660 con 0x7fb8500c1940 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb855200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb850158940 con 0x7fb85005e900 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84d400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb85005e900 0x7fb8500aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84d400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb85005e900 0x7fb8500aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38980/0 (socket says 172.21.15.100:38980) 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84de00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb8500a9f60 0x7fb85005e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53350/0 (socket says 172.21.15.100:53350) 2024-01-22T05:39:07.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84d400700 1 -- 172.21.15.100:0/841594496 learned_addr learned my addr 172.21.15.100:0/841594496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:07.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84d400700 1 -- 172.21.15.100:0/841594496 >> v1:172.21.15.169:6789/0 conn(0x7fb8500c1940 legacy=0x7fb850098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:07.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84d400700 1 -- 172.21.15.100:0/841594496 >> v1:172.21.15.100:6789/0 conn(0x7fb8500a9f60 legacy=0x7fb85005e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84d400700 1 -- 172.21.15.100:0/841594496 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500c7140 con 0x7fb85005e900 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.444+0000 7fb84ca00700 1 -- 172.21.15.100:0/841594496 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625107885 0 0) 0x7fb8500c74b0 con 0x7fb8500a9f60 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb84d400700 1 --2- 172.21.15.100:0/841594496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fb838006fd0 tx=0x7fb8380090f0).ready entity=mon.0 client_cookie=de982c2336966194 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb84ca00700 1 -- 172.21.15.100:0/841594496 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800b600 con 0x7fb85005e900 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb84ca00700 1 -- 172.21.15.100:0/841594496 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800b760 con 0x7fb85005e900 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb84ca00700 1 -- 172.21.15.100:0/841594496 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800bae0 con 0x7fb85005e900 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb855200700 1 -- 172.21.15.100:0/841594496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 msgr2=0x7fb8500aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb855200700 1 --2- 172.21.15.100:0/841594496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fb838006fd0 tx=0x7fb8380090f0).stop 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb855200700 1 -- 172.21.15.100:0/841594496 shutdown_connections 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb855200700 1 --2- 172.21.15.100:0/841594496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa340 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb855200700 1 -- 172.21.15.100:0/841594496 >> 172.21.15.100:0/841594496 conn(0x7fb8500cada0 msgr2=0x7fb8500cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.445+0000 7fb855200700 1 -- 172.21.15.100:0/841594496 shutdown_connections 2024-01-22T05:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.446+0000 7fb855200700 1 -- 172.21.15.100:0/841594496 wait complete. 2024-01-22T05:39:07.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.447+0000 7fb855200700 1 Processor -- start 2024-01-22T05:39:07.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.447+0000 7fb855200700 1 -- start start 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb855200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb855200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8500a9f60 0x7fb850154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb855200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8500c1940 0x7fb850152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb855200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c3e40 con 0x7fb85005e900 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb855200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c3230 con 0x7fb8500a9f60 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb855200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c3510 con 0x7fb8500c1940 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb84de00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb84de00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38986/0 (socket says 172.21.15.100:38986) 2024-01-22T05:39:07.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb84de00700 1 -- 172.21.15.100:0/3857816851 learned_addr learned my addr 172.21.15.100:0/3857816851 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb84d400700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8500a9f60 0x7fb850154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.448+0000 7fb84e800700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8500c1940 0x7fb850152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb84de00700 1 -- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8500c1940 msgr2=0x7fb850152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb84de00700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8500c1940 0x7fb850152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb84de00700 1 -- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8500a9f60 msgr2=0x7fb850154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb84de00700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8500a9f60 0x7fb850154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb84de00700 1 -- 172.21.15.100:0/3857816851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009370 con 0x7fb85005e900 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb84e800700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8500c1940 0x7fb850152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb84de00700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa650 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fb84000c560 tx=0x7fb840007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb845600700 1 -- 172.21.15.100:0/3857816851 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400072e0 con 0x7fb85005e900 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb845600700 1 -- 172.21.15.100:0/3857816851 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840007440 con 0x7fb85005e900 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500c37f0 con 0x7fb85005e900 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb845600700 1 -- 172.21.15.100:0/3857816851 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400058f0 con 0x7fb85005e900 2024-01-22T05:39:07.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.449+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb850154c60 con 0x7fb85005e900 2024-01-22T05:39:07.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.450+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8500ca890 con 0x7fb85005e900 2024-01-22T05:39:07.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.451+0000 7fb845600700 1 -- 172.21.15.100:0/3857816851 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb840005ce0 con 0x7fb85005e900 2024-01-22T05:39:07.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.452+0000 7fb845600700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb82805f150 0x7fb828061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:07.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.452+0000 7fb845600700 1 -- 172.21.15.100:0/3857816851 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb840079a50 con 0x7fb85005e900 2024-01-22T05:39:07.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.452+0000 7fb84d400700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb82805f150 0x7fb828061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:07.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.452+0000 7fb84d400700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb82805f150 0x7fb828061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb838009130 tx=0x7fb838017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.456+0000 7fb845600700 1 -- 172.21.15.100:0/3857816851 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb84004ac60 con 0x7fb85005e900 2024-01-22T05:39:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:07.627+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7fb85005fdb0 con 0x7fb85005e900 2024-01-22T05:39:08.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.201+0000 7fb845600700 1 -- 172.21.15.100:0/3857816851 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v37) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb84004e280 con 0x7fb85005e900 2024-01-22T05:39:08.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb82805f150 msgr2=0x7fb828061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb82805f150 0x7fb828061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb838009130 tx=0x7fb838017000).stop 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 msgr2=0x7fb8500aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa650 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fb84000c560 tx=0x7fb840007c90).stop 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 shutdown_connections 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb82805f150 0x7fb828061610 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0x7fb838009130 tx=0x7fb838017000).stop 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8500c1940 0x7fb850152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb85005e900 0x7fb8500aa650 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 --2- 172.21.15.100:0/3857816851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8500a9f60 0x7fb850154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.205+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 >> 172.21.15.100:0/3857816851 conn(0x7fb8500cada0 msgr2=0x7fb850157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:08.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.206+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 shutdown_connections 2024-01-22T05:39:08.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.206+0000 7fb855200700 1 -- 172.21.15.100:0/3857816851 wait complete. 2024-01-22T05:39:08.213 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'data_new' created 2024-01-22T05:39:08.230 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-01-22T05:39:08.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.415+0000 7f5418200700 1 Processor -- start 2024-01-22T05:39:08.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.415+0000 7f5418200700 1 -- start start 2024-01-22T05:39:08.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5418200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5410157290 0x7f5410092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5418200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410092600 0x7f54100c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5418200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5410065000 con 0x7f5410157670 2024-01-22T05:39:08.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5418200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54100c4250 con 0x7f5410157290 2024-01-22T05:39:08.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5418200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54100643f0 con 0x7f5410092600 2024-01-22T05:39:08.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5414e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410092600 0x7f54100c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5414e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410092600 0x7f54100c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:55852/0 (socket says 172.21.15.100:55852) 2024-01-22T05:39:08.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5414e00700 1 -- 172.21.15.100:0/3871953734 learned_addr learned my addr 172.21.15.100:0/3871953734 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:08.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5415800700 1 --2- 172.21.15.100:0/3871953734 >> v2:172.21.15.169:3300/0 conn(0x7f5410157290 0x7f5410092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.417+0000 7f5416200700 1 --1- 172.21.15.100:0/3871953734 >> v1:172.21.15.169:6789/0 conn(0x7f5410157670 0x7f5410157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:33412/0 (socket says 172.21.15.100:33412) 2024-01-22T05:39:08.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f5414e00700 1 -- 172.21.15.100:0/3871953734 >> v2:172.21.15.169:3300/0 conn(0x7f5410157290 msgr2=0x7f5410092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f5414e00700 1 --2- 172.21.15.100:0/3871953734 >> v2:172.21.15.169:3300/0 conn(0x7f5410157290 0x7f5410092110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f5414e00700 1 -- 172.21.15.100:0/3871953734 >> v1:172.21.15.169:6789/0 conn(0x7f5410157670 legacy=0x7f5410157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f5414e00700 1 -- 172.21.15.100:0/3871953734 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54100646d0 con 0x7f5410092600 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f5414e00700 1 --2- 172.21.15.100:0/3871953734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410092600 0x7f54100c5470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f53f8006fd0 tx=0x7f53f80090f0).ready entity=mon.2 client_cookie=e418ed00b07f7fc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f540fe00700 1 -- 172.21.15.100:0/3871953734 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800b580 con 0x7f5410092600 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f540fe00700 1 -- 172.21.15.100:0/3871953734 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f800b6e0 con 0x7f5410092600 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.418+0000 7f540fe00700 1 -- 172.21.15.100:0/3871953734 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800ba60 con 0x7f5410092600 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 -- 172.21.15.100:0/3871953734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410092600 msgr2=0x7f54100c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 --2- 172.21.15.100:0/3871953734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410092600 0x7f54100c5470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f53f8006fd0 tx=0x7f53f80090f0).stop 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 -- 172.21.15.100:0/3871953734 shutdown_connections 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 --2- 172.21.15.100:0/3871953734 >> v2:172.21.15.169:3300/0 conn(0x7f5410157290 0x7f5410092110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 --2- 172.21.15.100:0/3871953734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410092600 0x7f54100c5470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 -- 172.21.15.100:0/3871953734 >> 172.21.15.100:0/3871953734 conn(0x7f541005e9d0 msgr2=0x7f5410091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 -- 172.21.15.100:0/3871953734 shutdown_connections 2024-01-22T05:39:08.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.419+0000 7f5418200700 1 -- 172.21.15.100:0/3871953734 wait complete. 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.420+0000 7f5418200700 1 Processor -- start 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.421+0000 7f5418200700 1 -- start start 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.421+0000 7f5418200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5410092600 0x7f54100c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.421+0000 7f5418200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410157290 0x7f5410150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.421+0000 7f5418200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410157670 0x7f54100adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5418200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541014fc90 con 0x7f5410157670 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5418200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541014ede0 con 0x7f5410092600 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5418200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541014f080 con 0x7f5410157290 2024-01-22T05:39:08.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410157670 0x7f54100adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410157670 0x7f54100adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38998/0 (socket says 172.21.15.100:38998) 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 -- 172.21.15.100:0/1317796528 learned_addr learned my addr 172.21.15.100:0/1317796528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5415800700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5410092600 0x7f54100c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5414e00700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410157290 0x7f5410150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 -- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410157290 msgr2=0x7f5410150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410157290 0x7f5410150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 -- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5410092600 msgr2=0x7f54100c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5410092600 0x7f54100c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.422+0000 7f5416200700 1 -- 172.21.15.100:0/1317796528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8009370 con 0x7f5410157670 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.423+0000 7f5416200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410157670 0x7f54100adf90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f540800c7c0 tx=0x7f54080014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.423+0000 7f540cc00700 1 -- 172.21.15.100:0/1317796528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408005c70 con 0x7f5410157670 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.423+0000 7f540cc00700 1 -- 172.21.15.100:0/1317796528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408005dd0 con 0x7f5410157670 2024-01-22T05:39:08.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.423+0000 7f540cc00700 1 -- 172.21.15.100:0/1317796528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080072e0 con 0x7f5410157670 2024-01-22T05:39:08.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.423+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541014f360 con 0x7f5410157670 2024-01-22T05:39:08.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.423+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541014f920 con 0x7f5410157670 2024-01-22T05:39:08.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.424+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541014fe00 con 0x7f5410157670 2024-01-22T05:39:08.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.425+0000 7f540cc00700 1 -- 172.21.15.100:0/1317796528 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5408007710 con 0x7f5410157670 2024-01-22T05:39:08.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.426+0000 7f540cc00700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f53e805f150 0x7f53e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.426+0000 7f540cc00700 1 -- 172.21.15.100:0/1317796528 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f5408079c00 con 0x7f5410157670 2024-01-22T05:39:08.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.426+0000 7f5415800700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f53e805f150 0x7f53e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.427+0000 7f5415800700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f53e805f150 0x7f53e8061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5400009c30 tx=0x7f5400009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:08.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.430+0000 7f540cc00700 1 -- 172.21.15.100:0/1317796528 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5408080080 con 0x7f5410157670 2024-01-22T05:39:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.644+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f541005fdb0 con 0x7f5410157670 2024-01-22T05:39:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.649+0000 7f540cc00700 1 -- 172.21.15.100:0/1317796528 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v15) v1 ==== 131+0+0 (secure 0 0 0) 0x7f540804ad60 con 0x7f5410157670 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.652+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f53e805f150 msgr2=0x7f53e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.652+0000 7f5418200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f53e805f150 0x7f53e8061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5400009c30 tx=0x7f5400009060).stop 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.652+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410157670 msgr2=0x7f54100adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.652+0000 7f5418200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410157670 0x7f54100adf90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f540800c7c0 tx=0x7f54080014e0).stop 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 shutdown_connections 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f53e805f150 0x7f53e8061610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5410092600 0x7f54100c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410157670 0x7f54100adf90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 --2- 172.21.15.100:0/1317796528 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5410157290 0x7f5410150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 >> 172.21.15.100:0/1317796528 conn(0x7f541005e9d0 msgr2=0x7f54100c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 shutdown_connections 2024-01-22T05:39:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.653+0000 7f5418200700 1 -- 172.21.15.100:0/1317796528 wait complete. 2024-01-22T05:39:08.655 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 7 to fsmap 2024-01-22T05:39:08.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.861+0000 7f9403a00700 1 Processor -- start 2024-01-22T05:39:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.861+0000 7f9403a00700 1 -- start start 2024-01-22T05:39:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.862+0000 7f9403a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f93fc153fb0 0x7f93fc0c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.862+0000 7f9403a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0640f0 0x7f93fc15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.862+0000 7f9403a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc0c5d20 con 0x7f93fc0a7c90 2024-01-22T05:39:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.862+0000 7f9403a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc0c57a0 con 0x7f93fc153fb0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.862+0000 7f9403a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0c16c0 con 0x7f93fc0640f0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f93fc153fb0 0x7f93fc0c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f93fc153fb0 0x7f93fc0c0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39010/0 (socket says 172.21.15.100:39010) 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 -- 172.21.15.100:0/3161943500 learned_addr learned my addr 172.21.15.100:0/3161943500 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f93fbe00700 1 --1- 172.21.15.100:0/3161943500 >> v1:172.21.15.100:6789/0 conn(0x7f93fc0a7c90 0x7f93fc0639e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53362/0 (socket says 172.21.15.100:53362) 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401a00700 1 --2- 172.21.15.100:0/3161943500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0640f0 0x7f93fc15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 -- 172.21.15.100:0/3161943500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0640f0 msgr2=0x7f93fc15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 --2- 172.21.15.100:0/3161943500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0640f0 0x7f93fc15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 -- 172.21.15.100:0/3161943500 >> v1:172.21.15.100:6789/0 conn(0x7f93fc0a7c90 legacy=0x7f93fc0639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 -- 172.21.15.100:0/3161943500 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0c19a0 con 0x7f93fc153fb0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f9401000700 1 --2- 172.21.15.100:0/3161943500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc153fb0 0x7f93fc0c0e30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f93ec006fd0 tx=0x7f93ec0090f0).ready entity=mon.0 client_cookie=120265186e6d16b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.863+0000 7f93fb400700 1 -- 172.21.15.100:0/3161943500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00b600 con 0x7f93fc153fb0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f93fb400700 1 -- 172.21.15.100:0/3161943500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec00b760 con 0x7f93fc153fb0 2024-01-22T05:39:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f93fb400700 1 -- 172.21.15.100:0/3161943500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00bae0 con 0x7f93fc153fb0 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 -- 172.21.15.100:0/3161943500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc153fb0 msgr2=0x7f93fc0c0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 --2- 172.21.15.100:0/3161943500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc153fb0 0x7f93fc0c0e30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f93ec006fd0 tx=0x7f93ec0090f0).stop 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 -- 172.21.15.100:0/3161943500 shutdown_connections 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 --2- 172.21.15.100:0/3161943500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc153fb0 0x7f93fc0c0e30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 --2- 172.21.15.100:0/3161943500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0640f0 0x7f93fc15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 -- 172.21.15.100:0/3161943500 >> 172.21.15.100:0/3161943500 conn(0x7f93fc0c78a0 msgr2=0x7f93fc0c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 -- 172.21.15.100:0/3161943500 shutdown_connections 2024-01-22T05:39:08.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.864+0000 7f9403a00700 1 -- 172.21.15.100:0/3161943500 wait complete. 2024-01-22T05:39:08.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.866+0000 7f9403a00700 1 Processor -- start 2024-01-22T05:39:08.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.866+0000 7f9403a00700 1 -- start start 2024-01-22T05:39:08.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9403a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc0640f0 0x7f93fc165440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9403a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0a7c90 0x7f93fc14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9403a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93fc153fb0 0x7f93fc164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9403a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc151fc0 con 0x7f93fc0640f0 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9403a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc1519b0 con 0x7f93fc153fb0 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9403a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc164d60 con 0x7f93fc0a7c90 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc0640f0 0x7f93fc165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc0640f0 0x7f93fc165440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39012/0 (socket says 172.21.15.100:39012) 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 -- 172.21.15.100:0/1125147908 learned_addr learned my addr 172.21.15.100:0/1125147908 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401a00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93fc153fb0 0x7f93fc164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f93fbe00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0a7c90 0x7f93fc14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 -- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0a7c90 msgr2=0x7f93fc14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0a7c90 0x7f93fc14e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 -- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93fc153fb0 msgr2=0x7f93fc164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93fc153fb0 0x7f93fc164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f9401000700 1 -- 172.21.15.100:0/1125147908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec009370 con 0x7f93fc0640f0 2024-01-22T05:39:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.867+0000 7f93fbe00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0a7c90 0x7f93fc14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.868+0000 7f9401000700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc0640f0 0x7f93fc165440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f93fc0842a0 tx=0x7f93ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.868+0000 7f93f3e00700 1 -- 172.21.15.100:0/1125147908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00b8d0 con 0x7f93fc0640f0 2024-01-22T05:39:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.868+0000 7f93f3e00700 1 -- 172.21.15.100:0/1125147908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec00ba30 con 0x7f93fc0640f0 2024-01-22T05:39:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.868+0000 7f93f3e00700 1 -- 172.21.15.100:0/1125147908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec01d680 con 0x7f93fc0640f0 2024-01-22T05:39:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.868+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc165040 con 0x7f93fc0640f0 2024-01-22T05:39:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.868+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc0c4ba0 con 0x7f93fc0640f0 2024-01-22T05:39:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.869+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc05fdb0 con 0x7f93fc0640f0 2024-01-22T05:39:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.870+0000 7f93f3e00700 1 -- 172.21.15.100:0/1125147908 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f93ec01da30 con 0x7f93fc0640f0 2024-01-22T05:39:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.871+0000 7f93f3e00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f93d405f150 0x7f93d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.871+0000 7f93f3e00700 1 -- 172.21.15.100:0/1125147908 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f93ec07c630 con 0x7f93fc0640f0 2024-01-22T05:39:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.871+0000 7f93fbe00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f93d405f150 0x7f93d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.872+0000 7f93fbe00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f93d405f150 0x7f93d4061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f93fc161e90 tx=0x7f93e4007c90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:08.875+0000 7f93f3e00700 1 -- 172.21.15.100:0/1125147908 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f93ec04d770 con 0x7f93fc0640f0 2024-01-22T05:39:09.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.087+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93fc06abb0 con 0x7f93fc0640f0 2024-01-22T05:39:09.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.088+0000 7f93f3e00700 1 -- 172.21.15.100:0/1125147908 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f93ec021020 con 0x7f93fc0640f0 2024-01-22T05:39:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:09.089 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:38:58.799067+0000","modified":"2024-01-22T05:39:08.646529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6834/2612830615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2612830615},{"type":"v1","addr":"172.21.15.169:6834","nonce":2612830615}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:39:09.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f93d405f150 msgr2=0x7f93d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f93d405f150 0x7f93d4061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f93fc161e90 tx=0x7f93e4007c90).stop 2024-01-22T05:39:09.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc0640f0 msgr2=0x7f93fc165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc0640f0 0x7f93fc165440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f93fc0842a0 tx=0x7f93ec017000).stop 2024-01-22T05:39:09.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 shutdown_connections 2024-01-22T05:39:09.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f93d405f150 0x7f93d4061610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93fc153fb0 0x7f93fc164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93fc0640f0 0x7f93fc165440 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 --2- 172.21.15.100:0/1125147908 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93fc0a7c90 0x7f93fc14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 >> 172.21.15.100:0/1125147908 conn(0x7f93fc0c78a0 msgr2=0x7f93fc1563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:09.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 shutdown_connections 2024-01-22T05:39:09.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.090+0000 7f9403a00700 1 -- 172.21.15.100:0/1125147908 wait complete. 2024-01-22T05:39:09.092 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 15 2024-01-22T05:39:09.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:09.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.292+0000 7f1ca3e00700 1 Processor -- start 2024-01-22T05:39:09.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.293+0000 7f1ca3e00700 1 -- start start 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca3e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c9c154040 0x7f1c9c066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c064c30 0x7f1c9c065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca3e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c065540 con 0x7f1c9c153c60 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca3e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c0bc510 con 0x7f1c9c154040 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0bc7f0 con 0x7f1c9c064c30 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca0a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c9c154040 0x7f1c9c066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca0a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c9c154040 0x7f1c9c066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39028/0 (socket says 172.21.15.100:39028) 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca0a00700 1 -- 172.21.15.100:0/2079691150 learned_addr learned my addr 172.21.15.100:0/2079691150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:09.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.294+0000 7f1ca1e00700 1 --2- 172.21.15.100:0/2079691150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c064c30 0x7f1c9c065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1ca0a00700 1 -- 172.21.15.100:0/2079691150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c064c30 msgr2=0x7f1c9c065050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1ca0a00700 1 --2- 172.21.15.100:0/2079691150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c064c30 0x7f1c9c065050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1ca0a00700 1 -- 172.21.15.100:0/2079691150 >> v1:172.21.15.169:6789/0 conn(0x7f1c9c153c60 legacy=0x7f1c9c0c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1ca0a00700 1 -- 172.21.15.100:0/2079691150 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0c45b0 con 0x7f1c9c154040 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1ca0a00700 1 --2- 172.21.15.100:0/2079691150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c066520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f1c84006fd0 tx=0x7f1c840090f0).ready entity=mon.0 client_cookie=b397b1fa89ef6751 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1c9be00700 1 -- 172.21.15.100:0/2079691150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400b600 con 0x7f1c9c154040 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1c9be00700 1 -- 172.21.15.100:0/2079691150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8400b760 con 0x7f1c9c154040 2024-01-22T05:39:09.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1c9be00700 1 -- 172.21.15.100:0/2079691150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400bae0 con 0x7f1c9c154040 2024-01-22T05:39:09.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1ca3e00700 1 -- 172.21.15.100:0/2079691150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 msgr2=0x7f1c9c066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.295+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/2079691150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c066520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f1c84006fd0 tx=0x7f1c840090f0).stop 2024-01-22T05:39:09.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.296+0000 7f1ca3e00700 1 -- 172.21.15.100:0/2079691150 shutdown_connections 2024-01-22T05:39:09.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.296+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/2079691150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c064c30 0x7f1c9c065050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.296+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/2079691150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c066520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.296+0000 7f1ca3e00700 1 -- 172.21.15.100:0/2079691150 >> 172.21.15.100:0/2079691150 conn(0x7f1c9c0c7d20 msgr2=0x7f1c9c0c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:09.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.296+0000 7f1ca3e00700 1 -- 172.21.15.100:0/2079691150 shutdown_connections 2024-01-22T05:39:09.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.296+0000 7f1ca3e00700 1 -- 172.21.15.100:0/2079691150 wait complete. 2024-01-22T05:39:09.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.297+0000 7f1ca3e00700 1 Processor -- start 2024-01-22T05:39:09.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.297+0000 7f1ca3e00700 1 -- start start 2024-01-22T05:39:09.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.298+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c064c30 0x7f1c9c0aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.298+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c153c60 0x7f1c9c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.298+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.298+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c154490 con 0x7f1c9c154040 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.298+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c154770 con 0x7f1c9c064c30 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.298+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c150930 con 0x7f1c9c153c60 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.298+0000 7f1ca1e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c1481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39030/0 (socket says 172.21.15.100:39030) 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 -- 172.21.15.100:0/4092794500 learned_addr learned my addr 172.21.15.100:0/4092794500 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca0a00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c153c60 0x7f1c9c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1400700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c064c30 0x7f1c9c0aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 -- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c153c60 msgr2=0x7f1c9c150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c153c60 0x7f1c9c150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 -- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c064c30 msgr2=0x7f1c9c0aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c064c30 0x7f1c9c0aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 -- 172.21.15.100:0/4092794500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c84009370 con 0x7f1c9c154040 2024-01-22T05:39:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca1e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c1481a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f1c94007f50 tx=0x7f1c94009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1c98c00700 1 -- 172.21.15.100:0/4092794500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400eb70 con 0x7f1c9c154040 2024-01-22T05:39:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1c98c00700 1 -- 172.21.15.100:0/4092794500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9400ecd0 con 0x7f1c9c154040 2024-01-22T05:39:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c150c10 con 0x7f1c9c154040 2024-01-22T05:39:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1c98c00700 1 -- 172.21.15.100:0/4092794500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94014610 con 0x7f1c9c154040 2024-01-22T05:39:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.299+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c0aaf30 con 0x7f1c9c154040 2024-01-22T05:39:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.300+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c154900 con 0x7f1c9c154040 2024-01-22T05:39:09.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.301+0000 7f1c98c00700 1 -- 172.21.15.100:0/4092794500 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1c94014980 con 0x7f1c9c154040 2024-01-22T05:39:09.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.302+0000 7f1c98c00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1c7405f150 0x7f1c74061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.302+0000 7f1c98c00700 1 -- 172.21.15.100:0/4092794500 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f1c9407a7a0 con 0x7f1c9c154040 2024-01-22T05:39:09.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.302+0000 7f1ca1400700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1c7405f150 0x7f1c74061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.303+0000 7f1ca1400700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1c7405f150 0x7f1c74061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1c8c003900 tx=0x7f1c8c007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:09.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.306+0000 7f1c98c00700 1 -- 172.21.15.100:0/4092794500 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1c9404b820 con 0x7f1c9c154040 2024-01-22T05:39:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.478+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c9c05fdb0 con 0x7f1c9c154040 2024-01-22T05:39:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.479+0000 7f1c98c00700 1 -- 172.21.15.100:0/4092794500 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18548 (secure 0 0 0) 0x7f1c9404ee40 con 0x7f1c9c154040 2024-01-22T05:39:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:09.481 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:08.646241+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:38:56.791674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-22T05:38:57.778340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-22T05:39:07.671856+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.481+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1c7405f150 msgr2=0x7f1c74061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.481+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1c7405f150 0x7f1c74061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1c8c003900 tx=0x7f1c8c007d40).stop 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.481+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 msgr2=0x7f1c9c1481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.481+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c1481a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f1c94007f50 tx=0x7f1c94009860).stop 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 shutdown_connections 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1c7405f150 0x7f1c74061610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c064c30 0x7f1c9c0aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c154040 0x7f1c9c1481a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 --2- 172.21.15.100:0/4092794500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c153c60 0x7f1c9c150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 >> 172.21.15.100:0/4092794500 conn(0x7f1c9c0c7d20 msgr2=0x7f1c9c0a9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 shutdown_connections 2024-01-22T05:39:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.482+0000 7f1ca3e00700 1 -- 172.21.15.100:0/4092794500 wait complete. 2024-01-22T05:39:09.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:09.500 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-01-22T05:39:09.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:09.555 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-01-22T05:39:09.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-01-22T05:39:09.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.798+0000 7f423c800700 1 Processor -- start 2024-01-22T05:39:09.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.798+0000 7f423c800700 1 -- start start 2024-01-22T05:39:09.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f423c800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4234138440 0x7f42340681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f423c800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4234138820 0x7f42340686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f423c800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4234064520 con 0x7f42340c5120 2024-01-22T05:39:09.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f423c800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4234064e30 con 0x7f4234138440 2024-01-22T05:39:09.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f423c800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4234068bc0 con 0x7f4234138820 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f4239e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4234138440 0x7f42340681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f4239e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4234138440 0x7f42340681e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39038/0 (socket says 172.21.15.100:39038) 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.799+0000 7f4239e00700 1 -- 172.21.15.100:0/3226404147 learned_addr learned my addr 172.21.15.100:0/3226404147 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4239400700 1 --2- 172.21.15.100:0/3226404147 >> v2:172.21.15.169:3300/0 conn(0x7f4234138820 0x7f42340686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4239e00700 1 -- 172.21.15.100:0/3226404147 >> v2:172.21.15.169:3300/0 conn(0x7f4234138820 msgr2=0x7f42340686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4239e00700 1 --2- 172.21.15.100:0/3226404147 >> v2:172.21.15.169:3300/0 conn(0x7f4234138820 0x7f42340686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4239e00700 1 -- 172.21.15.100:0/3226404147 >> v1:172.21.15.169:6789/0 conn(0x7f42340c5120 legacy=0x7f42340c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4239e00700 1 -- 172.21.15.100:0/3226404147 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340c5e50 con 0x7f4234138440 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4239400700 1 --2- 172.21.15.100:0/3226404147 >> v2:172.21.15.169:3300/0 conn(0x7f4234138820 0x7f42340686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4239e00700 1 --2- 172.21.15.100:0/3226404147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f42340681e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f42340a5fb0 tx=0x7f42240090f0).ready entity=mon.0 client_cookie=83555752a25dce4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4238a00700 1 -- 172.21.15.100:0/3226404147 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400b580 con 0x7f4234138440 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4238a00700 1 -- 172.21.15.100:0/3226404147 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400b6e0 con 0x7f4234138440 2024-01-22T05:39:09.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.800+0000 7f4238a00700 1 -- 172.21.15.100:0/3226404147 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400ba80 con 0x7f4234138440 2024-01-22T05:39:09.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 -- 172.21.15.100:0/3226404147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 msgr2=0x7f42340681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 --2- 172.21.15.100:0/3226404147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f42340681e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f42340a5fb0 tx=0x7f42240090f0).stop 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 -- 172.21.15.100:0/3226404147 shutdown_connections 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 --2- 172.21.15.100:0/3226404147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f42340681e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 --2- 172.21.15.100:0/3226404147 >> v2:172.21.15.169:3300/0 conn(0x7f4234138820 0x7f42340686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 -- 172.21.15.100:0/3226404147 >> 172.21.15.100:0/3226404147 conn(0x7f42340630c0 msgr2=0x7f42340c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 -- 172.21.15.100:0/3226404147 shutdown_connections 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.801+0000 7f423c800700 1 -- 172.21.15.100:0/3226404147 wait complete. 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.802+0000 7f423c800700 1 Processor -- start 2024-01-22T05:39:09.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.803+0000 7f423c800700 1 -- start start 2024-01-22T05:39:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.803+0000 7f423c800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42340c5120 0x7f4234150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.803+0000 7f423c800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f4234147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.803+0000 7f423c800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4234138820 0x7f4234065250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.803+0000 7f423c800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340a6e30 con 0x7f4234138440 2024-01-22T05:39:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.803+0000 7f423c800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340a7110 con 0x7f42340c5120 2024-01-22T05:39:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.803+0000 7f423c800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340a73f0 con 0x7f4234138820 2024-01-22T05:39:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f4234147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f4234147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39046/0 (socket says 172.21.15.100:39046) 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 -- 172.21.15.100:0/1484440599 learned_addr learned my addr 172.21.15.100:0/1484440599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239e00700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42340c5120 0x7f4234150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f423a800700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4234138820 0x7f4234065250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 -- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4234138820 msgr2=0x7f4234065250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4234138820 0x7f4234065250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 -- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42340c5120 msgr2=0x7f4234150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42340c5120 0x7f4234150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 -- 172.21.15.100:0/1484440599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009370 con 0x7f4234138440 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4239400700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f4234147460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f421c00c880 tx=0x7f421c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.804+0000 7f4231600700 1 -- 172.21.15.100:0/1484440599 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c010580 con 0x7f4234138440 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.805+0000 7f4231600700 1 -- 172.21.15.100:0/1484440599 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c0106e0 con 0x7f4234138440 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.805+0000 7f4231600700 1 -- 172.21.15.100:0/1484440599 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c010a80 con 0x7f4234138440 2024-01-22T05:39:09.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.805+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42340a76d0 con 0x7f4234138440 2024-01-22T05:39:09.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.805+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42340a63a0 con 0x7f4234138440 2024-01-22T05:39:09.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.806+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42340bec60 con 0x7f4234138440 2024-01-22T05:39:09.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.806+0000 7f4231600700 1 -- 172.21.15.100:0/1484440599 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f421c01b460 con 0x7f4234138440 2024-01-22T05:39:09.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.807+0000 7f4231600700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f420c05f150 0x7f420c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:09.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.807+0000 7f4231600700 1 -- 172.21.15.100:0/1484440599 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f421c07a2d0 con 0x7f4234138440 2024-01-22T05:39:09.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.807+0000 7f4239e00700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f420c05f150 0x7f420c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:09.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.808+0000 7f4239e00700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f420c05f150 0x7f420c061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f4224008000 tx=0x7f4224017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:09.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:09.811+0000 7f4231600700 1 -- 172.21.15.100:0/1484440599 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f421c04b2f0 con 0x7f4234138440 2024-01-22T05:39:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.043+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f423405fdb0 con 0x7f4234138440 2024-01-22T05:39:10.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.047+0000 7f4231600700 1 -- 172.21.15.100:0/1484440599 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) v1 ==== 210+0+0 (secure 0 0 0) 0x7f421c04e910 con 0x7f4234138440 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.049+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f420c05f150 msgr2=0x7f420c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.049+0000 7f423c800700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f420c05f150 0x7f420c061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f4224008000 tx=0x7f4224017000).stop 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.049+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 msgr2=0x7f4234147460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.049+0000 7f423c800700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f4234147460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f421c00c880 tx=0x7f421c008040).stop 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 shutdown_connections 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f420c05f150 0x7f420c061610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42340c5120 0x7f4234150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4234138820 0x7f4234065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 --2- 172.21.15.100:0/1484440599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4234138440 0x7f4234147460 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 >> 172.21.15.100:0/1484440599 conn(0x7f42340630c0 msgr2=0x7f42340c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 shutdown_connections 2024-01-22T05:39:10.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:10.050+0000 7f423c800700 1 -- 172.21.15.100:0/1484440599 wait complete. 2024-01-22T05:39:10.052 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:39:10.068 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:39:10.068 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:39:10.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:10.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[83097]: fuse finished with error 0 and tester_r 0 2024-01-22T05:39:10.134 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:39:16.236 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:39:16.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:16.237 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:39:16.287 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:39:16.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.446+0000 7fb790400700 1 Processor -- start 2024-01-22T05:39:16.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.446+0000 7fb790400700 1 -- start start 2024-01-22T05:39:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.447+0000 7fb790400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7880c5f40 0x7fb7880c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.447+0000 7fb790400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb788154880 0x7fb7880c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.447+0000 7fb790400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880c8710 con 0x7fb78814e200 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.447+0000 7fb790400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb788155830 con 0x7fb788154880 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.447+0000 7fb790400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c6810 con 0x7fb7880c5f40 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78d000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb788154880 0x7fb7880c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78e400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb78814e200 0x7fb78814e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57814/0 (socket says 172.21.15.100:57814) 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78e400700 1 -- 172.21.15.100:0/3476523220 learned_addr learned my addr 172.21.15.100:0/3476523220 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78da00700 1 --2- 172.21.15.100:0/3476523220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7880c5f40 0x7fb7880c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78d000700 1 -- 172.21.15.100:0/3476523220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7880c5f40 msgr2=0x7fb7880c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78d000700 1 --2- 172.21.15.100:0/3476523220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7880c5f40 0x7fb7880c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78d000700 1 -- 172.21.15.100:0/3476523220 >> v1:172.21.15.100:6789/0 conn(0x7fb78814e200 legacy=0x7fb78814e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78d000700 1 -- 172.21.15.100:0/3476523220 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880650f0 con 0x7fb788154880 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb787e00700 1 -- 172.21.15.100:0/3476523220 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61233395 0 0) 0x7fb780001490 con 0x7fb78814e200 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78da00700 1 --2- 172.21.15.100:0/3476523220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7880c5f40 0x7fb7880c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb78d000700 1 --2- 172.21.15.100:0/3476523220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb788154880 0x7fb7880c8220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fb770009760 tx=0x7fb770009060).ready entity=mon.0 client_cookie=5bf2a6d23f835543 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.448+0000 7fb787e00700 1 -- 172.21.15.100:0/3476523220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000b580 con 0x7fb788154880 2024-01-22T05:39:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb787e00700 1 -- 172.21.15.100:0/3476523220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77000b6e0 con 0x7fb788154880 2024-01-22T05:39:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb787e00700 1 -- 172.21.15.100:0/3476523220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000ba60 con 0x7fb788154880 2024-01-22T05:39:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 -- 172.21.15.100:0/3476523220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb788154880 msgr2=0x7fb7880c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 --2- 172.21.15.100:0/3476523220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb788154880 0x7fb7880c8220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fb770009760 tx=0x7fb770009060).stop 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 -- 172.21.15.100:0/3476523220 shutdown_connections 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 --2- 172.21.15.100:0/3476523220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7880c5f40 0x7fb7880c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 --2- 172.21.15.100:0/3476523220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb788154880 0x7fb7880c8220 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 -- 172.21.15.100:0/3476523220 >> 172.21.15.100:0/3476523220 conn(0x7fb7880cb840 msgr2=0x7fb7880c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 -- 172.21.15.100:0/3476523220 shutdown_connections 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.449+0000 7fb790400700 1 -- 172.21.15.100:0/3476523220 wait complete. 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.451+0000 7fb790400700 1 Processor -- start 2024-01-22T05:39:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.451+0000 7fb790400700 1 -- start start 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb790400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7880c5f40 0x7fb78814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb790400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb78814e200 0x7fb788156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb790400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb788154880 0x7fb7880c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb790400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c5680 con 0x7fb7880c5f40 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb790400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78814d910 con 0x7fb78814e200 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb790400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c2a60 con 0x7fb788154880 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7880c5f40 0x7fb78814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7880c5f40 0x7fb78814d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58588/0 (socket says 172.21.15.100:58588) 2024-01-22T05:39:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 -- 172.21.15.100:0/1501843812 learned_addr learned my addr 172.21.15.100:0/1501843812 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 -- 172.21.15.100:0/1501843812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb788154880 msgr2=0x7fb7880c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb788154880 0x7fb7880c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 -- 172.21.15.100:0/1501843812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb78814e200 msgr2=0x7fb788156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb78814e200 0x7fb788156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 -- 172.21.15.100:0/1501843812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700092a0 con 0x7fb7880c5f40 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.452+0000 7fb78da00700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7880c5f40 0x7fb78814d420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb77800c880 tx=0x7fb778008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.453+0000 7fb784c00700 1 -- 172.21.15.100:0/1501843812 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778010580 con 0x7fb7880c5f40 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.453+0000 7fb784c00700 1 -- 172.21.15.100:0/1501843812 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7780106e0 con 0x7fb7880c5f40 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.453+0000 7fb784c00700 1 -- 172.21.15.100:0/1501843812 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778010a60 con 0x7fb7880c5f40 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.453+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7880c53a0 con 0x7fb7880c5f40 2024-01-22T05:39:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.453+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880c26f0 con 0x7fb7880c5f40 2024-01-22T05:39:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.454+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7880c2270 con 0x7fb7880c5f40 2024-01-22T05:39:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.455+0000 7fb784c00700 1 -- 172.21.15.100:0/1501843812 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb77801b460 con 0x7fb7880c5f40 2024-01-22T05:39:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.455+0000 7fb784c00700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb76005f150 0x7fb760061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.455+0000 7fb784c00700 1 -- 172.21.15.100:0/1501843812 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fb77807a470 con 0x7fb7880c5f40 2024-01-22T05:39:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.456+0000 7fb78d000700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb76005f150 0x7fb760061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.456+0000 7fb78d000700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb76005f150 0x7fb760061610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb770009760 tx=0x7fb770017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:16.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.460+0000 7fb784c00700 1 -- 172.21.15.100:0/1501843812 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb7880c2270 con 0x7fb7880c5f40 2024-01-22T05:39:16.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.672+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb7880c2270 con 0x7fb7880c5f40 2024-01-22T05:39:16.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.673+0000 7fb784c00700 1 -- 172.21.15.100:0/1501843812 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+82 (secure 0 0 0) 0x7fb7880c2270 con 0x7fb7880c5f40 2024-01-22T05:39:16.673 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb76005f150 msgr2=0x7fb760061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb76005f150 0x7fb760061610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb770009760 tx=0x7fb770017000).stop 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7880c5f40 msgr2=0x7fb78814d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7880c5f40 0x7fb78814d420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb77800c880 tx=0x7fb778008040).stop 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 shutdown_connections 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb76005f150 0x7fb760061610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb788154880 0x7fb7880c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:16.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7880c5f40 0x7fb78814d420 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:16.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 --2- 172.21.15.100:0/1501843812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb78814e200 0x7fb788156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:16.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 >> 172.21.15.100:0/1501843812 conn(0x7fb7880cb840 msgr2=0x7fb7880b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:16.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 shutdown_connections 2024-01-22T05:39:16.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:16.675+0000 7fb790400700 1 -- 172.21.15.100:0/1501843812 wait complete. 2024-01-22T05:39:16.690 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:39:16.690 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:39:16.690 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:39:16.690 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:39:16.690 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:16.690 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:39:16.690 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:39:16.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:39:16.691 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:16.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:16.691 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:39:16.736 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:39:16.736 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:39:16.737 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40834sec preferred_lft 40834sec 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:39:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f05d:9bff:feba:b90d/64 scope link 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::1c0c:7cff:fe73:80ca/64 scope link 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether e6:39:c6:eb:cb:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::e439:c6ff:feeb:cbd7/64 scope link 2024-01-22T05:39:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:16.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:16.740 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:39:16.841 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:39:16.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:16.844 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:39:16.890 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:39:16.890 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:39:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:39:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:39:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:39:16.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:16.891 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:39:16.891 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:39:16.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:39:16.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:39:16.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:39:16.891 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:39:17.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:17.090 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:39:17.135 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:39:17.135 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:39:17.135 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:17.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:17.136 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-22T05:39:17.242 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-22T05:39:17.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:17.242 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:17.285 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:17.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:17.392 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:17.392 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:17.459 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:17.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:17.459 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:17.504 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:39:17.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:17.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:17.615 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:17.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:17.679 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:17.682 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:17.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:17.682 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:17.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-01-22T05:39:17.705+0000 7fbb9174b3c0 -1 init, newargv = 0x562ec1f3f170 newargc=15 2024-01-22T05:39:17.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[83968]: starting ceph client 2024-01-22T05:39:17.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[83968]: starting fuse 2024-01-22T05:39:17.729 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:39:17.729 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:39:17.730 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:39:17.731 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:39:17.732 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:39:17.732 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:17.732 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-01-22T05:39:17.732 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:39:17.913 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.83968.asok 2024-01-22T05:39:18.091 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.83968.asok 2024-01-22T05:39:18.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:18.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.83968.asok status 2024-01-22T05:39:18.304 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:39:18.304 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:39:18.304 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:39:18.304 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:39:18.304 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "83968", 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5196, 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5196 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:39:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3967505823 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3967505823 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5196 192.168.0.1:0/3967505823", 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/3967505823", 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 15, 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 39, 2024-01-22T05:39:18.306 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:39:18.307 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:39:18.307 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:39:18.307 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:39:18.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:18.318 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:39:18.318 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:18.362 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:39:18.363 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:18.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:18.363 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:18.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:18.469 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-01-22T05:39:18.533 INFO:teuthology.orchestra.run.smithi100.stderr:setfattr: layoutfile: Permission denied 2024-01-22T05:39:18.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:39:18.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:18.535 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-01-22T05:39:18.581 INFO:teuthology.orchestra.run.smithi100.stderr:setfattr: layoutdir: Permission denied 2024-01-22T05:39:18.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:39:18.582 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:39:18.582 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:39:18.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:18.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[83968]: fuse finished with error 0 and tester_r 0 2024-01-22T05:39:18.648 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:39:18.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:39:18.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:18.695 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:39:18.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-01-22T05:39:18.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.969+0000 7ff112800700 1 Processor -- start 2024-01-22T05:39:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.969+0000 7ff112800700 1 -- start start 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff112800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff10c157670 0x7ff10c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff112800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c0c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff112800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0c5e10 con 0x7ff10c157290 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff112800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c065000 con 0x7ff10c157670 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff112800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c092820 con 0x7ff10c0c5960 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff103e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff10c157670 0x7ff10c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff10be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c0c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff10b400700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff10c157290 0x7ff10c092110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:57632/0 (socket says 172.21.15.100:57632) 2024-01-22T05:39:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.971+0000 7ff10b400700 1 -- 172.21.15.100:0/2680051442 learned_addr learned my addr 172.21.15.100:0/2680051442 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:18.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff103e00700 1 -- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 msgr2=0x7ff10c0c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:18.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff103e00700 1 --2- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c0c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:18.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff103e00700 1 -- 172.21.15.100:0/2680051442 >> v1:172.21.15.169:6789/0 conn(0x7ff10c157290 legacy=0x7ff10c092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:18.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff103e00700 1 -- 172.21.15.100:0/2680051442 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0643f0 con 0x7ff10c157670 2024-01-22T05:39:18.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff10be00700 1 --2- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c0c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:18.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff10aa00700 1 -- 172.21.15.100:0/2680051442 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830130493 0 0) 0x7ff0fc001110 con 0x7ff10c157290 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff103e00700 1 --2- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157670 0x7ff10c0c5470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff0f4009760 tx=0x7ff0f4009060).ready entity=mon.1 client_cookie=e0a1212ce29114e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff10aa00700 1 -- 172.21.15.100:0/2680051442 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400f510 con 0x7ff10c157670 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff10aa00700 1 -- 172.21.15.100:0/2680051442 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f400f670 con 0x7ff10c157670 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.972+0000 7ff10aa00700 1 -- 172.21.15.100:0/2680051442 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400f9f0 con 0x7ff10c157670 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 -- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157670 msgr2=0x7ff10c0c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 --2- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157670 0x7ff10c0c5470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff0f4009760 tx=0x7ff0f4009060).stop 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 -- 172.21.15.100:0/2680051442 shutdown_connections 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 --2- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c0c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 --2- 172.21.15.100:0/2680051442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157670 0x7ff10c0c5470 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 -- 172.21.15.100:0/2680051442 >> 172.21.15.100:0/2680051442 conn(0x7ff10c05e9d0 msgr2=0x7ff10c091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 -- 172.21.15.100:0/2680051442 shutdown_connections 2024-01-22T05:39:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.973+0000 7ff112800700 1 -- 172.21.15.100:0/2680051442 wait complete. 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.974+0000 7ff112800700 1 Processor -- start 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.975+0000 7ff112800700 1 -- start start 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.975+0000 7ff112800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.975+0000 7ff112800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157290 0x7ff10c0aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff112800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c157670 0x7ff10c0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff112800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0abb50 con 0x7ff10c157670 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff112800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c154360 con 0x7ff10c157290 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff112800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0a8bf0 con 0x7ff10c0c5960 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff10be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c157670 0x7ff10c0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157290 0x7ff10c0aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157290 0x7ff10c0aa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:46338/0 (socket says 172.21.15.100:46338) 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff10be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c157670 0x7ff10c0c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58594/0 (socket says 172.21.15.100:58594) 2024-01-22T05:39:18.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 -- 172.21.15.100:0/114941832 learned_addr learned my addr 172.21.15.100:0/114941832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff10b400700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 -- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 msgr2=0x7ff10c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 -- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c157670 msgr2=0x7ff10c0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c157670 0x7ff10c0c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff103e00700 1 -- 172.21.15.100:0/114941832 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009a20 con 0x7ff10c157290 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.976+0000 7ff10be00700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c157670 0x7ff10c0c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.977+0000 7ff103e00700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157290 0x7ff10c0aa300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff0f4006d90 tx=0x7ff0f4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.977+0000 7ff102a00700 1 -- 172.21.15.100:0/114941832 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400f7e0 con 0x7ff10c157290 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.977+0000 7ff102a00700 1 -- 172.21.15.100:0/114941832 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f400f940 con 0x7ff10c157290 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.977+0000 7ff102a00700 1 -- 172.21.15.100:0/114941832 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f401b660 con 0x7ff10c157290 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.977+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f40092a0 con 0x7ff10c157290 2024-01-22T05:39:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.977+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c0a91b0 con 0x7ff10c157290 2024-01-22T05:39:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.978+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c0abd00 con 0x7ff10c157290 2024-01-22T05:39:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.979+0000 7ff102a00700 1 -- 172.21.15.100:0/114941832 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff0f401ba50 con 0x7ff10c157290 2024-01-22T05:39:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.980+0000 7ff102a00700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff0e405f150 0x7ff0e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.980+0000 7ff102a00700 1 -- 172.21.15.100:0/114941832 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7ff0f407bd20 con 0x7ff10c157290 2024-01-22T05:39:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.980+0000 7ff10b400700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff0e405f150 0x7ff0e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:18.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.980+0000 7ff10b400700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff0e405f150 0x7ff0e4061610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff0fc0075c0 tx=0x7ff0fc007a10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:18.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:18.985+0000 7ff102a00700 1 -- 172.21.15.100:0/114941832 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff10c0abd00 con 0x7ff10c157290 2024-01-22T05:39:19.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.222+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7ff10c0abd00 con 0x7ff10c157290 2024-01-22T05:39:19.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.229+0000 7ff102a00700 1 -- 172.21.15.100:0/114941832 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) v1 ==== 211+0+0 (secure 0 0 0) 0x7ff10c0abd00 con 0x7ff10c157290 2024-01-22T05:39:19.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff0e405f150 msgr2=0x7ff0e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff0e405f150 0x7ff0e4061610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff0fc0075c0 tx=0x7ff0fc007a10).stop 2024-01-22T05:39:19.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157290 msgr2=0x7ff10c0aa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157290 0x7ff10c0aa300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff0f4006d90 tx=0x7ff0f4017000).stop 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 shutdown_connections 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff0e405f150 0x7ff0e4061610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c157670 0x7ff10c0c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff10c0c5960 0x7ff10c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 --2- 172.21.15.100:0/114941832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff10c157290 0x7ff10c0aa300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 >> 172.21.15.100:0/114941832 conn(0x7ff10c05e9d0 msgr2=0x7ff10c0a6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 shutdown_connections 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.231+0000 7ff112800700 1 -- 172.21.15.100:0/114941832 wait complete. 2024-01-22T05:39:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:39:19.249 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:39:19.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.403+0000 7fc8d4000700 1 Processor -- start 2024-01-22T05:39:19.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.404+0000 7fc8d4000700 1 -- start start 2024-01-22T05:39:19.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.405+0000 7fc8d4000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc151b10 0x7fc8cc151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:19.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.405+0000 7fc8d4000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc8cc0c73c0 0x7fc8cc1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:19.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.405+0000 7fc8d4000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc154f10 con 0x7fc8cc0630a0 2024-01-22T05:39:19.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.405+0000 7fc8d4000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc063510 con 0x7fc8cc0c73c0 2024-01-22T05:39:19.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.405+0000 7fc8d4000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc063a70 con 0x7fc8cc151b10 2024-01-22T05:39:19.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc151b10 0x7fc8cc151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d0c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc8cc0c73c0 0x7fc8cc1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc151b10 0x7fc8cc151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:56230/0 (socket says 172.21.15.100:56230) 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 -- 172.21.15.100:0/2443036507 learned_addr learned my addr 172.21.15.100:0/2443036507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d2000700 1 --1- 172.21.15.100:0/2443036507 >> v1:172.21.15.169:6789/0 conn(0x7fc8cc0630a0 0x7fc8cc0a9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:57646/0 (socket says 172.21.15.100:57646) 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 -- 172.21.15.100:0/2443036507 >> v2:172.21.15.169:3300/0 conn(0x7fc8cc0c73c0 msgr2=0x7fc8cc1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 --2- 172.21.15.100:0/2443036507 >> v2:172.21.15.169:3300/0 conn(0x7fc8cc0c73c0 0x7fc8cc1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 -- 172.21.15.100:0/2443036507 >> v1:172.21.15.169:6789/0 conn(0x7fc8cc0630a0 legacy=0x7fc8cc0a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 -- 172.21.15.100:0/2443036507 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc063790 con 0x7fc8cc151b10 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d0c00700 1 --2- 172.21.15.100:0/2443036507 >> v2:172.21.15.169:3300/0 conn(0x7fc8cc0c73c0 0x7fc8cc1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.406+0000 7fc8d1600700 1 --2- 172.21.15.100:0/2443036507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc151b10 0x7fc8cc151ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc8bc006fd0 tx=0x7fc8bc0090f0).ready entity=mon.2 client_cookie=867c2443e6739d26 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8cbe00700 1 -- 172.21.15.100:0/2443036507 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00b580 con 0x7fc8cc151b10 2024-01-22T05:39:19.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8cbe00700 1 -- 172.21.15.100:0/2443036507 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc00b6e0 con 0x7fc8cc151b10 2024-01-22T05:39:19.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8cbe00700 1 -- 172.21.15.100:0/2443036507 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00ba60 con 0x7fc8cc151b10 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 -- 172.21.15.100:0/2443036507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc151b10 msgr2=0x7fc8cc151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 --2- 172.21.15.100:0/2443036507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc151b10 0x7fc8cc151ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc8bc006fd0 tx=0x7fc8bc0090f0).stop 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 -- 172.21.15.100:0/2443036507 shutdown_connections 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 --2- 172.21.15.100:0/2443036507 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc151b10 0x7fc8cc151ef0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 --2- 172.21.15.100:0/2443036507 >> v2:172.21.15.169:3300/0 conn(0x7fc8cc0c73c0 0x7fc8cc1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 -- 172.21.15.100:0/2443036507 >> 172.21.15.100:0/2443036507 conn(0x7fc8cc06a970 msgr2=0x7fc8cc0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 -- 172.21.15.100:0/2443036507 shutdown_connections 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.407+0000 7fc8d4000700 1 -- 172.21.15.100:0/2443036507 wait complete. 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.409+0000 7fc8d4000700 1 Processor -- start 2024-01-22T05:39:19.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.409+0000 7fc8d4000700 1 -- start start 2024-01-22T05:39:19.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d4000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc0630a0 0x7fc8cc1651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:19.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d4000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc0c73c0 0x7fc8cc1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:19.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d4000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8cc151b10 0x7fc8cc0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:19.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d4000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0c2e70 con 0x7fc8cc0630a0 2024-01-22T05:39:19.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d4000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0b0430 con 0x7fc8cc151b10 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d4000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc1656c0 con 0x7fc8cc0c73c0 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d1600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc0630a0 0x7fc8cc1651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d1600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc0630a0 0x7fc8cc1651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58604/0 (socket says 172.21.15.100:58604) 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d1600700 1 -- 172.21.15.100:0/918025730 learned_addr learned my addr 172.21.15.100:0/918025730 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d1600700 1 -- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc0c73c0 msgr2=0x7fc8cc1439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d2000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8cc151b10 0x7fc8cc0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.410+0000 7fc8d0c00700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc0c73c0 0x7fc8cc1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d1600700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc0c73c0 0x7fc8cc1439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d1600700 1 -- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8cc151b10 msgr2=0x7fc8cc0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d1600700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8cc151b10 0x7fc8cc0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d1600700 1 -- 172.21.15.100:0/918025730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b40092a0 con 0x7fc8cc0630a0 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d2000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8cc151b10 0x7fc8cc0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:19.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d0c00700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc0c73c0 0x7fc8cc1439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:19.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d1600700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc0630a0 0x7fc8cc1651d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fc8cc063bb0 tx=0x7fc8bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:19.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8c8c00700 1 -- 172.21.15.100:0/918025730 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00b850 con 0x7fc8cc0630a0 2024-01-22T05:39:19.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8c8c00700 1 -- 172.21.15.100:0/918025730 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc00b9b0 con 0x7fc8cc0630a0 2024-01-22T05:39:19.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc009370 con 0x7fc8cc0630a0 2024-01-22T05:39:19.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8c8c00700 1 -- 172.21.15.100:0/918025730 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc01c670 con 0x7fc8cc0630a0 2024-01-22T05:39:19.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.411+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc0c2540 con 0x7fc8cc0630a0 2024-01-22T05:39:19.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.412+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc0475e0 con 0x7fc8cc0630a0 2024-01-22T05:39:19.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.413+0000 7fc8c8c00700 1 -- 172.21.15.100:0/918025730 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc8bc01ca20 con 0x7fc8cc0630a0 2024-01-22T05:39:19.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.414+0000 7fc8c8c00700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc8a405f150 0x7fc8a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:19.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.414+0000 7fc8c8c00700 1 -- 172.21.15.100:0/918025730 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fc8bc07bf60 con 0x7fc8cc0630a0 2024-01-22T05:39:19.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.414+0000 7fc8d0c00700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc8a405f150 0x7fc8a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:19.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.415+0000 7fc8d0c00700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc8a405f150 0x7fc8a4061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fc8b4009270 tx=0x7fc8b4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:19.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.418+0000 7fc8c8c00700 1 -- 172.21.15.100:0/918025730 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc8bc04d150 con 0x7fc8cc0630a0 2024-01-22T05:39:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.631+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8cc1548c0 con 0x7fc8cc0630a0 2024-01-22T05:39:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.631+0000 7fc8c8c00700 1 -- 172.21.15.100:0/918025730 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+82 (secure 0 0 0) 0x7fc8bc050770 con 0x7fc8cc0630a0 2024-01-22T05:39:19.632 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc8a405f150 msgr2=0x7fc8a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc8a405f150 0x7fc8a4061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fc8b4009270 tx=0x7fc8b4008040).stop 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc0630a0 msgr2=0x7fc8cc1651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc0630a0 0x7fc8cc1651d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fc8cc063bb0 tx=0x7fc8bc017000).stop 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 shutdown_connections 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc8a405f150 0x7fc8a4061610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8cc151b10 0x7fc8cc0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc0630a0 0x7fc8cc1651d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 --2- 172.21.15.100:0/918025730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8cc0c73c0 0x7fc8cc1439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 >> 172.21.15.100:0/918025730 conn(0x7fc8cc06a970 msgr2=0x7fc8cc0cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:19.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 shutdown_connections 2024-01-22T05:39:19.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:19.634+0000 7fc8d4000700 1 -- 172.21.15.100:0/918025730 wait complete. 2024-01-22T05:39:19.648 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:39:19.649 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:19.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:19.649 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:19.695 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40831sec preferred_lft 40831sec 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f05d:9bff:feba:b90d/64 scope link 2024-01-22T05:39:19.696 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::1c0c:7cff:fe73:80ca/64 scope link 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether e6:39:c6:eb:cb:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::e439:c6ff:feeb:cbd7/64 scope link 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:19.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:19.697 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:39:19.799 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:39:19.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:19.802 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:39:19.849 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:39:19.849 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:39:19.849 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:39:19.849 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:39:19.849 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:39:19.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:19.849 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:39:19.850 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:39:19.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:39:19.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:39:19.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:39:19.850 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:39:20.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:20.009 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:39:20.054 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:39:20.054 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:39:20.054 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:20.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:20.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-22T05:39:20.161 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-22T05:39:20.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:20.161 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:20.205 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:20.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:20.313 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:20.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:20.378 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:20.380 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:20.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:20.381 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:20.425 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:39:20.425 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:20.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:20.535 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:20.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:20.600 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:20.602 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:20.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:20.602 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:20.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-01-22T05:39:20.621+0000 7fa3922e93c0 -1 init, newargv = 0x5598bcaf7ef0 newargc=15 2024-01-22T05:39:20.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[84641]: starting ceph client 2024-01-22T05:39:20.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[84641]: starting fuse 2024-01-22T05:39:20.650 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:39:20.650 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-22T05:39:20.650 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:39:20.651 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-01-22T05:39:20.652 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:39:20.830 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.84641.asok 2024-01-22T05:39:21.008 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.84641.asok 2024-01-22T05:39:21.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:21.009 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.84641.asok status 2024-01-22T05:39:21.226 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:39:21.226 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:39:21.226 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:39:21.226 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:39:21.227 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-01-22T05:39:21.227 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:39:21.227 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-22T05:39:21.227 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "84641", 2024-01-22T05:39:21.227 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:39:21.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:21.228 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:39:21.228 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:39:21.228 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5208, 2024-01-22T05:39:21.228 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:39:21.228 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:39:21.228 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:39:21.229 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5208 2024-01-22T05:39:21.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:21.229 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:39:21.229 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:39:21.229 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:39:21.229 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 736349404 2024-01-22T05:39:21.230 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:21.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:21.230 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:39:21.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:39:21.230 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:39:21.230 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 736349404 2024-01-22T05:39:21.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:21.231 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5208 192.168.0.1:0/736349404", 2024-01-22T05:39:21.231 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/736349404", 2024-01-22T05:39:21.231 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:39:21.231 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 15, 2024-01-22T05:39:21.231 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 39, 2024-01-22T05:39:21.231 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:39:21.232 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:39:21.232 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:39:21.232 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:39:21.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:21.239 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:39:21.239 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:21.284 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:39:21.285 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:21.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:21.285 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:21.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:21.391 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-01-22T05:39:21.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:21.439 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-01-22T05:39:21.490 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:39:21.490 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:39:21.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:21.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[84641]: fuse finished with error 0 and tester_r 0 2024-01-22T05:39:21.557 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:39:21.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:39:21.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:21.611 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:39:21.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-01-22T05:39:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.885+0000 7f6fc5a00700 1 Processor -- start 2024-01-22T05:39:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.885+0000 7f6fc5a00700 1 -- start start 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fc5a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6fc00688f0 0x7f6fc00c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fc5a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6fc0138820 0x7f6fc00c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fc5a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc0064520 con 0x7f6fc0138440 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fc5a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc0064e30 con 0x7f6fc00688f0 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fc5a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc00c5e50 con 0x7f6fc0138820 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fb7e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6fc00688f0 0x7f6fc00c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fbea00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6fc0138440 0x7f6fc00681e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57826/0 (socket says 172.21.15.100:57826) 2024-01-22T05:39:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.886+0000 7f6fbea00700 1 -- 172.21.15.100:0/4142110932 learned_addr learned my addr 172.21.15.100:0/4142110932 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fbf400700 1 --2- 172.21.15.100:0/4142110932 >> v2:172.21.15.169:3300/0 conn(0x7f6fc0138820 0x7f6fc00c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fb7e00700 1 -- 172.21.15.100:0/4142110932 >> v2:172.21.15.169:3300/0 conn(0x7f6fc0138820 msgr2=0x7f6fc00c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fb7e00700 1 --2- 172.21.15.100:0/4142110932 >> v2:172.21.15.169:3300/0 conn(0x7f6fc0138820 0x7f6fc00c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fb7e00700 1 -- 172.21.15.100:0/4142110932 >> v1:172.21.15.100:6789/0 conn(0x7f6fc0138440 legacy=0x7f6fc00681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fb7e00700 1 -- 172.21.15.100:0/4142110932 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0064770 con 0x7f6fc00688f0 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fbe000700 1 -- 172.21.15.100:0/4142110932 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931074075 0 0) 0x7f6fc0064520 con 0x7f6fc0138440 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fb7e00700 1 --2- 172.21.15.100:0/4142110932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc00688f0 0x7f6fc00c5120 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f6fc00a96b0 tx=0x7f6fa8009060).ready entity=mon.0 client_cookie=fa9b59ec6fefd70f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fbe000700 1 -- 172.21.15.100:0/4142110932 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80090d0 con 0x7f6fc00688f0 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fbe000700 1 -- 172.21.15.100:0/4142110932 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa800b580 con 0x7f6fc00688f0 2024-01-22T05:39:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.887+0000 7f6fbe000700 1 -- 172.21.15.100:0/4142110932 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800b900 con 0x7f6fc00688f0 2024-01-22T05:39:21.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 -- 172.21.15.100:0/4142110932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc00688f0 msgr2=0x7f6fc00c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:21.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/4142110932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc00688f0 0x7f6fc00c5120 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f6fc00a96b0 tx=0x7f6fa8009060).stop 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 -- 172.21.15.100:0/4142110932 shutdown_connections 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/4142110932 >> v2:172.21.15.169:3300/0 conn(0x7f6fc0138820 0x7f6fc00c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/4142110932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc00688f0 0x7f6fc00c5120 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 -- 172.21.15.100:0/4142110932 >> 172.21.15.100:0/4142110932 conn(0x7f6fc00630c0 msgr2=0x7f6fc00c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 -- 172.21.15.100:0/4142110932 shutdown_connections 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.888+0000 7f6fc5a00700 1 -- 172.21.15.100:0/4142110932 wait complete. 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.889+0000 7f6fc5a00700 1 Processor -- start 2024-01-22T05:39:21.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.890+0000 7f6fc5a00700 1 -- start start 2024-01-22T05:39:21.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fc5a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6fc00688f0 0x7f6fc014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:21.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fc5a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc0138440 0x7f6fc00bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:21.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fc5a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc0138820 0x7f6fc014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:21.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fc5a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00a6380 con 0x7f6fc0138440 2024-01-22T05:39:21.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fc5a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00bc130 con 0x7f6fc0138820 2024-01-22T05:39:21.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fc5a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00bc410 con 0x7f6fc00688f0 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc0138440 0x7f6fc00bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc0138440 0x7f6fc00bb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58622/0 (socket says 172.21.15.100:58622) 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 -- 172.21.15.100:0/2163266664 learned_addr learned my addr 172.21.15.100:0/2163266664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fbea00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6fc00688f0 0x7f6fc014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fbf400700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc0138820 0x7f6fc014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 -- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6fc00688f0 msgr2=0x7f6fc014f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6fc00688f0 0x7f6fc014f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 -- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc0138820 msgr2=0x7f6fc014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc0138820 0x7f6fc014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 -- 172.21.15.100:0/2163266664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80092a0 con 0x7f6fc0138440 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fbf400700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc0138820 0x7f6fc014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.891+0000 7f6fb7e00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc0138440 0x7f6fc00bb8e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f6fa8009fd0 tx=0x7f6fa8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.892+0000 7f6fb6000700 1 -- 172.21.15.100:0/2163266664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800b900 con 0x7f6fc0138440 2024-01-22T05:39:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.892+0000 7f6fb6000700 1 -- 172.21.15.100:0/2163266664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa800bcc0 con 0x7f6fc0138440 2024-01-22T05:39:21.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.892+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc00bc6f0 con 0x7f6fc0138440 2024-01-22T05:39:21.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.892+0000 7f6fb6000700 1 -- 172.21.15.100:0/2163266664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa801b410 con 0x7f6fc0138440 2024-01-22T05:39:21.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.892+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc00bbdd0 con 0x7f6fc0138440 2024-01-22T05:39:21.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.893+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc005fdb0 con 0x7f6fc0138440 2024-01-22T05:39:21.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.894+0000 7f6fb6000700 1 -- 172.21.15.100:0/2163266664 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6fa801b840 con 0x7f6fc0138440 2024-01-22T05:39:21.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.895+0000 7f6fb6000700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6f9805f150 0x7f6f98061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:21.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.895+0000 7f6fb6000700 1 -- 172.21.15.100:0/2163266664 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f6fa807be70 con 0x7f6fc0138440 2024-01-22T05:39:21.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.895+0000 7f6fbea00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6f9805f150 0x7f6f98061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:21.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.896+0000 7f6fbea00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6f9805f150 0x7f6f98061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f6fb00011e0 tx=0x7f6fb0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:21.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:21.900+0000 7f6fb6000700 1 -- 172.21.15.100:0/2163266664 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6fa804cfb0 con 0x7f6fc0138440 2024-01-22T05:39:22.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.136+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6fc0064a50 con 0x7f6fc0138440 2024-01-22T05:39:22.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.141+0000 7f6fb6000700 1 -- 172.21.15.100:0/2163266664 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6fa80505d0 con 0x7f6fc0138440 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6f9805f150 msgr2=0x7f6f98061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6f9805f150 0x7f6f98061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f6fb00011e0 tx=0x7f6fb0009040).stop 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc0138440 msgr2=0x7f6fc00bb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc0138440 0x7f6fc00bb8e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f6fa8009fd0 tx=0x7f6fa8017000).stop 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 shutdown_connections 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6f9805f150 0x7f6f98061610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fc0138820 0x7f6fc014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6fc00688f0 0x7f6fc014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 --2- 172.21.15.100:0/2163266664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fc0138440 0x7f6fc00bb8e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 >> 172.21.15.100:0/2163266664 conn(0x7f6fc00630c0 msgr2=0x7f6fc0137600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:22.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 shutdown_connections 2024-01-22T05:39:22.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.143+0000 7f6fc5a00700 1 -- 172.21.15.100:0/2163266664 wait complete. 2024-01-22T05:39:22.144 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:39:22.160 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:39:22.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:39:22.243 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:39:22.337 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:39:22.337 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:39:22.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:22.338 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:39:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-22T05:39:22.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:39:22.384 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:39:22.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:22.384 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-22T05:39:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-01-22T05:39:22.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:39:22.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:39:22.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:22.431 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-22T05:39:22.475 INFO:teuthology.orchestra.run.smithi100.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-01-22T05:39:22.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:39:22.476 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:39:22.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:22.476 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-22T05:39:22.520 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-01-22T05:39:22.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:39:22.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:22.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.705+0000 7f76d9200700 1 Processor -- start 2024-01-22T05:39:22.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.705+0000 7f76d9200700 1 -- start start 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d9200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d4154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d9200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76d40c64b0 0x7f76d40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d9200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d40c1530 con 0x7f76d40aa3f0 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d9200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d40cbb60 con 0x7f76d40c64b0 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d9200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40cb880 con 0x7f76d4154060 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d2800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76d40c64b0 0x7f76d40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d1400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f76d40aa3f0 0x7f76d40c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57840/0 (socket says 172.21.15.100:57840) 2024-01-22T05:39:22.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d1400700 1 -- 172.21.15.100:0/401630348 learned_addr learned my addr 172.21.15.100:0/401630348 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:22.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.707+0000 7f76d1e00700 1 --2- 172.21.15.100:0/401630348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d2800700 1 -- 172.21.15.100:0/401630348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 msgr2=0x7f76d4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d2800700 1 --2- 172.21.15.100:0/401630348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d2800700 1 -- 172.21.15.100:0/401630348 >> v1:172.21.15.100:6789/0 conn(0x7f76d40aa3f0 legacy=0x7f76d40c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d2800700 1 -- 172.21.15.100:0/401630348 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40c17d0 con 0x7f76d40c64b0 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d2800700 1 --2- 172.21.15.100:0/401630348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d40c9950 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f76cc009e60 tx=0x7f76cc009780).ready entity=mon.0 client_cookie=daccec1f9c14122d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d0a00700 1 -- 172.21.15.100:0/401630348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00e070 con 0x7f76d40c64b0 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d0a00700 1 -- 172.21.15.100:0/401630348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc00bb60 con 0x7f76d40c64b0 2024-01-22T05:39:22.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d0a00700 1 -- 172.21.15.100:0/401630348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc012410 con 0x7f76d40c64b0 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d9200700 1 -- 172.21.15.100:0/401630348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 msgr2=0x7f76d40c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.708+0000 7f76d9200700 1 --2- 172.21.15.100:0/401630348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d40c9950 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f76cc009e60 tx=0x7f76cc009780).stop 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.709+0000 7f76d9200700 1 -- 172.21.15.100:0/401630348 shutdown_connections 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.709+0000 7f76d9200700 1 --2- 172.21.15.100:0/401630348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d40c9950 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.709+0000 7f76d9200700 1 --2- 172.21.15.100:0/401630348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.709+0000 7f76d9200700 1 -- 172.21.15.100:0/401630348 >> 172.21.15.100:0/401630348 conn(0x7f76d405e9d0 msgr2=0x7f76d40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.709+0000 7f76d9200700 1 -- 172.21.15.100:0/401630348 shutdown_connections 2024-01-22T05:39:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.709+0000 7f76d9200700 1 -- 172.21.15.100:0/401630348 wait complete. 2024-01-22T05:39:22.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.710+0000 7f76d9200700 1 Processor -- start 2024-01-22T05:39:22.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.710+0000 7f76d9200700 1 -- start start 2024-01-22T05:39:22.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d9200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d40aa3f0 0x7f76d40c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:22.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d9200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d9200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d40af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d9200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40c4790 con 0x7f76d40c64b0 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d9200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40c44b0 con 0x7f76d40aa3f0 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d9200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40c29f0 con 0x7f76d4154060 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d1400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d1400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d414fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58640/0 (socket says 172.21.15.100:58640) 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.711+0000 7f76d1400700 1 -- 172.21.15.100:0/2083513096 learned_addr learned my addr 172.21.15.100:0/2083513096 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d2800700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d40af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d1e00700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d40aa3f0 0x7f76d40c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d1400700 1 -- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 msgr2=0x7f76d40af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d1400700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d40af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d1400700 1 -- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d40aa3f0 msgr2=0x7f76d40c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d1400700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d40aa3f0 0x7f76d40c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d1400700 1 -- 172.21.15.100:0/2083513096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc009a20 con 0x7f76d40c64b0 2024-01-22T05:39:22.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d1400700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d414fe60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f76bc00c440 tx=0x7f76bc007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:22.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76c9600700 1 -- 172.21.15.100:0/2083513096 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0070d0 con 0x7f76d40c64b0 2024-01-22T05:39:22.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76c9600700 1 -- 172.21.15.100:0/2083513096 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc007230 con 0x7f76d40c64b0 2024-01-22T05:39:22.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76c9600700 1 -- 172.21.15.100:0/2083513096 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0075b0 con 0x7f76d40c64b0 2024-01-22T05:39:22.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d40c2cd0 con 0x7f76d40c64b0 2024-01-22T05:39:22.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.712+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d4150350 con 0x7f76d40c64b0 2024-01-22T05:39:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.713+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d40c31f0 con 0x7f76d40c64b0 2024-01-22T05:39:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.714+0000 7f76c9600700 1 -- 172.21.15.100:0/2083513096 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f76bc0059b0 con 0x7f76d40c64b0 2024-01-22T05:39:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.715+0000 7f76c9600700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76ac05f150 0x7f76ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.715+0000 7f76c9600700 1 -- 172.21.15.100:0/2083513096 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f76bc079900 con 0x7f76d40c64b0 2024-01-22T05:39:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.715+0000 7f76d1e00700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76ac05f150 0x7f76ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.716+0000 7f76d1e00700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76ac05f150 0x7f76ac061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f76c4009b90 tx=0x7f76c4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:22.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.719+0000 7f76c9600700 1 -- 172.21.15.100:0/2083513096 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f76d40c31f0 con 0x7f76d40c64b0 2024-01-22T05:39:22.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.934+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76d40c31f0 con 0x7f76d40c64b0 2024-01-22T05:39:22.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.935+0000 7f76c9600700 1 -- 172.21.15.100:0/2083513096 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f76d40c31f0 con 0x7f76d40c64b0 2024-01-22T05:39:22.935 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:22.935 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:38:58.799067+0000","modified":"2024-01-22T05:39:08.646529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6834/2612830615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2612830615},{"type":"v1","addr":"172.21.15.169:6834","nonce":2612830615}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:39:22.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76ac05f150 msgr2=0x7f76ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76ac05f150 0x7f76ac061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f76c4009b90 tx=0x7f76c4009060).stop 2024-01-22T05:39:22.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 msgr2=0x7f76d414fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d414fe60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f76bc00c440 tx=0x7f76bc007d60).stop 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 shutdown_connections 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f76ac05f150 0x7f76ac061610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d40aa3f0 0x7f76d40c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76d4154060 0x7f76d40af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 --2- 172.21.15.100:0/2083513096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40c64b0 0x7f76d414fe60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 >> 172.21.15.100:0/2083513096 conn(0x7f76d405e9d0 msgr2=0x7f76d4150810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 shutdown_connections 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:22.937+0000 7f76d9200700 1 -- 172.21.15.100:0/2083513096 wait complete. 2024-01-22T05:39:22.938 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 15 2024-01-22T05:39:22.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:23.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.138+0000 7fab80a00700 1 Processor -- start 2024-01-22T05:39:23.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.138+0000 7fab80a00700 1 -- start start 2024-01-22T05:39:23.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.139+0000 7fab80a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab78154060 0x7fab78154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.139+0000 7fab80a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780c1530 con 0x7fab780c64b0 2024-01-22T05:39:23.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.139+0000 7fab80a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780cb880 con 0x7fab780aa3f0 2024-01-22T05:39:23.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.139+0000 7fab80a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab780cbb60 con 0x7fab78154060 2024-01-22T05:39:23.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.139+0000 7fab7e000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab78154060 0x7fab78154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7ea00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fab780c64b0 0x7fab780c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43608/0 (socket says 172.21.15.100:43608) 2024-01-22T05:39:23.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7ea00700 1 -- 172.21.15.100:0/3208280324 learned_addr learned my addr 172.21.15.100:0/3208280324 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7e000700 1 -- 172.21.15.100:0/3208280324 >> v1:172.21.15.169:6789/0 conn(0x7fab780aa3f0 legacy=0x7fab780c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7e000700 1 -- 172.21.15.100:0/3208280324 >> v1:172.21.15.100:6789/0 conn(0x7fab780c64b0 legacy=0x7fab780c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7e000700 1 -- 172.21.15.100:0/3208280324 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab780c17d0 con 0x7fab78154060 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7e000700 1 --2- 172.21.15.100:0/3208280324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab78154060 0x7fab78154440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fab68009760 tx=0x7fab68009060).ready entity=mon.0 client_cookie=6c9dc0291ef03e82 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7cc00700 1 -- 172.21.15.100:0/3208280324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800b580 con 0x7fab78154060 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7cc00700 1 -- 172.21.15.100:0/3208280324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6800b6e0 con 0x7fab78154060 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.140+0000 7fab7cc00700 1 -- 172.21.15.100:0/3208280324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800ba60 con 0x7fab78154060 2024-01-22T05:39:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.141+0000 7fab80a00700 1 -- 172.21.15.100:0/3208280324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab78154060 msgr2=0x7fab78154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.141+0000 7fab80a00700 1 --2- 172.21.15.100:0/3208280324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab78154060 0x7fab78154440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fab68009760 tx=0x7fab68009060).stop 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.141+0000 7fab80a00700 1 -- 172.21.15.100:0/3208280324 shutdown_connections 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.141+0000 7fab80a00700 1 --2- 172.21.15.100:0/3208280324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab78154060 0x7fab78154440 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.141+0000 7fab80a00700 1 -- 172.21.15.100:0/3208280324 >> 172.21.15.100:0/3208280324 conn(0x7fab7805e9d0 msgr2=0x7fab780cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.141+0000 7fab80a00700 1 -- 172.21.15.100:0/3208280324 shutdown_connections 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.141+0000 7fab80a00700 1 -- 172.21.15.100:0/3208280324 wait complete. 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.142+0000 7fab80a00700 1 Processor -- start 2024-01-22T05:39:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.143+0000 7fab80a00700 1 -- start start 2024-01-22T05:39:23.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.143+0000 7fab80a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab780aa3f0 0x7fab78144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.143+0000 7fab80a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab780c64b0 0x7fab780aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.143+0000 7fab80a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab78154060 0x7fab7814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab80a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7814c450 con 0x7fab780aa3f0 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab80a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780b0940 con 0x7fab780c64b0 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab80a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7814be00 con 0x7fab78154060 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab780aa3f0 0x7fab78144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab780aa3f0 0x7fab78144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42814/0 (socket says 172.21.15.100:42814) 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 -- 172.21.15.100:0/755811964 learned_addr learned my addr 172.21.15.100:0/755811964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7ea00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab78154060 0x7fab7814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7d600700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab780c64b0 0x7fab780aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 -- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab78154060 msgr2=0x7fab7814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab78154060 0x7fab7814f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 -- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab780c64b0 msgr2=0x7fab780aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab780c64b0 0x7fab780aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 -- 172.21.15.100:0/755811964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab680092a0 con 0x7fab780aa3f0 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7ea00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab78154060 0x7fab7814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab7e000700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab780aa3f0 0x7fab78144b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fab68009eb0 tx=0x7fab68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.144+0000 7fab75600700 1 -- 172.21.15.100:0/755811964 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800ba60 con 0x7fab780aa3f0 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.145+0000 7fab75600700 1 -- 172.21.15.100:0/755811964 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6801b440 con 0x7fab780aa3f0 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.145+0000 7fab75600700 1 -- 172.21.15.100:0/755811964 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6801b7c0 con 0x7fab780aa3f0 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.145+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7814c0e0 con 0x7fab780aa3f0 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.145+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab78064860 con 0x7fab780aa3f0 2024-01-22T05:39:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.146+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7814bc60 con 0x7fab780aa3f0 2024-01-22T05:39:23.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.147+0000 7fab75600700 1 -- 172.21.15.100:0/755811964 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fab6801bb70 con 0x7fab780aa3f0 2024-01-22T05:39:23.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.147+0000 7fab75600700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fab5005f180 0x7fab50061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.147+0000 7fab75600700 1 -- 172.21.15.100:0/755811964 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fab6807bb60 con 0x7fab780aa3f0 2024-01-22T05:39:23.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.148+0000 7fab7d600700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fab5005f180 0x7fab50061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.148+0000 7fab7d600700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fab5005f180 0x7fab50061640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fab780adae0 tx=0x7fab60009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.152+0000 7fab75600700 1 -- 172.21.15.100:0/755811964 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fab7814bc60 con 0x7fab780aa3f0 2024-01-22T05:39:23.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.328+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab7814bc60 con 0x7fab780aa3f0 2024-01-22T05:39:23.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.329+0000 7fab75600700 1 -- 172.21.15.100:0/755811964 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18535 (secure 0 0 0) 0x7fab7814bc60 con 0x7fab780aa3f0 2024-01-22T05:39:23.329 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:23.329 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:09.648970+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:38:56.791674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-22T05:38:57.778340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-22T05:39:07.671856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:23.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fab5005f180 msgr2=0x7fab50061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fab5005f180 0x7fab50061640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fab780adae0 tx=0x7fab60009040).stop 2024-01-22T05:39:23.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab780aa3f0 msgr2=0x7fab78144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab780aa3f0 0x7fab78144b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fab68009eb0 tx=0x7fab68017000).stop 2024-01-22T05:39:23.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 shutdown_connections 2024-01-22T05:39:23.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fab5005f180 0x7fab50061640 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab78154060 0x7fab7814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab780aa3f0 0x7fab78144b80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 --2- 172.21.15.100:0/755811964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab780c64b0 0x7fab780aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 >> 172.21.15.100:0/755811964 conn(0x7fab7805e9d0 msgr2=0x7fab780a7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:23.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 shutdown_connections 2024-01-22T05:39:23.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.331+0000 7fab80a00700 1 -- 172.21.15.100:0/755811964 wait complete. 2024-01-22T05:39:23.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:38:56.791674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:38:57.778340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-22T05:39:07.671856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:39:23.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:39:23.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.535+0000 7fdadac00700 1 Processor -- start 2024-01-22T05:39:23.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.536+0000 7fdadac00700 1 -- start start 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdadac00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdad40c5340 0x7fdad4064c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdadac00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c6c00 0x7fdad40c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdadac00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdad40c5720 0x7fdad40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdadac00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40c7060 con 0x7fdad40c5720 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdadac00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40c2760 con 0x7fdad40c5340 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdadac00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40c6820 con 0x7fdad40c6c00 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdad8c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdad40c5720 0x7fdad40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdad8c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdad40c5720 0x7fdad40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42816/0 (socket says 172.21.15.100:42816) 2024-01-22T05:39:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdad8c00700 1 -- 172.21.15.100:0/948640767 learned_addr learned my addr 172.21.15.100:0/948640767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdad3e00700 1 --2- 172.21.15.100:0/948640767 >> v2:172.21.15.169:3300/0 conn(0x7fdad40c5340 0x7fdad4064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.537+0000 7fdad3400700 1 --2- 172.21.15.100:0/948640767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c6c00 0x7fdad40c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad8c00700 1 -- 172.21.15.100:0/948640767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c6c00 msgr2=0x7fdad40c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad8c00700 1 --2- 172.21.15.100:0/948640767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c6c00 0x7fdad40c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad8c00700 1 -- 172.21.15.100:0/948640767 >> v2:172.21.15.169:3300/0 conn(0x7fdad40c5340 msgr2=0x7fdad4064c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad8c00700 1 --2- 172.21.15.100:0/948640767 >> v2:172.21.15.169:3300/0 conn(0x7fdad40c5340 0x7fdad4064c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad8c00700 1 -- 172.21.15.100:0/948640767 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40c64d0 con 0x7fdad40c5720 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad8c00700 1 --2- 172.21.15.100:0/948640767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40c5bb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fdad4064170 tx=0x7fdacc009840).ready entity=mon.0 client_cookie=914042f1ded7907d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad2a00700 1 -- 172.21.15.100:0/948640767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00e070 con 0x7fdad40c5720 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad2a00700 1 -- 172.21.15.100:0/948640767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00b970 con 0x7fdad40c5720 2024-01-22T05:39:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdad2a00700 1 -- 172.21.15.100:0/948640767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00bcf0 con 0x7fdad40c5720 2024-01-22T05:39:23.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdadac00700 1 -- 172.21.15.100:0/948640767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 msgr2=0x7fdad40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.538+0000 7fdadac00700 1 --2- 172.21.15.100:0/948640767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40c5bb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fdad4064170 tx=0x7fdacc009840).stop 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.539+0000 7fdadac00700 1 -- 172.21.15.100:0/948640767 shutdown_connections 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.539+0000 7fdadac00700 1 --2- 172.21.15.100:0/948640767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40c5bb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.539+0000 7fdadac00700 1 --2- 172.21.15.100:0/948640767 >> v2:172.21.15.169:3300/0 conn(0x7fdad40c5340 0x7fdad4064c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.539+0000 7fdadac00700 1 --2- 172.21.15.100:0/948640767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c6c00 0x7fdad40c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.539+0000 7fdadac00700 1 -- 172.21.15.100:0/948640767 >> 172.21.15.100:0/948640767 conn(0x7fdad40c3ca0 msgr2=0x7fdad40c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.539+0000 7fdadac00700 1 -- 172.21.15.100:0/948640767 shutdown_connections 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.539+0000 7fdadac00700 1 -- 172.21.15.100:0/948640767 wait complete. 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.540+0000 7fdadac00700 1 Processor -- start 2024-01-22T05:39:23.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.540+0000 7fdadac00700 1 -- start start 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdadac00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c5340 0x7fdad4143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdadac00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdadac00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad40c6c00 0x7fdad4068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdadac00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40a7ae0 con 0x7fdad40c5720 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdadac00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4144240 con 0x7fdad40c6c00 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdadac00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40a6ed0 con 0x7fdad40c5340 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdad3400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdad3400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42828/0 (socket says 172.21.15.100:42828) 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.541+0000 7fdad3400700 1 -- 172.21.15.100:0/4000217675 learned_addr learned my addr 172.21.15.100:0/4000217675 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:23.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad8c00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad40c6c00 0x7fdad4068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad3e00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c5340 0x7fdad4143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad3400700 1 -- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c5340 msgr2=0x7fdad4143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad3400700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c5340 0x7fdad4143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad3400700 1 -- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad40c6c00 msgr2=0x7fdad4068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad3400700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad40c6c00 0x7fdad4068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad3400700 1 -- 172.21.15.100:0/4000217675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009ae0 con 0x7fdad40c5720 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdad3400700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40abfc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fdabc00e930 tx=0x7fdabc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdacb400700 1 -- 172.21.15.100:0/4000217675 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc009390 con 0x7fdad40c5720 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdacb400700 1 -- 172.21.15.100:0/4000217675 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00c640 con 0x7fdad40c5720 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdacb400700 1 -- 172.21.15.100:0/4000217675 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00c9c0 con 0x7fdad40c5720 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad40a71b0 con 0x7fdad40c5720 2024-01-22T05:39:23.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.542+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40a7770 con 0x7fdad40c5720 2024-01-22T05:39:23.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.544+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad405fdb0 con 0x7fdad40c5720 2024-01-22T05:39:23.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.544+0000 7fdacb400700 1 -- 172.21.15.100:0/4000217675 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdabc01b400 con 0x7fdad40c5720 2024-01-22T05:39:23.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.545+0000 7fdacb400700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.545+0000 7fdacb400700 1 -- 172.21.15.100:0/4000217675 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fdabc07a7b0 con 0x7fdad40c5720 2024-01-22T05:39:23.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.545+0000 7fdad3e00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.546+0000 7fdad3e00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdaac05f150 0x7fdaac061610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fdad4156df0 tx=0x7fdac4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.549+0000 7fdacb400700 1 -- 172.21.15.100:0/4000217675 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdabc04b7d0 con 0x7fdad40c5720 2024-01-22T05:39:23.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.720+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdad4066090 con 0x7fdad40c5720 2024-01-22T05:39:23.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.720+0000 7fdacb400700 1 -- 172.21.15.100:0/4000217675 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v39) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdabc04edf0 con 0x7fdad40c5720 2024-01-22T05:39:23.720 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:39:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdaac05f150 msgr2=0x7fdaac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdaac05f150 0x7fdaac061610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fdad4156df0 tx=0x7fdac4008040).stop 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 msgr2=0x7fdad40abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40abfc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fdabc00e930 tx=0x7fdabc009060).stop 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 shutdown_connections 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdad40c6c00 0x7fdad4068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdad40c5340 0x7fdad4143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 --2- 172.21.15.100:0/4000217675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdad40c5720 0x7fdad40abfc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 >> 172.21.15.100:0/4000217675 conn(0x7fdad40c3ca0 msgr2=0x7fdad40a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 shutdown_connections 2024-01-22T05:39:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.722+0000 7fdadac00700 1 -- 172.21.15.100:0/4000217675 wait complete. 2024-01-22T05:39:23.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:39:23.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.925+0000 7f874d200700 1 Processor -- start 2024-01-22T05:39:23.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.925+0000 7f874d200700 1 -- start start 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.926+0000 7f874d200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8748154260 0x7f87480cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.926+0000 7f874d200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f87480c5c80 0x7f87480c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.926+0000 7f874d200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87480c65f0 0x7f8748157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.926+0000 7f874d200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87480c1a40 con 0x7f8748154260 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f874d200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87480cbd30 con 0x7f87480c5c80 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f874d200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480c6a80 con 0x7f87480c65f0 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8748154260 0x7f87480cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8748154260 0x7f87480cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42834/0 (socket says 172.21.15.100:42834) 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 -- 172.21.15.100:0/3926870827 learned_addr learned my addr 172.21.15.100:0/3926870827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8746800700 1 --2- 172.21.15.100:0/3926870827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87480c65f0 0x7f8748157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745400700 1 --2- 172.21.15.100:0/3926870827 >> v2:172.21.15.169:3300/0 conn(0x7f87480c5c80 0x7f87480c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 -- 172.21.15.100:0/3926870827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87480c65f0 msgr2=0x7f8748157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 --2- 172.21.15.100:0/3926870827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87480c65f0 0x7f8748157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 -- 172.21.15.100:0/3926870827 >> v2:172.21.15.169:3300/0 conn(0x7f87480c5c80 msgr2=0x7f87480c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 --2- 172.21.15.100:0/3926870827 >> v2:172.21.15.169:3300/0 conn(0x7f87480c5c80 0x7f87480c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.927+0000 7f8745e00700 1 -- 172.21.15.100:0/3926870827 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87480c1110 con 0x7f8748154260 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f8745e00700 1 --2- 172.21.15.100:0/3926870827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8748154260 0x7f87480cb4e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f8748083230 tx=0x7f8738009060).ready entity=mon.0 client_cookie=fc100d641382213e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f8744a00700 1 -- 172.21.15.100:0/3926870827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738005880 con 0x7f8748154260 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f8744a00700 1 -- 172.21.15.100:0/3926870827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87380059e0 con 0x7f8748154260 2024-01-22T05:39:23.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f8744a00700 1 -- 172.21.15.100:0/3926870827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738005d60 con 0x7f8748154260 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 -- 172.21.15.100:0/3926870827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8748154260 msgr2=0x7f87480cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 --2- 172.21.15.100:0/3926870827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8748154260 0x7f87480cb4e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f8748083230 tx=0x7f8738009060).stop 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 -- 172.21.15.100:0/3926870827 shutdown_connections 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 --2- 172.21.15.100:0/3926870827 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87480c65f0 0x7f8748157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 --2- 172.21.15.100:0/3926870827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8748154260 0x7f87480cb4e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 --2- 172.21.15.100:0/3926870827 >> v2:172.21.15.169:3300/0 conn(0x7f87480c5c80 0x7f87480c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 -- 172.21.15.100:0/3926870827 >> 172.21.15.100:0/3926870827 conn(0x7f874805e9d0 msgr2=0x7f87480cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.928+0000 7f874d200700 1 -- 172.21.15.100:0/3926870827 shutdown_connections 2024-01-22T05:39:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.929+0000 7f874d200700 1 -- 172.21.15.100:0/3926870827 wait complete. 2024-01-22T05:39:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.930+0000 7f874d200700 1 Processor -- start 2024-01-22T05:39:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.930+0000 7f874d200700 1 -- start start 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f874d200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87480c5c80 0x7f87480ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f874d200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87480c65f0 0x7f8748164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f874d200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8748154260 0x7f87480c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f874d200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8748164900 con 0x7f87480c65f0 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f874d200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87480c2a50 con 0x7f87480c5c80 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f874d200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480c2d30 con 0x7f8748154260 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f8745400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87480c65f0 0x7f8748164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f8745400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87480c65f0 0x7f8748164d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42850/0 (socket says 172.21.15.100:42850) 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f8745400700 1 -- 172.21.15.100:0/1879342556 learned_addr learned my addr 172.21.15.100:0/1879342556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f8746800700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8748154260 0x7f87480c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.931+0000 7f8745e00700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87480c5c80 0x7f87480ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f8745400700 1 -- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8748154260 msgr2=0x7f87480c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f8745400700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8748154260 0x7f87480c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f8745400700 1 -- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87480c5c80 msgr2=0x7f87480ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f8745400700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87480c5c80 0x7f87480ad340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f8745400700 1 -- 172.21.15.100:0/1879342556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8738009300 con 0x7f87480c65f0 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f8745e00700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87480c5c80 0x7f87480ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f8745400700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87480c65f0 0x7f8748164d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f873000d890 tx=0x7f8730008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f873d600700 1 -- 172.21.15.100:0/1879342556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730011590 con 0x7f87480c65f0 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f873d600700 1 -- 172.21.15.100:0/1879342556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300116f0 con 0x7f87480c65f0 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f873d600700 1 -- 172.21.15.100:0/1879342556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730011a70 con 0x7f87480c65f0 2024-01-22T05:39:23.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87480c3010 con 0x7f87480c65f0 2024-01-22T05:39:23.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.932+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87480ad830 con 0x7f87480c65f0 2024-01-22T05:39:23.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.933+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8748164ab0 con 0x7f87480c65f0 2024-01-22T05:39:23.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.934+0000 7f873d600700 1 -- 172.21.15.100:0/1879342556 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f873001c460 con 0x7f87480c65f0 2024-01-22T05:39:23.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.935+0000 7f873d600700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f872005f150 0x7f8720061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:23.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.935+0000 7f873d600700 1 -- 172.21.15.100:0/1879342556 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f873007a210 con 0x7f87480c65f0 2024-01-22T05:39:23.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.935+0000 7f8745e00700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f872005f150 0x7f8720061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:23.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.935+0000 7f8745e00700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f872005f150 0x7f8720061610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f8748150bf0 tx=0x7f8738016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:23.939+0000 7f873d600700 1 -- 172.21.15.100:0/1879342556 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8748164ab0 con 0x7f87480c65f0 2024-01-22T05:39:24.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.108+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f874805fdb0 con 0x7f87480c65f0 2024-01-22T05:39:24.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.108+0000 7f873d600700 1 -- 172.21.15.100:0/1879342556 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f873004b230 con 0x7f87480c65f0 2024-01-22T05:39:24.108 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:39:24.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f872005f150 msgr2=0x7f8720061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f872005f150 0x7f8720061610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f8748150bf0 tx=0x7f8738016000).stop 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87480c65f0 msgr2=0x7f8748164d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87480c65f0 0x7f8748164d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f873000d890 tx=0x7f8730008040).stop 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 shutdown_connections 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f872005f150 0x7f8720061610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87480c5c80 0x7f87480ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8748154260 0x7f87480c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 --2- 172.21.15.100:0/1879342556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87480c65f0 0x7f8748164d90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 >> 172.21.15.100:0/1879342556 conn(0x7f874805e9d0 msgr2=0x7f87480afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 shutdown_connections 2024-01-22T05:39:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.110+0000 7f874d200700 1 -- 172.21.15.100:0/1879342556 wait complete. 2024-01-22T05:39:24.127 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:39:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.314+0000 7f90b7200700 1 Processor -- start 2024-01-22T05:39:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.314+0000 7f90b7200700 1 -- start start 2024-01-22T05:39:24.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.315+0000 7f90b7200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f90b00a9f60 0x7f90b00aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.315+0000 7f90b7200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90b005e900 0x7f90b00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.315+0000 7f90b7200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b00c74b0 con 0x7f90b00c1940 2024-01-22T05:39:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.315+0000 7f90b7200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b00cab90 con 0x7f90b005e900 2024-01-22T05:39:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.315+0000 7f90b7200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b0158660 con 0x7f90b00a9f60 2024-01-22T05:39:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90b005e900 0x7f90b00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90b005e900 0x7f90b00ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42860/0 (socket says 172.21.15.100:42860) 2024-01-22T05:39:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 -- 172.21.15.100:0/587489669 learned_addr learned my addr 172.21.15.100:0/587489669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90afe00700 1 --2- 172.21.15.100:0/587489669 >> v2:172.21.15.169:3300/0 conn(0x7f90b00a9f60 0x7f90b00aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 -- 172.21.15.100:0/587489669 >> v2:172.21.15.169:3300/0 conn(0x7f90b00a9f60 msgr2=0x7f90b00aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 --2- 172.21.15.100:0/587489669 >> v2:172.21.15.169:3300/0 conn(0x7f90b00a9f60 0x7f90b00aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 -- 172.21.15.100:0/587489669 >> v1:172.21.15.169:6789/0 conn(0x7f90b00c1940 legacy=0x7f90b005e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 -- 172.21.15.100:0/587489669 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0158940 con 0x7f90b005e900 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.316+0000 7f90b5200700 1 --2- 172.21.15.100:0/587489669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00ca6a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f90b00c8850 tx=0x7f90a8009840).ready entity=mon.0 client_cookie=418596604c91e18e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90aea00700 1 -- 172.21.15.100:0/587489669 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800e070 con 0x7f90b005e900 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90aea00700 1 -- 172.21.15.100:0/587489669 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a800ba20 con 0x7f90b005e900 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90aea00700 1 -- 172.21.15.100:0/587489669 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800bda0 con 0x7f90b005e900 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 -- 172.21.15.100:0/587489669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 msgr2=0x7f90b00ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 --2- 172.21.15.100:0/587489669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00ca6a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f90b00c8850 tx=0x7f90a8009840).stop 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 -- 172.21.15.100:0/587489669 shutdown_connections 2024-01-22T05:39:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 --2- 172.21.15.100:0/587489669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00ca6a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 --2- 172.21.15.100:0/587489669 >> v2:172.21.15.169:3300/0 conn(0x7f90b00a9f60 0x7f90b00aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 -- 172.21.15.100:0/587489669 >> 172.21.15.100:0/587489669 conn(0x7f90b00cada0 msgr2=0x7f90b00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:24.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 -- 172.21.15.100:0/587489669 shutdown_connections 2024-01-22T05:39:24.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.317+0000 7f90b7200700 1 -- 172.21.15.100:0/587489669 wait complete. 2024-01-22T05:39:24.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.319+0000 7f90b7200700 1 Processor -- start 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.319+0000 7f90b7200700 1 -- start start 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b7200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b7200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90b00a9f60 0x7f90b00c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b7200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90b00c1940 0x7f90b0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b7200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00c4d70 con 0x7f90b005e900 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b7200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00acc60 con 0x7f90b00c1940 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b7200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00c2330 con 0x7f90b00a9f60 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42864/0 (socket says 172.21.15.100:42864) 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 -- 172.21.15.100:0/1360747306 learned_addr learned my addr 172.21.15.100:0/1360747306 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b5200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90b00c1940 0x7f90b0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90af400700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90b00a9f60 0x7f90b00c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 -- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90b00a9f60 msgr2=0x7f90b00c1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90b00a9f60 0x7f90b00c1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 -- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90b00c1940 msgr2=0x7f90b0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90b00c1940 0x7f90b0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90afe00700 1 -- 172.21.15.100:0/1360747306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8009ae0 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.320+0000 7f90b5200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90b00c1940 0x7f90b0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.321+0000 7f90afe00700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00c4880 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f90a000e960 tx=0x7f90a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.321+0000 7f90a7400700 1 -- 172.21.15.100:0/1360747306 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0009510 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.321+0000 7f90a7400700 1 -- 172.21.15.100:0/1360747306 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a000c850 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.321+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b00ac330 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.321+0000 7f90a7400700 1 -- 172.21.15.100:0/1360747306 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000cbd0 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.321+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b00ac8f0 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.322+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b00acf40 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.323+0000 7f90a7400700 1 -- 172.21.15.100:0/1360747306 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f90a001b400 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.323+0000 7f90a7400700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f908805f150 0x7f9088061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.324+0000 7f90a7400700 1 -- 172.21.15.100:0/1360747306 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f90a007a9c0 con 0x7f90b005e900 2024-01-22T05:39:24.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.324+0000 7f90af400700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f908805f150 0x7f9088061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.324+0000 7f90af400700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f908805f150 0x7f9088061610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f90b00aa6a0 tx=0x7f9098009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:24.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.328+0000 7f90a7400700 1 -- 172.21.15.100:0/1360747306 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f90a004b9e0 con 0x7f90b005e900 2024-01-22T05:39:24.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.497+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90b00afa50 con 0x7f90b005e900 2024-01-22T05:39:24.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.498+0000 7f90a7400700 1 -- 172.21.15.100:0/1360747306 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90a004f000 con 0x7f90b005e900 2024-01-22T05:39:24.498 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:39:24.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f908805f150 msgr2=0x7f9088061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f908805f150 0x7f9088061610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f90b00aa6a0 tx=0x7f9098009040).stop 2024-01-22T05:39:24.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 msgr2=0x7f90b00c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00c4880 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f90a000e960 tx=0x7f90a0009060).stop 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 shutdown_connections 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f908805f150 0x7f9088061610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90b00c1940 0x7f90b0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b005e900 0x7f90b00c4880 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 --2- 172.21.15.100:0/1360747306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f90b00a9f60 0x7f90b00c1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 >> 172.21.15.100:0/1360747306 conn(0x7f90b00cada0 msgr2=0x7f90b00ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 shutdown_connections 2024-01-22T05:39:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.500+0000 7f90b7200700 1 -- 172.21.15.100:0/1360747306 wait complete. 2024-01-22T05:39:24.517 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:39:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.706+0000 7fd2ef600700 1 Processor -- start 2024-01-22T05:39:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.706+0000 7fd2ef600700 1 -- start start 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.707+0000 7fd2ef600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e8157670 0x7fd2e80c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.707+0000 7fd2ef600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80c5e10 con 0x7fd2e8157290 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2ef600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e8065000 con 0x7fd2e80c5960 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2ef600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8092820 con 0x7fd2e8157670 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2ecc00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd2e8157290 0x7fd2e8092110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43618/0 (socket says 172.21.15.100:43618) 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2ecc00700 1 -- 172.21.15.100:0/3914333640 learned_addr learned my addr 172.21.15.100:0/3914333640 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2e7e00700 1 --2- 172.21.15.100:0/3914333640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e8157670 0x7fd2e80c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2e7400700 1 -- 172.21.15.100:0/3914333640 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619718481 0 0) 0x7fd2d8001110 con 0x7fd2e8157290 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2e7400700 1 -- 172.21.15.100:0/3914333640 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c80033f0 con 0x7fd2e8157290 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2e7e00700 1 -- 172.21.15.100:0/3914333640 >> v1:172.21.15.169:6789/0 conn(0x7fd2e80c5960 legacy=0x7fd2e80c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2e7400700 1 -- 172.21.15.100:0/3914333640 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831491137 0 0) 0x7fd2e8065000 con 0x7fd2e80c5960 2024-01-22T05:39:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2e7e00700 1 -- 172.21.15.100:0/3914333640 >> v1:172.21.15.100:6789/0 conn(0x7fd2e8157290 legacy=0x7fd2e8092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.708+0000 7fd2e7e00700 1 -- 172.21.15.100:0/3914333640 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80643f0 con 0x7fd2e8157670 2024-01-22T05:39:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.709+0000 7fd2e7e00700 1 --2- 172.21.15.100:0/3914333640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e8157670 0x7fd2e80c5470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd2d0009790 tx=0x7fd2d0009060).ready entity=mon.2 client_cookie=597c6a70086f76c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.709+0000 7fd2e7400700 1 -- 172.21.15.100:0/3914333640 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000f510 con 0x7fd2e8157670 2024-01-22T05:39:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.709+0000 7fd2e7400700 1 -- 172.21.15.100:0/3914333640 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000f670 con 0x7fd2e8157670 2024-01-22T05:39:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.709+0000 7fd2e7400700 1 -- 172.21.15.100:0/3914333640 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000f9f0 con 0x7fd2e8157670 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.709+0000 7fd2ef600700 1 -- 172.21.15.100:0/3914333640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e8157670 msgr2=0x7fd2e80c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.709+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3914333640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e8157670 0x7fd2e80c5470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd2d0009790 tx=0x7fd2d0009060).stop 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.710+0000 7fd2ef600700 1 -- 172.21.15.100:0/3914333640 shutdown_connections 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.710+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3914333640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e8157670 0x7fd2e80c5470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.710+0000 7fd2ef600700 1 -- 172.21.15.100:0/3914333640 >> 172.21.15.100:0/3914333640 conn(0x7fd2e805e9d0 msgr2=0x7fd2e8091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.710+0000 7fd2ef600700 1 -- 172.21.15.100:0/3914333640 shutdown_connections 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.710+0000 7fd2ef600700 1 -- 172.21.15.100:0/3914333640 wait complete. 2024-01-22T05:39:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.711+0000 7fd2ef600700 1 Processor -- start 2024-01-22T05:39:24.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.711+0000 7fd2ef600700 1 -- start start 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.712+0000 7fd2ef600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e80c5960 0x7fd2e80ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.712+0000 7fd2ef600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e8157290 0x7fd2e8164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.712+0000 7fd2ef600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e8157670 0x7fd2e80c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.712+0000 7fd2ef600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8165a00 con 0x7fd2e8157670 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.712+0000 7fd2ef600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8165ce0 con 0x7fd2e8157290 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.712+0000 7fd2ef600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8165060 con 0x7fd2e80c5960 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.712+0000 7fd2ed600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e8157670 0x7fd2e80c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e8157670 0x7fd2e80c3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42870/0 (socket says 172.21.15.100:42870) 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 -- 172.21.15.100:0/3645193022 learned_addr learned my addr 172.21.15.100:0/3645193022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2e7e00700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e8157290 0x7fd2e8164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ecc00700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e80c5960 0x7fd2e80ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 -- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e80c5960 msgr2=0x7fd2e80ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e80c5960 0x7fd2e80ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 -- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e8157290 msgr2=0x7fd2e8164830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e8157290 0x7fd2e8164830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 -- 172.21.15.100:0/3645193022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00092a0 con 0x7fd2e8157670 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2ed600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e8157670 0x7fd2e80c3be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd2e0002230 tx=0x7fd2e0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2dfe00700 1 -- 172.21.15.100:0/3645193022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0010510 con 0x7fd2e8157670 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2dfe00700 1 -- 172.21.15.100:0/3645193022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0010670 con 0x7fd2e8157670 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.713+0000 7fd2dfe00700 1 -- 172.21.15.100:0/3645193022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0010a10 con 0x7fd2e8157670 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.714+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e8165340 con 0x7fd2e8157670 2024-01-22T05:39:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.714+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e8164d20 con 0x7fd2e8157670 2024-01-22T05:39:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.715+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e8165e50 con 0x7fd2e8157670 2024-01-22T05:39:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.715+0000 7fd2dfe00700 1 -- 172.21.15.100:0/3645193022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd2e001b400 con 0x7fd2e8157670 2024-01-22T05:39:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.716+0000 7fd2dfe00700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd2c005f150 0x7fd2c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.716+0000 7fd2dfe00700 1 -- 172.21.15.100:0/3645193022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fd2e007a1d0 con 0x7fd2e8157670 2024-01-22T05:39:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.716+0000 7fd2ecc00700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd2c005f150 0x7fd2c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.717+0000 7fd2ecc00700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd2c005f150 0x7fd2c0061610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd2d8001270 tx=0x7fd2d8000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.720+0000 7fd2dfe00700 1 -- 172.21.15.100:0/3645193022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2e004b1f0 con 0x7fd2e8157670 2024-01-22T05:39:24.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.893+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2e805fdb0 con 0x7fd2e8157670 2024-01-22T05:39:24.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.893+0000 7fd2dfe00700 1 -- 172.21.15.100:0/3645193022 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2e004e810 con 0x7fd2e8157670 2024-01-22T05:39:24.894 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:39:24.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd2c005f150 msgr2=0x7fd2c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd2c005f150 0x7fd2c0061610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd2d8001270 tx=0x7fd2d8000bc0).stop 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e8157670 msgr2=0x7fd2e80c3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e8157670 0x7fd2e80c3be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd2e0002230 tx=0x7fd2e0007f70).stop 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 shutdown_connections 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd2c005f150 0x7fd2c0061610 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e8157670 0x7fd2e80c3be0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e80c5960 0x7fd2e80ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 --2- 172.21.15.100:0/3645193022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e8157290 0x7fd2e8164830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 >> 172.21.15.100:0/3645193022 conn(0x7fd2e805e9d0 msgr2=0x7fd2e80c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 shutdown_connections 2024-01-22T05:39:24.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:24.895+0000 7fd2ef600700 1 -- 172.21.15.100:0/3645193022 wait complete. 2024-01-22T05:39:24.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-22T05:39:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.099+0000 7f70c6600700 1 Processor -- start 2024-01-22T05:39:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.099+0000 7f70c6600700 1 -- start start 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70c6600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f70c00a9f60 0x7f70c00aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70c6600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f70c005e900 0x7f70c00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70c6600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c00c74b0 con 0x7f70c00c1940 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70c6600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c00cab90 con 0x7f70c005e900 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70c6600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c0158660 con 0x7f70c00a9f60 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70bfe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f70c005e900 0x7f70c00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70bfe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f70c005e900 0x7f70c00ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42880/0 (socket says 172.21.15.100:42880) 2024-01-22T05:39:25.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.100+0000 7f70bfe00700 1 -- 172.21.15.100:0/655046639 learned_addr learned my addr 172.21.15.100:0/655046639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bf400700 1 --2- 172.21.15.100:0/655046639 >> v2:172.21.15.169:3300/0 conn(0x7f70c00a9f60 0x7f70c00aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bfe00700 1 -- 172.21.15.100:0/655046639 >> v2:172.21.15.169:3300/0 conn(0x7f70c00a9f60 msgr2=0x7f70c00aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bfe00700 1 --2- 172.21.15.100:0/655046639 >> v2:172.21.15.169:3300/0 conn(0x7f70c00a9f60 0x7f70c00aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bfe00700 1 -- 172.21.15.100:0/655046639 >> v1:172.21.15.169:6789/0 conn(0x7f70c00c1940 legacy=0x7f70c005e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bfe00700 1 -- 172.21.15.100:0/655046639 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0158940 con 0x7f70c005e900 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bfe00700 1 --2- 172.21.15.100:0/655046639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c005e900 0x7f70c00ca6a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f70c00c8850 tx=0x7f70b8009840).ready entity=mon.0 client_cookie=24d3041aa019683b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bea00700 1 -- 172.21.15.100:0/655046639 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b800e070 con 0x7f70c005e900 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bea00700 1 -- 172.21.15.100:0/655046639 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b800ba10 con 0x7f70c005e900 2024-01-22T05:39:25.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.101+0000 7f70bea00700 1 -- 172.21.15.100:0/655046639 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b800bd90 con 0x7f70c005e900 2024-01-22T05:39:25.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 -- 172.21.15.100:0/655046639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c005e900 msgr2=0x7f70c00ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 --2- 172.21.15.100:0/655046639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c005e900 0x7f70c00ca6a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f70c00c8850 tx=0x7f70b8009840).stop 2024-01-22T05:39:25.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 -- 172.21.15.100:0/655046639 shutdown_connections 2024-01-22T05:39:25.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 --2- 172.21.15.100:0/655046639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c005e900 0x7f70c00ca6a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 --2- 172.21.15.100:0/655046639 >> v2:172.21.15.169:3300/0 conn(0x7f70c00a9f60 0x7f70c00aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 -- 172.21.15.100:0/655046639 >> 172.21.15.100:0/655046639 conn(0x7f70c00cada0 msgr2=0x7f70c00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:25.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 -- 172.21.15.100:0/655046639 shutdown_connections 2024-01-22T05:39:25.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.102+0000 7f70c6600700 1 -- 172.21.15.100:0/655046639 wait complete. 2024-01-22T05:39:25.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.104+0000 7f70c6600700 1 Processor -- start 2024-01-22T05:39:25.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.104+0000 7f70c6600700 1 -- start start 2024-01-22T05:39:25.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.105+0000 7f70c6600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70c005e900 0x7f70c0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.105+0000 7f70c6600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70c00a9f60 0x7f70c01676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.105+0000 7f70c6600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c00c1940 0x7f70c0167bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.105+0000 7f70c6600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c01680a0 con 0x7f70c00c1940 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.105+0000 7f70c6600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c00c4710 con 0x7f70c00a9f60 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.105+0000 7f70c6600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c00c3820 con 0x7f70c005e900 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c00c1940 0x7f70c0167bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c00c1940 0x7f70c0167bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42886/0 (socket says 172.21.15.100:42886) 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 -- 172.21.15.100:0/864813313 learned_addr learned my addr 172.21.15.100:0/864813313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bf400700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70c005e900 0x7f70c0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70b7e00700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70c00a9f60 0x7f70c01676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 -- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70c005e900 msgr2=0x7f70c0152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70c005e900 0x7f70c0152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 -- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70c00a9f60 msgr2=0x7f70c01676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70c00a9f60 0x7f70c01676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 -- 172.21.15.100:0/864813313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b8009ae0 con 0x7f70c00c1940 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70bfe00700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c00c1940 0x7f70c0167bb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f70b8010000 tx=0x7f70b8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.106+0000 7f70b6a00700 1 -- 172.21.15.100:0/864813313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8013cf0 con 0x7f70c00c1940 2024-01-22T05:39:25.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.107+0000 7f70b6a00700 1 -- 172.21.15.100:0/864813313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b8013e50 con 0x7f70c00c1940 2024-01-22T05:39:25.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.107+0000 7f70b6a00700 1 -- 172.21.15.100:0/864813313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b801c630 con 0x7f70c00c1940 2024-01-22T05:39:25.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.107+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c00c3b00 con 0x7f70c00c1940 2024-01-22T05:39:25.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.107+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c00c40c0 con 0x7f70c00c1940 2024-01-22T05:39:25.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.108+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c005fdb0 con 0x7f70c00c1940 2024-01-22T05:39:25.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.108+0000 7f70b6a00700 1 -- 172.21.15.100:0/864813313 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f70b801ca20 con 0x7f70c00c1940 2024-01-22T05:39:25.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.110+0000 7f70b6a00700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f709805f150 0x7f7098061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.110+0000 7f70b6a00700 1 -- 172.21.15.100:0/864813313 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f70b807bdb0 con 0x7f70c00c1940 2024-01-22T05:39:25.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.110+0000 7f70bf400700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f709805f150 0x7f7098061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.110+0000 7f70bf400700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f709805f150 0x7f7098061610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f70b000bbc0 tx=0x7f70b0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.114+0000 7f70b6a00700 1 -- 172.21.15.100:0/864813313 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f70b8080070 con 0x7f70c00c1940 2024-01-22T05:39:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.286+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f70c005fdb0 con 0x7f70c00c1940 2024-01-22T05:39:25.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.287+0000 7f70b6a00700 1 -- 172.21.15.100:0/864813313 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v39) v1 ==== 97+0+11 (secure 0 0 0) 0x7f70b804ce30 con 0x7f70c00c1940 2024-01-22T05:39:25.287 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f709805f150 msgr2=0x7f7098061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f709805f150 0x7f7098061610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f70b000bbc0 tx=0x7f70b0008040).stop 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c00c1940 msgr2=0x7f70c0167bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c00c1940 0x7f70c0167bb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f70b8010000 tx=0x7f70b8009840).stop 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 shutdown_connections 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f709805f150 0x7f7098061610 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70c00c1940 0x7f70c0167bb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70c005e900 0x7f70c0152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 --2- 172.21.15.100:0/864813313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70c00a9f60 0x7f70c01676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 >> 172.21.15.100:0/864813313 conn(0x7f70c00cada0 msgr2=0x7f70c0153730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 shutdown_connections 2024-01-22T05:39:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.289+0000 7f70c6600700 1 -- 172.21.15.100:0/864813313 wait complete. 2024-01-22T05:39:25.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:25.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.489+0000 7f8465e00700 1 Processor -- start 2024-01-22T05:39:25.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.490+0000 7f8465e00700 1 -- start start 2024-01-22T05:39:25.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.491+0000 7f8465e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8460064c30 0x7f8460065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.491+0000 7f8465e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8460065540 con 0x7f8460153c60 2024-01-22T05:39:25.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.491+0000 7f8465e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84600bc510 con 0x7f8460154040 2024-01-22T05:39:25.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.491+0000 7f8465e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84600bc7f0 con 0x7f8460064c30 2024-01-22T05:39:25.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.491+0000 7f845ea00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8460153c60 0x7f84600c1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43626/0 (socket says 172.21.15.100:43626) 2024-01-22T05:39:25.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.491+0000 7f845ea00700 1 -- 172.21.15.100:0/68607248 learned_addr learned my addr 172.21.15.100:0/68607248 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:25.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845f400700 1 --2- 172.21.15.100:0/68607248 >> v2:172.21.15.169:3300/0 conn(0x7f8460064c30 0x7f8460065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845d600700 1 -- 172.21.15.100:0/68607248 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484091440 0 0) 0x7f8460065540 con 0x7f8460153c60 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845d600700 1 -- 172.21.15.100:0/68607248 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84400033f0 con 0x7f8460153c60 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845d600700 1 -- 172.21.15.100:0/68607248 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015323780 0 0) 0x7f84600bc510 con 0x7f8460154040 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845d600700 1 -- 172.21.15.100:0/68607248 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8460065540 con 0x7f8460154040 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845f400700 1 -- 172.21.15.100:0/68607248 >> v1:172.21.15.169:6789/0 conn(0x7f8460154040 legacy=0x7f8460066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845f400700 1 -- 172.21.15.100:0/68607248 >> v1:172.21.15.100:6789/0 conn(0x7f8460153c60 legacy=0x7f84600c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845f400700 1 -- 172.21.15.100:0/68607248 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600c45b0 con 0x7f8460064c30 2024-01-22T05:39:25.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.492+0000 7f845f400700 1 --2- 172.21.15.100:0/68607248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460064c30 0x7f8460065050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f8458009e60 tx=0x7f8458009780).ready entity=mon.1 client_cookie=14567d9e2348802f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f845d600700 1 -- 172.21.15.100:0/68607248 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845800e070 con 0x7f8460064c30 2024-01-22T05:39:25.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f845d600700 1 -- 172.21.15.100:0/68607248 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845800bab0 con 0x7f8460064c30 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f845d600700 1 -- 172.21.15.100:0/68607248 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845800be30 con 0x7f8460064c30 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f8465e00700 1 -- 172.21.15.100:0/68607248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460064c30 msgr2=0x7f8460065050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f8465e00700 1 --2- 172.21.15.100:0/68607248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460064c30 0x7f8460065050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f8458009e60 tx=0x7f8458009780).stop 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f8465e00700 1 -- 172.21.15.100:0/68607248 shutdown_connections 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f8465e00700 1 --2- 172.21.15.100:0/68607248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460064c30 0x7f8460065050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f8465e00700 1 -- 172.21.15.100:0/68607248 >> 172.21.15.100:0/68607248 conn(0x7f84600c7d20 msgr2=0x7f84600c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f8465e00700 1 -- 172.21.15.100:0/68607248 shutdown_connections 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.493+0000 7f8465e00700 1 -- 172.21.15.100:0/68607248 wait complete. 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.495+0000 7f8465e00700 1 Processor -- start 2024-01-22T05:39:25.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.495+0000 7f8465e00700 1 -- start start 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f8465e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8460064c30 0x7f8460144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f8465e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460153c60 0x7f84600ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f8465e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8460154040 0x7f8460156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f8465e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460144b30 con 0x7f8460064c30 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f8465e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84601548b0 con 0x7f8460153c60 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f8465e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8460154b90 con 0x7f8460154040 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8460064c30 0x7f8460144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8460064c30 0x7f8460144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42892/0 (socket says 172.21.15.100:42892) 2024-01-22T05:39:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 -- 172.21.15.100:0/4191733338 learned_addr learned my addr 172.21.15.100:0/4191733338 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 -- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8460154040 msgr2=0x7f8460156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8460154040 0x7f8460156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 -- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460153c60 msgr2=0x7f84600ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845e000700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460153c60 0x7f84600ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460153c60 0x7f84600ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845ea00700 1 -- 172.21.15.100:0/4191733338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458009a20 con 0x7f8460064c30 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.496+0000 7f845e000700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460153c60 0x7f84600ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.497+0000 7f845ea00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8460064c30 0x7f8460144640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f845000c560 tx=0x7f8450007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.497+0000 7f8456000700 1 -- 172.21.15.100:0/4191733338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500072e0 con 0x7f8460064c30 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.497+0000 7f8456000700 1 -- 172.21.15.100:0/4191733338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450007440 con 0x7f8460064c30 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.497+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8460154e70 con 0x7f8460064c30 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.497+0000 7f8456000700 1 -- 172.21.15.100:0/4191733338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500057a0 con 0x7f8460064c30 2024-01-22T05:39:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.497+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8460155430 con 0x7f8460064c30 2024-01-22T05:39:25.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.498+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8460155650 con 0x7f8460064c30 2024-01-22T05:39:25.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.499+0000 7f8456000700 1 -- 172.21.15.100:0/4191733338 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8450005bd0 con 0x7f8460064c30 2024-01-22T05:39:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.499+0000 7f8456000700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f843805f150 0x7f8438061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.499+0000 7f8456000700 1 -- 172.21.15.100:0/4191733338 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f8450079dc0 con 0x7f8460064c30 2024-01-22T05:39:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.500+0000 7f845e000700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f843805f150 0x7f8438061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.500+0000 7f845e000700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f843805f150 0x7f8438061610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f84600ac810 tx=0x7f8448009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.504+0000 7f8456000700 1 -- 172.21.15.100:0/4191733338 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f845004ae40 con 0x7f8460064c30 2024-01-22T05:39:25.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.716+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f846005fdb0 con 0x7f8460064c30 2024-01-22T05:39:25.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.716+0000 7f8456000700 1 -- 172.21.15.100:0/4191733338 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f8450018070 con 0x7f8460064c30 2024-01-22T05:39:25.716 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:25.717 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:38:58.799067+0000","modified":"2024-01-22T05:39:08.646529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6834/2612830615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2612830615},{"type":"v1","addr":"172.21.15.169:6834","nonce":2612830615}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:39:25.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.718+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f843805f150 msgr2=0x7f8438061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.718+0000 7f8465e00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f843805f150 0x7f8438061610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f84600ac810 tx=0x7f8448009040).stop 2024-01-22T05:39:25.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.718+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8460064c30 msgr2=0x7f8460144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.718+0000 7f8465e00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8460064c30 0x7f8460144640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f845000c560 tx=0x7f8450007d20).stop 2024-01-22T05:39:25.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 shutdown_connections 2024-01-22T05:39:25.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f843805f150 0x7f8438061610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8460154040 0x7f8460156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8460064c30 0x7f8460144640 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 --2- 172.21.15.100:0/4191733338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8460153c60 0x7f84600ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 >> 172.21.15.100:0/4191733338 conn(0x7f84600c7d20 msgr2=0x7f8460066270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 shutdown_connections 2024-01-22T05:39:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.719+0000 7f8465e00700 1 -- 172.21.15.100:0/4191733338 wait complete. 2024-01-22T05:39:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 15 2024-01-22T05:39:25.736 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.919+0000 7f5396400700 1 Processor -- start 2024-01-22T05:39:25.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.919+0000 7f5396400700 1 -- start start 2024-01-22T05:39:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.920+0000 7f5396400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f53900a7c90 0x7f53900639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.920+0000 7f5396400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5390098920 0x7f5390063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.920+0000 7f5396400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53900c5d20 con 0x7f5390153fb0 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.920+0000 7f5396400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53900643c0 con 0x7f5390098920 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.920+0000 7f5396400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53900c57a0 con 0x7f53900a7c90 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5390098920 0x7f5390063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5390098920 0x7f5390063ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42898/0 (socket says 172.21.15.100:42898) 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 -- 172.21.15.100:0/1949281056 learned_addr learned my addr 172.21.15.100:0/1949281056 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538f400700 1 --1- 172.21.15.100:0/1949281056 >> v1:172.21.15.100:6789/0 conn(0x7f5390153fb0 0x7f53900c0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43640/0 (socket says 172.21.15.100:43640) 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538ea00700 1 --2- 172.21.15.100:0/1949281056 >> v2:172.21.15.169:3300/0 conn(0x7f53900a7c90 0x7f53900639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 -- 172.21.15.100:0/1949281056 >> v2:172.21.15.169:3300/0 conn(0x7f53900a7c90 msgr2=0x7f53900639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 --2- 172.21.15.100:0/1949281056 >> v2:172.21.15.169:3300/0 conn(0x7f53900a7c90 0x7f53900639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 -- 172.21.15.100:0/1949281056 >> v1:172.21.15.100:6789/0 conn(0x7f5390153fb0 legacy=0x7f53900c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 -- 172.21.15.100:0/1949281056 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900c16c0 con 0x7f5390098920 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538e000700 1 -- 172.21.15.100:0/1949281056 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292254917 0 0) 0x7f53900c5d20 con 0x7f5390153fb0 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.921+0000 7f538fe00700 1 --2- 172.21.15.100:0/1949281056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390098920 0x7f5390063ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f53900c8c00 tx=0x7f5388009840).ready entity=mon.0 client_cookie=a97754340c97ae0d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f538e000700 1 -- 172.21.15.100:0/1949281056 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800e070 con 0x7f5390098920 2024-01-22T05:39:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f538e000700 1 -- 172.21.15.100:0/1949281056 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800ba20 con 0x7f5390098920 2024-01-22T05:39:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f538e000700 1 -- 172.21.15.100:0/1949281056 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800bda0 con 0x7f5390098920 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 -- 172.21.15.100:0/1949281056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390098920 msgr2=0x7f5390063ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 --2- 172.21.15.100:0/1949281056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390098920 0x7f5390063ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f53900c8c00 tx=0x7f5388009840).stop 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 -- 172.21.15.100:0/1949281056 shutdown_connections 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 --2- 172.21.15.100:0/1949281056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390098920 0x7f5390063ed0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 --2- 172.21.15.100:0/1949281056 >> v2:172.21.15.169:3300/0 conn(0x7f53900a7c90 0x7f53900639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 -- 172.21.15.100:0/1949281056 >> 172.21.15.100:0/1949281056 conn(0x7f53900c78a0 msgr2=0x7f53900c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 -- 172.21.15.100:0/1949281056 shutdown_connections 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.922+0000 7f5396400700 1 -- 172.21.15.100:0/1949281056 wait complete. 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.924+0000 7f5396400700 1 Processor -- start 2024-01-22T05:39:25.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.924+0000 7f5396400700 1 -- start start 2024-01-22T05:39:25.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f5396400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5390098920 0x7f5390154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f5396400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53900a7c90 0x7f539013d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f5396400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390153fb0 0x7f5390155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f5396400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390156fb0 con 0x7f5390153fb0 2024-01-22T05:39:25.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f5396400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390157290 con 0x7f53900a7c90 2024-01-22T05:39:25.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f5396400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5390158820 con 0x7f5390098920 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390153fb0 0x7f5390155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390153fb0 0x7f5390155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42912/0 (socket says 172.21.15.100:42912) 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 -- 172.21.15.100:0/3842020254 learned_addr learned my addr 172.21.15.100:0/3842020254 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538f400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5390098920 0x7f5390154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538ea00700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53900a7c90 0x7f539013d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 -- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5390098920 msgr2=0x7f5390154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5390098920 0x7f5390154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 -- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53900a7c90 msgr2=0x7f539013d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53900a7c90 0x7f539013d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 -- 172.21.15.100:0/3842020254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388009ae0 con 0x7f5390153fb0 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538f400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5390098920 0x7f5390154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.925+0000 7f538fe00700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390153fb0 0x7f5390155f90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f538800b6c0 tx=0x7f5388009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.926+0000 7f5386a00700 1 -- 172.21.15.100:0/3842020254 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800bda0 con 0x7f5390153fb0 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.926+0000 7f5386a00700 1 -- 172.21.15.100:0/3842020254 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53880092e0 con 0x7f5390153fb0 2024-01-22T05:39:25.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.926+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5390158b00 con 0x7f5390153fb0 2024-01-22T05:39:25.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.926+0000 7f5386a00700 1 -- 172.21.15.100:0/3842020254 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538801d6b0 con 0x7f5390153fb0 2024-01-22T05:39:25.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.926+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5390154880 con 0x7f5390153fb0 2024-01-22T05:39:25.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.927+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539005fdb0 con 0x7f5390153fb0 2024-01-22T05:39:25.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.928+0000 7f5386a00700 1 -- 172.21.15.100:0/3842020254 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5388003040 con 0x7f5390153fb0 2024-01-22T05:39:25.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.928+0000 7f5386a00700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f536805f150 0x7f5368061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:25.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.928+0000 7f5386a00700 1 -- 172.21.15.100:0/3842020254 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f538807b830 con 0x7f5390153fb0 2024-01-22T05:39:25.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.928+0000 7f538f400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f536805f150 0x7f5368061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:25.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.929+0000 7f538f400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f536805f150 0x7f5368061610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f53800011e0 tx=0x7f5380007b10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:25.932+0000 7f5386a00700 1 -- 172.21.15.100:0/3842020254 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f538804c8b0 con 0x7f5390153fb0 2024-01-22T05:39:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.103+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53900bffd0 con 0x7f5390153fb0 2024-01-22T05:39:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.104+0000 7f5386a00700 1 -- 172.21.15.100:0/3842020254 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18535 (secure 0 0 0) 0x7f5388022020 con 0x7f5390153fb0 2024-01-22T05:39:26.104 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:26.104 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:09.648970+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:38:56.791674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-22T05:38:57.778340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-22T05:39:07.671856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:26.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f536805f150 msgr2=0x7f5368061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f536805f150 0x7f5368061610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f53800011e0 tx=0x7f5380007b10).stop 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390153fb0 msgr2=0x7f5390155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390153fb0 0x7f5390155f90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f538800b6c0 tx=0x7f5388009840).stop 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 shutdown_connections 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f536805f150 0x7f5368061610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5390153fb0 0x7f5390155f90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5390098920 0x7f5390154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 --2- 172.21.15.100:0/3842020254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53900a7c90 0x7f539013d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 >> 172.21.15.100:0/3842020254 conn(0x7f53900c78a0 msgr2=0x7f53900a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 shutdown_connections 2024-01-22T05:39:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.106+0000 7f5396400700 1 -- 172.21.15.100:0/3842020254 wait complete. 2024-01-22T05:39:26.124 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:39:26.124 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:26.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.309+0000 7fbd2e000700 1 Processor -- start 2024-01-22T05:39:26.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.309+0000 7fbd2e000700 1 -- start start 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.310+0000 7fbd2e000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd28153c60 0x7fbd28154040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.310+0000 7fbd2e000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbd28064c30 0x7fbd28065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.310+0000 7fbd2e000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd28065540 con 0x7fbd280c1900 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.310+0000 7fbd2e000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280bc510 con 0x7fbd28153c60 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.310+0000 7fbd2e000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280bc7f0 con 0x7fbd28064c30 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd28153c60 0x7fbd28154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd28153c60 0x7fbd28154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42928/0 (socket says 172.21.15.100:42928) 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 -- 172.21.15.100:0/494038242 learned_addr learned my addr 172.21.15.100:0/494038242 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27e00700 1 --2- 172.21.15.100:0/494038242 >> v2:172.21.15.169:3300/0 conn(0x7fbd28064c30 0x7fbd28065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 -- 172.21.15.100:0/494038242 >> v2:172.21.15.169:3300/0 conn(0x7fbd28064c30 msgr2=0x7fbd28065050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 --2- 172.21.15.100:0/494038242 >> v2:172.21.15.169:3300/0 conn(0x7fbd28064c30 0x7fbd28065050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 -- 172.21.15.100:0/494038242 >> v1:172.21.15.100:6789/0 conn(0x7fbd280c1900 legacy=0x7fbd28066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 -- 172.21.15.100:0/494038242 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd280c45b0 con 0x7fbd28153c60 2024-01-22T05:39:26.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd27400700 1 --2- 172.21.15.100:0/494038242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd28153c60 0x7fbd28154040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fbd28066c30 tx=0x7fbd180090f0).ready entity=mon.0 client_cookie=4e9d1a161dc42398 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd26000700 1 -- 172.21.15.100:0/494038242 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800b600 con 0x7fbd28153c60 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd26000700 1 -- 172.21.15.100:0/494038242 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800b760 con 0x7fbd28153c60 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.311+0000 7fbd26000700 1 -- 172.21.15.100:0/494038242 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800bae0 con 0x7fbd28153c60 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 -- 172.21.15.100:0/494038242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd28153c60 msgr2=0x7fbd28154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 --2- 172.21.15.100:0/494038242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd28153c60 0x7fbd28154040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fbd28066c30 tx=0x7fbd180090f0).stop 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 -- 172.21.15.100:0/494038242 shutdown_connections 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 --2- 172.21.15.100:0/494038242 >> v2:172.21.15.169:3300/0 conn(0x7fbd28064c30 0x7fbd28065050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 --2- 172.21.15.100:0/494038242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd28153c60 0x7fbd28154040 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 -- 172.21.15.100:0/494038242 >> 172.21.15.100:0/494038242 conn(0x7fbd280c7d20 msgr2=0x7fbd280c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 -- 172.21.15.100:0/494038242 shutdown_connections 2024-01-22T05:39:26.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.312+0000 7fbd2e000700 1 -- 172.21.15.100:0/494038242 wait complete. 2024-01-22T05:39:26.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.313+0000 7fbd2e000700 1 Processor -- start 2024-01-22T05:39:26.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.314+0000 7fbd2e000700 1 -- start start 2024-01-22T05:39:26.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd2e000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd28064c30 0x7fbd28142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd2e000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd280c1900 0x7fbd280bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd2e000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd28153c60 0x7fbd280be160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd2e000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280be650 con 0x7fbd280c1900 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd2e000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280a6da0 con 0x7fbd28064c30 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd2e000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280a7080 con 0x7fbd28153c60 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd280c1900 0x7fbd280bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd280c1900 0x7fbd280bdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42934/0 (socket says 172.21.15.100:42934) 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 -- 172.21.15.100:0/3099086928 learned_addr learned my addr 172.21.15.100:0/3099086928 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd27400700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd28064c30 0x7fbd28142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd27e00700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd28153c60 0x7fbd280be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 -- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd28153c60 msgr2=0x7fbd280be160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd28153c60 0x7fbd280be160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 -- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd28064c30 msgr2=0x7fbd28142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd28064c30 0x7fbd28142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 -- 172.21.15.100:0/3099086928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009370 con 0x7fbd280c1900 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd27e00700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd28153c60 0x7fbd280be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.315+0000 7fbd26a00700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd280c1900 0x7fbd280bdc70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fbd1000c4c0 tx=0x7fbd10007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.316+0000 7fbd1ea00700 1 -- 172.21.15.100:0/3099086928 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10007020 con 0x7fbd280c1900 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.316+0000 7fbd1ea00700 1 -- 172.21.15.100:0/3099086928 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10001e90 con 0x7fbd280c1900 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.316+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd280be850 con 0x7fbd280c1900 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.316+0000 7fbd1ea00700 1 -- 172.21.15.100:0/3099086928 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100073b0 con 0x7fbd280c1900 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.316+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd280bee10 con 0x7fbd280c1900 2024-01-22T05:39:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.317+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd280a6b90 con 0x7fbd280c1900 2024-01-22T05:39:26.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.317+0000 7fbd1ea00700 1 -- 172.21.15.100:0/3099086928 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbd100068b0 con 0x7fbd280c1900 2024-01-22T05:39:26.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.318+0000 7fbd1ea00700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd0005f150 0x7fbd00061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.318+0000 7fbd1ea00700 1 -- 172.21.15.100:0/3099086928 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fbd10079ce0 con 0x7fbd280c1900 2024-01-22T05:39:26.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.318+0000 7fbd27400700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd0005f150 0x7fbd00061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.319+0000 7fbd27400700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd0005f150 0x7fbd00061610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fbd18009fd0 tx=0x7fbd18017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:26.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.322+0000 7fbd1ea00700 1 -- 172.21.15.100:0/3099086928 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbd1004ad60 con 0x7fbd280c1900 2024-01-22T05:39:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.533+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd2805fdb0 con 0x7fbd280c1900 2024-01-22T05:39:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.533+0000 7fbd1ea00700 1 -- 172.21.15.100:0/3099086928 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fbd1004e380 con 0x7fbd280c1900 2024-01-22T05:39:26.533 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:26.534 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:38:58.799067+0000","modified":"2024-01-22T05:39:08.646529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6834/2612830615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2612830615},{"type":"v1","addr":"172.21.15.169:6834","nonce":2612830615}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:39:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd0005f150 msgr2=0x7fbd00061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd0005f150 0x7fbd00061610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fbd18009fd0 tx=0x7fbd18017000).stop 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd280c1900 msgr2=0x7fbd280bdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd280c1900 0x7fbd280bdc70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fbd1000c4c0 tx=0x7fbd10007e00).stop 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 shutdown_connections 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fbd0005f150 0x7fbd00061610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd28064c30 0x7fbd28142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd28153c60 0x7fbd280be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 --2- 172.21.15.100:0/3099086928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd280c1900 0x7fbd280bdc70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.535+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 >> 172.21.15.100:0/3099086928 conn(0x7fbd280c7d20 msgr2=0x7fbd280c5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.536+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 shutdown_connections 2024-01-22T05:39:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.536+0000 7fbd2e000700 1 -- 172.21.15.100:0/3099086928 wait complete. 2024-01-22T05:39:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 15 2024-01-22T05:39:26.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.736+0000 7efea7200700 1 Processor -- start 2024-01-22T05:39:26.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.736+0000 7efea7200700 1 -- start start 2024-01-22T05:39:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.737+0000 7efea7200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.737+0000 7efea7200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efea00681e0 0x7efea0068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.737+0000 7efea7200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea0065c90 con 0x7efea00a58a0 2024-01-22T05:39:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.737+0000 7efea7200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea006a790 con 0x7efea00681e0 2024-01-22T05:39:26.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.737+0000 7efea7200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea00bba50 con 0x7efea00a5c80 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efe9f400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efea00681e0 0x7efea0068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efea00681e0 0x7efea0068650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:42174/0 (socket says 172.21.15.100:42174) 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 -- 172.21.15.100:0/1665537938 learned_addr learned my addr 172.21.15.100:0/1665537938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efe9f400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea006a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:45568/0 (socket says 172.21.15.100:45568) 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efe9fe00700 1 --1- 172.21.15.100:0/1665537938 >> v1:172.21.15.169:6789/0 conn(0x7efea00a58a0 0x7efea0064b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:48522/0 (socket says 172.21.15.100:48522) 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 -- 172.21.15.100:0/1665537938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 msgr2=0x7efea006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 --2- 172.21.15.100:0/1665537938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 -- 172.21.15.100:0/1665537938 >> v1:172.21.15.169:6789/0 conn(0x7efea00a58a0 legacy=0x7efea0064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 -- 172.21.15.100:0/1665537938 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0068b40 con 0x7efea00681e0 2024-01-22T05:39:26.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.738+0000 7efea5200700 1 --2- 172.21.15.100:0/1665537938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 0x7efea0068650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7efe98009f20 tx=0x7efe98009840).ready entity=mon.1 client_cookie=b0add117844039b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efe9ea00700 1 -- 172.21.15.100:0/1665537938 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800e070 con 0x7efea00681e0 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efe9ea00700 1 -- 172.21.15.100:0/1665537938 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9800b9d0 con 0x7efea00681e0 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efe9ea00700 1 -- 172.21.15.100:0/1665537938 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800bd50 con 0x7efea00681e0 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 -- 172.21.15.100:0/1665537938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 msgr2=0x7efea0068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 --2- 172.21.15.100:0/1665537938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 0x7efea0068650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7efe98009f20 tx=0x7efe98009840).stop 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 -- 172.21.15.100:0/1665537938 shutdown_connections 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 --2- 172.21.15.100:0/1665537938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 0x7efea0068650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 --2- 172.21.15.100:0/1665537938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 -- 172.21.15.100:0/1665537938 >> 172.21.15.100:0/1665537938 conn(0x7efea0063090 msgr2=0x7efea00c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 -- 172.21.15.100:0/1665537938 shutdown_connections 2024-01-22T05:39:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.739+0000 7efea7200700 1 -- 172.21.15.100:0/1665537938 wait complete. 2024-01-22T05:39:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.741+0000 7efea7200700 1 Processor -- start 2024-01-22T05:39:26.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.741+0000 7efea7200700 1 -- start start 2024-01-22T05:39:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efea7200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 0x7efea0167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efea7200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea00a58a0 0x7efea0164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efea7200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea00a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efea7200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea0153800 con 0x7efea00a58a0 2024-01-22T05:39:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efea7200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea0167800 con 0x7efea00681e0 2024-01-22T05:39:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efea7200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea0164920 con 0x7efea00a5c80 2024-01-22T05:39:26.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea00a58a0 0x7efea0164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea00a58a0 0x7efea0164430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42948/0 (socket says 172.21.15.100:42948) 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 -- 172.21.15.100:0/1582500774 learned_addr learned my addr 172.21.15.100:0/1582500774 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efea5200700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea00a84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9fe00700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 0x7efea0167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 -- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 msgr2=0x7efea00a84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea00a84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 -- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 msgr2=0x7efea0167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 0x7efea0167310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.742+0000 7efe9f400700 1 -- 172.21.15.100:0/1582500774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98009ae0 con 0x7efea00a58a0 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.743+0000 7efe9f400700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea00a58a0 0x7efea0164430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7efe8800e8d0 tx=0x7efe88009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.743+0000 7efe97400700 1 -- 172.21.15.100:0/1582500774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800c640 con 0x7efea00a58a0 2024-01-22T05:39:26.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.743+0000 7efe97400700 1 -- 172.21.15.100:0/1582500774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8800c7a0 con 0x7efea00a58a0 2024-01-22T05:39:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.743+0000 7efe97400700 1 -- 172.21.15.100:0/1582500774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800cb20 con 0x7efea00a58a0 2024-01-22T05:39:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.743+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea0152bf0 con 0x7efea00a58a0 2024-01-22T05:39:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.743+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea01531b0 con 0x7efea00a58a0 2024-01-22T05:39:26.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.744+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea005fdb0 con 0x7efea00a58a0 2024-01-22T05:39:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.745+0000 7efe97400700 1 -- 172.21.15.100:0/1582500774 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efe8801b400 con 0x7efea00a58a0 2024-01-22T05:39:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.746+0000 7efe97400700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe7805f150 0x7efe78061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.746+0000 7efe97400700 1 -- 172.21.15.100:0/1582500774 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7efe8807a830 con 0x7efea00a58a0 2024-01-22T05:39:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.746+0000 7efe9fe00700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe7805f150 0x7efe78061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:26.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.746+0000 7efe9fe00700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe7805f150 0x7efe78061610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7efe900076b0 tx=0x7efe90007bf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.749+0000 7efe97400700 1 -- 172.21.15.100:0/1582500774 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efe8804b900 con 0x7efea00a58a0 2024-01-22T05:39:26.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.959+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efea00653f0 con 0x7efea00a58a0 2024-01-22T05:39:26.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.960+0000 7efe97400700 1 -- 172.21.15.100:0/1582500774 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4494 (secure 0 0 0) 0x7efe8804ef20 con 0x7efea00a58a0 2024-01-22T05:39:26.960 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:26.960 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:38:58.799067+0000","modified":"2024-01-22T05:39:08.646529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6834/2612830615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2612830615},{"type":"v1","addr":"172.21.15.169:6834","nonce":2612830615}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe7805f150 msgr2=0x7efe78061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe7805f150 0x7efe78061610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7efe900076b0 tx=0x7efe90007bf0).stop 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea00a58a0 msgr2=0x7efea0164430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea00a58a0 0x7efea0164430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7efe8800e8d0 tx=0x7efe88009060).stop 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 shutdown_connections 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe7805f150 0x7efe78061610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efea00681e0 0x7efea0167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efea00a5c80 0x7efea00a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 --2- 172.21.15.100:0/1582500774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea00a58a0 0x7efea0164430 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:26.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 >> 172.21.15.100:0/1582500774 conn(0x7efea0063090 msgr2=0x7efea00c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:26.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 shutdown_connections 2024-01-22T05:39:26.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:26.962+0000 7efea7200700 1 -- 172.21.15.100:0/1582500774 wait complete. 2024-01-22T05:39:26.963 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 15 2024-01-22T05:39:26.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:27.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:39:27.100 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:39:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.165+0000 7f50c7c00700 1 Processor -- start 2024-01-22T05:39:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.166+0000 7f50c7c00700 1 -- start start 2024-01-22T05:39:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50c7c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50c7c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c0065c90 con 0x7f50c00a58a0 2024-01-22T05:39:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50c7c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00bba50 con 0x7f50c00681e0 2024-01-22T05:39:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50c7c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c006a790 con 0x7f50c00a5c80 2024-01-22T05:39:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50c5200700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f50c00a58a0 0x7f50c0064b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43666/0 (socket says 172.21.15.100:43666) 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50c5200700 1 -- 172.21.15.100:0/313802495 learned_addr learned my addr 172.21.15.100:0/313802495 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50bfe00700 1 --2- 172.21.15.100:0/313802495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.167+0000 7f50bf400700 1 -- 172.21.15.100:0/313802495 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061495103 0 0) 0x7f50c0065c90 con 0x7f50c00a58a0 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bf400700 1 -- 172.21.15.100:0/313802495 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a00033f0 con 0x7f50c00a58a0 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bf400700 1 -- 172.21.15.100:0/313802495 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145111231 0 0) 0x7f50c00bba50 con 0x7f50c00681e0 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bf400700 1 -- 172.21.15.100:0/313802495 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c0065c90 con 0x7f50c00681e0 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bfe00700 1 -- 172.21.15.100:0/313802495 >> v1:172.21.15.169:6789/0 conn(0x7f50c00681e0 legacy=0x7f50c00bbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bfe00700 1 -- 172.21.15.100:0/313802495 >> v1:172.21.15.100:6789/0 conn(0x7f50c00a58a0 legacy=0x7f50c0064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bfe00700 1 -- 172.21.15.100:0/313802495 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00653f0 con 0x7f50c00a5c80 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bfe00700 1 --2- 172.21.15.100:0/313802495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c006a2a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f50a8009790 tx=0x7f50a8009060).ready entity=mon.2 client_cookie=ff7717594963648d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bf400700 1 -- 172.21.15.100:0/313802495 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800f510 con 0x7f50c00a5c80 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bf400700 1 -- 172.21.15.100:0/313802495 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800f670 con 0x7f50c00a5c80 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.168+0000 7f50bf400700 1 -- 172.21.15.100:0/313802495 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800f9f0 con 0x7f50c00a5c80 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.169+0000 7f50c7c00700 1 -- 172.21.15.100:0/313802495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 msgr2=0x7f50c006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.169+0000 7f50c7c00700 1 --2- 172.21.15.100:0/313802495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c006a2a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f50a8009790 tx=0x7f50a8009060).stop 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.169+0000 7f50c7c00700 1 -- 172.21.15.100:0/313802495 shutdown_connections 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.169+0000 7f50c7c00700 1 --2- 172.21.15.100:0/313802495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c006a2a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.169+0000 7f50c7c00700 1 -- 172.21.15.100:0/313802495 >> 172.21.15.100:0/313802495 conn(0x7f50c0063090 msgr2=0x7f50c00c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.169+0000 7f50c7c00700 1 -- 172.21.15.100:0/313802495 shutdown_connections 2024-01-22T05:39:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.169+0000 7f50c7c00700 1 -- 172.21.15.100:0/313802495 wait complete. 2024-01-22T05:39:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.170+0000 7f50c7c00700 1 Processor -- start 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.170+0000 7f50c7c00700 1 -- start start 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.171+0000 7f50c7c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00681e0 0x7f50c0139890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.171+0000 7f50c7c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c00a58a0 0x7f50c01539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.171+0000 7f50c7c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c0153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.171+0000 7f50c7c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c01552a0 con 0x7f50c00a58a0 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.171+0000 7f50c7c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c01526f0 con 0x7f50c00681e0 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.171+0000 7f50c7c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0153550 con 0x7f50c00a5c80 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c00a58a0 0x7f50c01539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c00a58a0 0x7f50c01539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42950/0 (socket says 172.21.15.100:42950) 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 -- 172.21.15.100:0/3831168995 learned_addr learned my addr 172.21.15.100:0/3831168995 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50c5c00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c0153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50c5200700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00681e0 0x7f50c0139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 -- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 msgr2=0x7f50c0153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c0153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 -- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00681e0 msgr2=0x7f50c0139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00681e0 0x7f50c0139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 -- 172.21.15.100:0/3831168995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80092a0 con 0x7f50c00a58a0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50bfe00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c00a58a0 0x7f50c01539e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f50a8011000 tx=0x7f50a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50b7e00700 1 -- 172.21.15.100:0/3831168995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800fe80 con 0x7f50c00a58a0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50b7e00700 1 -- 172.21.15.100:0/3831168995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800f7e0 con 0x7f50c00a58a0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.172+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c0152940 con 0x7f50c00a58a0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.173+0000 7f50b7e00700 1 -- 172.21.15.100:0/3831168995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a801c650 con 0x7f50c00a58a0 2024-01-22T05:39:27.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.173+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c0152f00 con 0x7f50c00a58a0 2024-01-22T05:39:27.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.174+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c005fdb0 con 0x7f50c00a58a0 2024-01-22T05:39:27.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.174+0000 7f50b7e00700 1 -- 172.21.15.100:0/3831168995 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f50a801c9c0 con 0x7f50c00a58a0 2024-01-22T05:39:27.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.175+0000 7f50b7e00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f509805f150 0x7f5098061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.175+0000 7f50b7e00700 1 -- 172.21.15.100:0/3831168995 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f50a807bed0 con 0x7f50c00a58a0 2024-01-22T05:39:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.175+0000 7f50c5200700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f509805f150 0x7f5098061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.176+0000 7f50c5200700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f509805f150 0x7f5098061610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f50b0005750 tx=0x7f50b0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.179+0000 7f50b7e00700 1 -- 172.21.15.100:0/3831168995 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f50a804cf50 con 0x7f50c00a58a0 2024-01-22T05:39:27.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.354+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c00656d0 con 0x7f50c00a58a0 2024-01-22T05:39:27.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.355+0000 7f50b7e00700 1 -- 172.21.15.100:0/3831168995 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18535 (secure 0 0 0) 0x7f50a8020070 con 0x7f50c00a58a0 2024-01-22T05:39:27.355 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:27.355 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:09.648970+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:38:56.791674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-22T05:38:57.778340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-22T05:39:07.671856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f509805f150 msgr2=0x7f5098061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f509805f150 0x7f5098061610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f50b0005750 tx=0x7f50b0009040).stop 2024-01-22T05:39:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c00a58a0 msgr2=0x7f50c01539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c00a58a0 0x7f50c01539e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f50a8011000 tx=0x7f50a8017000).stop 2024-01-22T05:39:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 shutdown_connections 2024-01-22T05:39:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f509805f150 0x7f5098061610 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00681e0 0x7f50c0139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c00a5c80 0x7f50c0153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 --2- 172.21.15.100:0/3831168995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c00a58a0 0x7f50c01539e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 >> 172.21.15.100:0/3831168995 conn(0x7f50c0063090 msgr2=0x7f50c00bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:27.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 shutdown_connections 2024-01-22T05:39:27.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.357+0000 7f50c7c00700 1 -- 172.21.15.100:0/3831168995 wait complete. 2024-01-22T05:39:27.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:39:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.559+0000 7f1f2dc00700 1 Processor -- start 2024-01-22T05:39:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.559+0000 7f1f2dc00700 1 -- start start 2024-01-22T05:39:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f2dc00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1f28157290 0x7f1f28092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f2dc00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f280c5b80 0x7f1f280c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f2dc00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f28065000 con 0x7f1f28092600 2024-01-22T05:39:27.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f2dc00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280643f0 con 0x7f1f28157290 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f2dc00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280646d0 con 0x7f1f280c5b80 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f26a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1f28157290 0x7f1f28092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f26000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1f28092600 0x7f1f280c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43672/0 (socket says 172.21.15.100:43672) 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.560+0000 7f1f26a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1f28157290 0x7f1f28092110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42964/0 (socket says 172.21.15.100:42964) 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f26000700 1 -- 172.21.15.100:0/692817034 learned_addr learned my addr 172.21.15.100:0/692817034 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f27400700 1 --2- 172.21.15.100:0/692817034 >> v2:172.21.15.169:3300/0 conn(0x7f1f280c5b80 0x7f1f280c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f26a00700 1 -- 172.21.15.100:0/692817034 >> v2:172.21.15.169:3300/0 conn(0x7f1f280c5b80 msgr2=0x7f1f280c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f26a00700 1 --2- 172.21.15.100:0/692817034 >> v2:172.21.15.169:3300/0 conn(0x7f1f280c5b80 0x7f1f280c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f26a00700 1 -- 172.21.15.100:0/692817034 >> v1:172.21.15.100:6789/0 conn(0x7f1f28092600 legacy=0x7f1f280c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f26a00700 1 -- 172.21.15.100:0/692817034 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f280649b0 con 0x7f1f28157290 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f25600700 1 -- 172.21.15.100:0/692817034 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535332697 0 0) 0x7f1f28065000 con 0x7f1f28092600 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f26a00700 1 --2- 172.21.15.100:0/692817034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28157290 0x7f1f28092110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f1f280bf1f0 tx=0x7f1f18009060).ready entity=mon.0 client_cookie=68a92b2c51ffb251 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f25600700 1 -- 172.21.15.100:0/692817034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800f510 con 0x7f1f28157290 2024-01-22T05:39:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f25600700 1 -- 172.21.15.100:0/692817034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1800f670 con 0x7f1f28157290 2024-01-22T05:39:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.561+0000 7f1f25600700 1 -- 172.21.15.100:0/692817034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800f9f0 con 0x7f1f28157290 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 -- 172.21.15.100:0/692817034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28157290 msgr2=0x7f1f28092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/692817034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28157290 0x7f1f28092110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f1f280bf1f0 tx=0x7f1f18009060).stop 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 -- 172.21.15.100:0/692817034 shutdown_connections 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/692817034 >> v2:172.21.15.169:3300/0 conn(0x7f1f280c5b80 0x7f1f280c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/692817034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28157290 0x7f1f28092110 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 -- 172.21.15.100:0/692817034 >> 172.21.15.100:0/692817034 conn(0x7f1f2805e9d0 msgr2=0x7f1f28091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 -- 172.21.15.100:0/692817034 shutdown_connections 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.562+0000 7f1f2dc00700 1 -- 172.21.15.100:0/692817034 wait complete. 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.563+0000 7f1f2dc00700 1 Processor -- start 2024-01-22T05:39:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.564+0000 7f1f2dc00700 1 -- start start 2024-01-22T05:39:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.564+0000 7f1f2dc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28092600 0x7f1f28164d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.564+0000 7f1f2dc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f280c5b80 0x7f1f2814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.564+0000 7f1f2dc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f28157290 0x7f1f2814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.564+0000 7f1f2dc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2814e230 con 0x7f1f28092600 2024-01-22T05:39:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.564+0000 7f1f2dc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280acb20 con 0x7f1f28157290 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.564+0000 7f1f2dc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28150730 con 0x7f1f280c5b80 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28092600 0x7f1f28164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28092600 0x7f1f28164d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42974/0 (socket says 172.21.15.100:42974) 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 -- 172.21.15.100:0/901407721 learned_addr learned my addr 172.21.15.100:0/901407721 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f27400700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f28157290 0x7f1f2814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26000700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f280c5b80 0x7f1f2814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 -- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f280c5b80 msgr2=0x7f1f2814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f280c5b80 0x7f1f2814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 -- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f28157290 msgr2=0x7f1f2814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f28157290 0x7f1f2814dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 -- 172.21.15.100:0/901407721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f180092a0 con 0x7f1f28092600 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f27400700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f28157290 0x7f1f2814dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f26a00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28092600 0x7f1f28164d50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1f18009dd0 tx=0x7f1f18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.565+0000 7f1f1e000700 1 -- 172.21.15.100:0/901407721 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800f9f0 con 0x7f1f28092600 2024-01-22T05:39:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.566+0000 7f1f1e000700 1 -- 172.21.15.100:0/901407721 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18000c90 con 0x7f1f28092600 2024-01-22T05:39:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.566+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f28150a10 con 0x7f1f28092600 2024-01-22T05:39:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.566+0000 7f1f1e000700 1 -- 172.21.15.100:0/901407721 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1801b690 con 0x7f1f28092600 2024-01-22T05:39:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.566+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f280ad050 con 0x7f1f28092600 2024-01-22T05:39:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.567+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2805fdb0 con 0x7f1f28092600 2024-01-22T05:39:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.567+0000 7f1f1e000700 1 -- 172.21.15.100:0/901407721 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1f1801ba40 con 0x7f1f28092600 2024-01-22T05:39:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.568+0000 7f1f1e000700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f0005f150 0x7f1f00061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.568+0000 7f1f1e000700 1 -- 172.21.15.100:0/901407721 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f1f1807bae0 con 0x7f1f28092600 2024-01-22T05:39:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.568+0000 7f1f26000700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f0005f150 0x7f1f00061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.569+0000 7f1f26000700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f0005f150 0x7f1f00061610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1f2814f550 tx=0x7f1f10009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:27.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.572+0000 7f1f1e000700 1 -- 172.21.15.100:0/901407721 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1f1804cb60 con 0x7f1f28092600 2024-01-22T05:39:27.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:27.783+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1f28064c90 con 0x7f1f28092600 2024-01-22T05:39:28.193 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-22T05:39:28.193+0000 7f8b0ae00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:39:28.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.201+0000 7f1f1e000700 1 -- 172.21.15.100:0/901407721 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1f18028020 con 0x7f1f28092600 2024-01-22T05:39:28.364 INFO:tasks.ceph.mds.d.smithi169.stderr: -2874> 2024-01-22T05:39:01.320+0000 7ff6b4a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:39:28.365 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-01-22T05:39:28.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f0005f150 msgr2=0x7f1f00061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:28.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f0005f150 0x7f1f00061610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1f2814f550 tx=0x7f1f10009040).stop 2024-01-22T05:39:28.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28092600 msgr2=0x7f1f28164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28092600 0x7f1f28164d50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1f18009dd0 tx=0x7f1f18017000).stop 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 shutdown_connections 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1f0005f150 0x7f1f00061610 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f28157290 0x7f1f2814dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28092600 0x7f1f28164d50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 --2- 172.21.15.100:0/901407721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f280c5b80 0x7f1f2814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 >> 172.21.15.100:0/901407721 conn(0x7f1f2805e9d0 msgr2=0x7f1f280c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 shutdown_connections 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.204+0000 7f1f2dc00700 1 -- 172.21.15.100:0/901407721 wait complete. 2024-01-22T05:39:28.367 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:39:28.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:39:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.564+0000 7f04d1e00700 1 Processor -- start 2024-01-22T05:39:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.564+0000 7f04d1e00700 1 -- start start 2024-01-22T05:39:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.565+0000 7f04d1e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc1521d0 0x7f04cc0654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.565+0000 7f04d1e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f04cc0c25c0 0x7f04cc0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.565+0000 7f04d1e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc0660a0 con 0x7f04cc150ae0 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.565+0000 7f04d1e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc151d40 con 0x7f04cc0c25c0 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.565+0000 7f04d1e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc065dc0 con 0x7f04cc1521d0 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.565+0000 7f04cb400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f04cc0c25c0 0x7f04cc0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04cb400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f04cc0c25c0 0x7f04cc0c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42986/0 (socket says 172.21.15.100:42986) 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04cb400700 1 -- 172.21.15.100:0/289280799 learned_addr learned my addr 172.21.15.100:0/289280799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04ca000700 1 --2- 172.21.15.100:0/289280799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc1521d0 0x7f04cc0654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04cb400700 1 -- 172.21.15.100:0/289280799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc1521d0 msgr2=0x7f04cc0654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04cb400700 1 --2- 172.21.15.100:0/289280799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc1521d0 0x7f04cc0654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04cb400700 1 -- 172.21.15.100:0/289280799 >> v1:172.21.15.169:6789/0 conn(0x7f04cc150ae0 legacy=0x7f04cc150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04cb400700 1 -- 172.21.15.100:0/289280799 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc1516f0 con 0x7f04cc0c25c0 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04cb400700 1 --2- 172.21.15.100:0/289280799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc0c25c0 0x7f04cc0c55f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f04c4009f20 tx=0x7f04c4009840).ready entity=mon.0 client_cookie=7441de704fdf9d84 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04c9600700 1 -- 172.21.15.100:0/289280799 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400e070 con 0x7f04cc0c25c0 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04c9600700 1 -- 172.21.15.100:0/289280799 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400b9d0 con 0x7f04cc0c25c0 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.566+0000 7f04c9600700 1 -- 172.21.15.100:0/289280799 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400bd50 con 0x7f04cc0c25c0 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 -- 172.21.15.100:0/289280799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc0c25c0 msgr2=0x7f04cc0c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 --2- 172.21.15.100:0/289280799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc0c25c0 0x7f04cc0c55f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f04c4009f20 tx=0x7f04c4009840).stop 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 -- 172.21.15.100:0/289280799 shutdown_connections 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 --2- 172.21.15.100:0/289280799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc0c25c0 0x7f04cc0c55f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 --2- 172.21.15.100:0/289280799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc1521d0 0x7f04cc0654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 -- 172.21.15.100:0/289280799 >> 172.21.15.100:0/289280799 conn(0x7f04cc0630c0 msgr2=0x7f04cc0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 -- 172.21.15.100:0/289280799 shutdown_connections 2024-01-22T05:39:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.567+0000 7f04d1e00700 1 -- 172.21.15.100:0/289280799 wait complete. 2024-01-22T05:39:28.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.568+0000 7f04d1e00700 1 Processor -- start 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.569+0000 7f04d1e00700 1 -- start start 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04d1e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04cc0c25c0 0x7f04cc14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04d1e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc150ae0 0x7f04cc0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04d1e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc1521d0 0x7f04cc13e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04d1e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0c5860 con 0x7f04cc1521d0 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04d1e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0a9ad0 con 0x7f04cc0c25c0 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04d1e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0a9db0 con 0x7f04cc150ae0 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc1521d0 0x7f04cc13e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:28.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc1521d0 0x7f04cc13e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42992/0 (socket says 172.21.15.100:42992) 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 -- 172.21.15.100:0/1240443086 learned_addr learned my addr 172.21.15.100:0/1240443086 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04ca000700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc150ae0 0x7f04cc0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04caa00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04cc0c25c0 0x7f04cc14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 -- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc150ae0 msgr2=0x7f04cc0c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc150ae0 0x7f04cc0c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 -- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04cc0c25c0 msgr2=0x7f04cc14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04cc0c25c0 0x7f04cc14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 -- 172.21.15.100:0/1240443086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4009ae0 con 0x7f04cc1521d0 2024-01-22T05:39:28.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.570+0000 7f04cb400700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc1521d0 0x7f04cc13e480 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f04c4010000 tx=0x7f04cc151e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.571+0000 7f04c2000700 1 -- 172.21.15.100:0/1240443086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c40092e0 con 0x7f04cc1521d0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.571+0000 7f04c2000700 1 -- 172.21.15.100:0/1240443086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4013e30 con 0x7f04cc1521d0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.571+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0aa090 con 0x7f04cc1521d0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.571+0000 7f04c2000700 1 -- 172.21.15.100:0/1240443086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c401e6c0 con 0x7f04cc1521d0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.571+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0c5540 con 0x7f04cc1521d0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.572+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc0aa5b0 con 0x7f04cc1521d0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.573+0000 7f04c2000700 1 -- 172.21.15.100:0/1240443086 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f04c4003040 con 0x7f04cc1521d0 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.573+0000 7f04c2000700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f04a405f150 0x7f04a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:28.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.574+0000 7f04c2000700 1 -- 172.21.15.100:0/1240443086 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6602+0+0 (secure 0 0 0) 0x7f04c407b710 con 0x7f04cc1521d0 2024-01-22T05:39:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.574+0000 7f04caa00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f04a405f150 0x7f04a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.574+0000 7f04caa00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f04a405f150 0x7f04a4061610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f04bc003900 tx=0x7f04bc007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.577+0000 7f04c2000700 1 -- 172.21.15.100:0/1240443086 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04cc0aa5b0 con 0x7f04cc1521d0 2024-01-22T05:39:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:28.787+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04cc0aa5b0 con 0x7f04cc1521d0 2024-01-22T05:39:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.205+0000 7f04c2000700 1 -- 172.21.15.100:0/1240443086 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f04cc0aa5b0 con 0x7f04cc1521d0 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f04a405f150 msgr2=0x7f04a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f04a405f150 0x7f04a4061610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f04bc003900 tx=0x7f04bc007d40).stop 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc1521d0 msgr2=0x7f04cc13e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc1521d0 0x7f04cc13e480 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f04c4010000 tx=0x7f04cc151e80).stop 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 shutdown_connections 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f04a405f150 0x7f04a4061610 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04cc0c25c0 0x7f04cc14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04cc1521d0 0x7f04cc13e480 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 --2- 172.21.15.100:0/1240443086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04cc150ae0 0x7f04cc0c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 >> 172.21.15.100:0/1240443086 conn(0x7f04cc0630c0 msgr2=0x7f04cc069010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:29.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 shutdown_connections 2024-01-22T05:39:29.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.208+0000 7f04d1e00700 1 -- 172.21.15.100:0/1240443086 wait complete. 2024-01-22T05:39:29.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:39:29.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.414+0000 7f8539600700 1 Processor -- start 2024-01-22T05:39:29.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.414+0000 7f8539600700 1 -- start start 2024-01-22T05:39:29.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.415+0000 7f8539600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f85340a9f60 0x7f85340aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.415+0000 7f8539600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f853405e900 0x7f85340ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.415+0000 7f8539600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85340c74b0 con 0x7f85340c1940 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.415+0000 7f8539600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85340cab90 con 0x7f853405e900 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.415+0000 7f8539600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8534158660 con 0x7f85340a9f60 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f853405e900 0x7f85340ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f853405e900 0x7f85340ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43000/0 (socket says 172.21.15.100:43000) 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 -- 172.21.15.100:0/1293736834 learned_addr learned my addr 172.21.15.100:0/1293736834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8532a00700 1 --2- 172.21.15.100:0/1293736834 >> v2:172.21.15.169:3300/0 conn(0x7f85340a9f60 0x7f85340aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 -- 172.21.15.100:0/1293736834 >> v2:172.21.15.169:3300/0 conn(0x7f85340a9f60 msgr2=0x7f85340aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 --2- 172.21.15.100:0/1293736834 >> v2:172.21.15.169:3300/0 conn(0x7f85340a9f60 0x7f85340aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 -- 172.21.15.100:0/1293736834 >> v1:172.21.15.169:6789/0 conn(0x7f85340c1940 legacy=0x7f853405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 -- 172.21.15.100:0/1293736834 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8534158940 con 0x7f853405e900 2024-01-22T05:39:29.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.416+0000 7f8533400700 1 --2- 172.21.15.100:0/1293736834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f853405e900 0x7f85340ca6a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f85340c8850 tx=0x7f852c009840).ready entity=mon.0 client_cookie=14c9cdf8c6bc4bf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:29.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8531600700 1 -- 172.21.15.100:0/1293736834 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c00e070 con 0x7f853405e900 2024-01-22T05:39:29.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8531600700 1 -- 172.21.15.100:0/1293736834 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c00ba20 con 0x7f853405e900 2024-01-22T05:39:29.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8531600700 1 -- 172.21.15.100:0/1293736834 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c00bda0 con 0x7f853405e900 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 -- 172.21.15.100:0/1293736834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f853405e900 msgr2=0x7f85340ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 --2- 172.21.15.100:0/1293736834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f853405e900 0x7f85340ca6a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f85340c8850 tx=0x7f852c009840).stop 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 -- 172.21.15.100:0/1293736834 shutdown_connections 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 --2- 172.21.15.100:0/1293736834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f853405e900 0x7f85340ca6a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 --2- 172.21.15.100:0/1293736834 >> v2:172.21.15.169:3300/0 conn(0x7f85340a9f60 0x7f85340aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 -- 172.21.15.100:0/1293736834 >> 172.21.15.100:0/1293736834 conn(0x7f85340cada0 msgr2=0x7f85340cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 -- 172.21.15.100:0/1293736834 shutdown_connections 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.417+0000 7f8539600700 1 -- 172.21.15.100:0/1293736834 wait complete. 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.419+0000 7f8539600700 1 Processor -- start 2024-01-22T05:39:29.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.419+0000 7f8539600700 1 -- start start 2024-01-22T05:39:29.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8539600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853405e900 0x7f8534156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8539600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85340a9f60 0x7f85340c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8539600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85340c1940 0x7f85341538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8539600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534156970 con 0x7f85340a9f60 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8539600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534157440 con 0x7f85340c1940 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8539600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85340aa990 con 0x7f853405e900 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8532000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85340a9f60 0x7f85340c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8532000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85340a9f60 0x7f85340c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43010/0 (socket says 172.21.15.100:43010) 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8532000700 1 -- 172.21.15.100:0/3772098594 learned_addr learned my addr 172.21.15.100:0/3772098594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8533400700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85340c1940 0x7f85341538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.420+0000 7f8532a00700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853405e900 0x7f8534156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8532000700 1 -- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853405e900 msgr2=0x7f8534156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8532000700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853405e900 0x7f8534156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8532000700 1 -- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85340c1940 msgr2=0x7f85341538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8532000700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85340c1940 0x7f85341538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8532000700 1 -- 172.21.15.100:0/3772098594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c009ae0 con 0x7f85340a9f60 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8533400700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85340c1940 0x7f85341538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8532000700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85340a9f60 0x7f85340c31d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f851c00c4c0 tx=0x7f851c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f852a000700 1 -- 172.21.15.100:0/3772098594 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c007020 con 0x7f85340a9f60 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f852a000700 1 -- 172.21.15.100:0/3772098594 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c001e90 con 0x7f85340a9f60 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f852a000700 1 -- 172.21.15.100:0/3772098594 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0073d0 con 0x7f85340a9f60 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8534156ba0 con 0x7f85340a9f60 2024-01-22T05:39:29.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.421+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8534157160 con 0x7f85340a9f60 2024-01-22T05:39:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.422+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85340aaad0 con 0x7f85340a9f60 2024-01-22T05:39:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.423+0000 7f852a000700 1 -- 172.21.15.100:0/3772098594 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f851c0068b0 con 0x7f85340a9f60 2024-01-22T05:39:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.424+0000 7f852a000700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f850c05f150 0x7f850c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.424+0000 7f852a000700 1 -- 172.21.15.100:0/3772098594 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6602+0+0 (secure 0 0 0) 0x7f851c079cd0 con 0x7f85340a9f60 2024-01-22T05:39:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.424+0000 7f8532a00700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f850c05f150 0x7f850c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:29.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.424+0000 7f8532a00700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f850c05f150 0x7f850c061610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f8524009c30 tx=0x7f8524009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:29.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.428+0000 7f852a000700 1 -- 172.21.15.100:0/3772098594 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f851c04ad00 con 0x7f85340a9f60 2024-01-22T05:39:29.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:29.600+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f853405fdb0 con 0x7f85340a9f60 2024-01-22T05:39:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.212+0000 7f852a000700 1 -- 172.21.15.100:0/3772098594 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7f851c04e320 con 0x7f85340a9f60 2024-01-22T05:39:30.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f850c05f150 msgr2=0x7f850c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:30.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f850c05f150 0x7f850c061610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f8524009c30 tx=0x7f8524009060).stop 2024-01-22T05:39:30.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85340a9f60 msgr2=0x7f85340c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:30.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85340a9f60 0x7f85340c31d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f851c00c4c0 tx=0x7f851c007e00).stop 2024-01-22T05:39:30.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 shutdown_connections 2024-01-22T05:39:30.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f850c05f150 0x7f850c061610 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85340c1940 0x7f85341538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853405e900 0x7f8534156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 --2- 172.21.15.100:0/3772098594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85340a9f60 0x7f85340c31d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.215+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 >> 172.21.15.100:0/3772098594 conn(0x7f85340cada0 msgr2=0x7f85340bfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:30.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.216+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 shutdown_connections 2024-01-22T05:39:30.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.216+0000 7f8539600700 1 -- 172.21.15.100:0/3772098594 wait complete. 2024-01-22T05:39:30.219 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:39:30.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:39:30.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.425+0000 7f5616c00700 1 Processor -- start 2024-01-22T05:39:30.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.426+0000 7f5616c00700 1 -- start start 2024-01-22T05:39:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f5616c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5610154260 0x7f56100cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f5616c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f56100c5c80 0x7f56100c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f5616c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56100c1a40 con 0x7f56100c65f0 2024-01-22T05:39:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f5616c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56100cbd30 con 0x7f56100c5c80 2024-01-22T05:39:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f5616c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56100c6aa0 con 0x7f5610154260 2024-01-22T05:39:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f5614c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f56100c65f0 0x7f5610157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43682/0 (socket says 172.21.15.100:43682) 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f5614c00700 1 -- 172.21.15.100:0/280251924 learned_addr learned my addr 172.21.15.100:0/280251924 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f560f400700 1 --2- 172.21.15.100:0/280251924 >> v2:172.21.15.100:3300/0 conn(0x7f56100c5c80 0x7f56100c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f560fe00700 1 --2- 172.21.15.100:0/280251924 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5610154260 0x7f56100cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.427+0000 7f560ea00700 1 -- 172.21.15.100:0/280251924 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268431542 0 0) 0x7f56100c1a40 con 0x7f56100c65f0 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560ea00700 1 -- 172.21.15.100:0/280251924 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f00033f0 con 0x7f56100c65f0 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560f400700 1 -- 172.21.15.100:0/280251924 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5610154260 msgr2=0x7f56100cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560f400700 1 --2- 172.21.15.100:0/280251924 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5610154260 0x7f56100cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560f400700 1 -- 172.21.15.100:0/280251924 >> v1:172.21.15.100:6789/0 conn(0x7f56100c65f0 legacy=0x7f5610157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560ea00700 1 -- 172.21.15.100:0/280251924 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1888470707 0 0) 0x7f55f00033f0 con 0x7f56100c65f0 2024-01-22T05:39:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560f400700 1 -- 172.21.15.100:0/280251924 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56100c1110 con 0x7f56100c5c80 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560f400700 1 --2- 172.21.15.100:0/280251924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56100c5c80 0x7f56100c6100 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f55f8009790 tx=0x7f55f8009060).ready entity=mon.0 client_cookie=1a99c0da5e21eb99 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560ea00700 1 -- 172.21.15.100:0/280251924 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080017f0 con 0x7f56100c5c80 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560ea00700 1 -- 172.21.15.100:0/280251924 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f8011400 con 0x7f56100c5c80 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.428+0000 7f560ea00700 1 -- 172.21.15.100:0/280251924 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8011780 con 0x7f56100c5c80 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 -- 172.21.15.100:0/280251924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56100c5c80 msgr2=0x7f56100c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 --2- 172.21.15.100:0/280251924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56100c5c80 0x7f56100c6100 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f55f8009790 tx=0x7f55f8009060).stop 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 -- 172.21.15.100:0/280251924 shutdown_connections 2024-01-22T05:39:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 --2- 172.21.15.100:0/280251924 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5610154260 0x7f56100cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 --2- 172.21.15.100:0/280251924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56100c5c80 0x7f56100c6100 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 -- 172.21.15.100:0/280251924 >> 172.21.15.100:0/280251924 conn(0x7f561005e9d0 msgr2=0x7f56100cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 -- 172.21.15.100:0/280251924 shutdown_connections 2024-01-22T05:39:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.429+0000 7f5616c00700 1 -- 172.21.15.100:0/280251924 wait complete. 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.430+0000 7f5616c00700 1 Processor -- start 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.430+0000 7f5616c00700 1 -- start start 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.431+0000 7f5616c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56100c5c80 0x7f56100c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.431+0000 7f5616c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56100c65f0 0x7f56101527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.431+0000 7f5616c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5610154260 0x7f56100abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.431+0000 7f5616c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100ab760 con 0x7f5610154260 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.431+0000 7f5616c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100aa8b0 con 0x7f56100c65f0 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.431+0000 7f5616c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56100aab50 con 0x7f56100c5c80 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5610154260 0x7f56100abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5610154260 0x7f56100abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43034/0 (socket says 172.21.15.100:43034) 2024-01-22T05:39:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 -- 172.21.15.100:0/2431642521 learned_addr learned my addr 172.21.15.100:0/2431642521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:30.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f560fe00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56100c5c80 0x7f56100c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:30.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 -- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56100c5c80 msgr2=0x7f56100c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:30.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f560f400700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56100c65f0 0x7f56101527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:30.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56100c5c80 0x7f56100c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 -- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56100c65f0 msgr2=0x7f56101527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:30.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56100c65f0 0x7f56101527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:30.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 -- 172.21.15.100:0/2431642521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80092a0 con 0x7f5610154260 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f560fe00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56100c5c80 0x7f56100c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5614c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5610154260 0x7f56100abbf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f560800cb90 tx=0x7f5608001920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5607400700 1 -- 172.21.15.100:0/2431642521 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608004c40 con 0x7f5610154260 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5607400700 1 -- 172.21.15.100:0/2431642521 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608004da0 con 0x7f5610154260 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5607400700 1 -- 172.21.15.100:0/2431642521 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608007380 con 0x7f5610154260 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.432+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56100aae30 con 0x7f5610154260 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.433+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56100ab3f0 con 0x7f5610154260 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.434+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561005fdb0 con 0x7f5610154260 2024-01-22T05:39:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.434+0000 7f5607400700 1 -- 172.21.15.100:0/2431642521 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5608007770 con 0x7f5610154260 2024-01-22T05:39:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.435+0000 7f5607400700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f55e805f150 0x7f55e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.436+0000 7f5607400700 1 -- 172.21.15.100:0/2431642521 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6164+0+0 (secure 0 0 0) 0x7f560807a2a0 con 0x7f5610154260 2024-01-22T05:39:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.436+0000 7f560fe00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f55e805f150 0x7f55e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.436+0000 7f560fe00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f55e805f150 0x7f55e8061610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f5600006d20 tx=0x7f5600008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.440+0000 7f5607400700 1 -- 172.21.15.100:0/2431642521 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f560804b480 con 0x7f5610154260 2024-01-22T05:39:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:30.620+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5610064000 con 0x7f5610154260 2024-01-22T05:39:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.214+0000 7f5607400700 1 -- 172.21.15.100:0/2431642521 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f560804eaa0 con 0x7f5610154260 2024-01-22T05:39:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f55e805f150 msgr2=0x7f55e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f55e805f150 0x7f55e8061610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f5600006d20 tx=0x7f5600008040).stop 2024-01-22T05:39:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5610154260 msgr2=0x7f56100abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5610154260 0x7f56100abbf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f560800cb90 tx=0x7f5608001920).stop 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 shutdown_connections 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f55e805f150 0x7f55e8061610 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5610154260 0x7f56100abbf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56100c5c80 0x7f56100c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 --2- 172.21.15.100:0/2431642521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56100c65f0 0x7f56101527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 >> 172.21.15.100:0/2431642521 conn(0x7f561005e9d0 msgr2=0x7f56100647a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 shutdown_connections 2024-01-22T05:39:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.217+0000 7f5616c00700 1 -- 172.21.15.100:0/2431642521 wait complete. 2024-01-22T05:39:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-01-22T05:39:31.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-01-22T05:39:31.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.429+0000 7f2dbf600700 1 Processor -- start 2024-01-22T05:39:31.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.429+0000 7f2dbf600700 1 -- start start 2024-01-22T05:39:31.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.430+0000 7f2dbf600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2db80c5340 0x7f2db8064c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:31.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.430+0000 7f2dbf600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c5e30 0x7f2db80c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:31.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.430+0000 7f2dbf600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db80c7060 con 0x7f2db80c6c00 2024-01-22T05:39:31.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.430+0000 7f2dbf600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80c62c0 con 0x7f2db80c5340 2024-01-22T05:39:31.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.430+0000 7f2dbf600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80c2760 con 0x7f2db80c5e30 2024-01-22T05:39:31.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2db7e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2db80c6c00 0x7f2db80c5720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43686/0 (socket says 172.21.15.100:43686) 2024-01-22T05:39:31.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2db7e00700 1 -- 172.21.15.100:0/3117710154 learned_addr learned my addr 172.21.15.100:0/3117710154 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:31.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2dbd600700 1 --2- 172.21.15.100:0/3117710154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c5e30 0x7f2db80c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:31.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2dbcc00700 1 --2- 172.21.15.100:0/3117710154 >> v2:172.21.15.169:3300/0 conn(0x7f2db80c5340 0x7f2db8064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2db7400700 1 -- 172.21.15.100:0/3117710154 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729746362 0 0) 0x7f2da0001110 con 0x7f2db80c6c00 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2db7400700 1 -- 172.21.15.100:0/3117710154 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d980033f0 con 0x7f2db80c6c00 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2dbd600700 1 -- 172.21.15.100:0/3117710154 >> v2:172.21.15.169:3300/0 conn(0x7f2db80c5340 msgr2=0x7f2db8064c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2dbd600700 1 --2- 172.21.15.100:0/3117710154 >> v2:172.21.15.169:3300/0 conn(0x7f2db80c5340 0x7f2db8064c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2dbd600700 1 -- 172.21.15.100:0/3117710154 >> v1:172.21.15.100:6789/0 conn(0x7f2db80c6c00 legacy=0x7f2db80c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2db7400700 1 -- 172.21.15.100:0/3117710154 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978454483 0 0) 0x7f2d980033f0 con 0x7f2db80c6c00 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2dbd600700 1 -- 172.21.15.100:0/3117710154 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80c6820 con 0x7f2db80c5e30 2024-01-22T05:39:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.431+0000 7f2dbcc00700 1 --2- 172.21.15.100:0/3117710154 >> v2:172.21.15.169:3300/0 conn(0x7f2db80c5340 0x7f2db8064c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbd600700 1 --2- 172.21.15.100:0/3117710154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c5e30 0x7f2db80c2270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2db0009e60 tx=0x7f2db0009780).ready entity=mon.2 client_cookie=c3cd35b11bce717f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2db7400700 1 -- 172.21.15.100:0/3117710154 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000e070 con 0x7f2db80c5e30 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2db7400700 1 -- 172.21.15.100:0/3117710154 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000bab0 con 0x7f2db80c5e30 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2db7400700 1 -- 172.21.15.100:0/3117710154 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000be30 con 0x7f2db80c5e30 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbf600700 1 -- 172.21.15.100:0/3117710154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c5e30 msgr2=0x7f2db80c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbf600700 1 --2- 172.21.15.100:0/3117710154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c5e30 0x7f2db80c2270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2db0009e60 tx=0x7f2db0009780).stop 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbf600700 1 -- 172.21.15.100:0/3117710154 shutdown_connections 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbf600700 1 --2- 172.21.15.100:0/3117710154 >> v2:172.21.15.169:3300/0 conn(0x7f2db80c5340 0x7f2db8064c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbf600700 1 --2- 172.21.15.100:0/3117710154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c5e30 0x7f2db80c2270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbf600700 1 -- 172.21.15.100:0/3117710154 >> 172.21.15.100:0/3117710154 conn(0x7f2db80c3ca0 msgr2=0x7f2db80c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.432+0000 7f2dbf600700 1 -- 172.21.15.100:0/3117710154 shutdown_connections 2024-01-22T05:39:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.433+0000 7f2dbf600700 1 -- 172.21.15.100:0/3117710154 wait complete. 2024-01-22T05:39:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.434+0000 7f2dbf600700 1 Processor -- start 2024-01-22T05:39:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.434+0000 7f2dbf600700 1 -- start start 2024-01-22T05:39:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbf600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db80c5340 0x7f2db80a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbf600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80c5e30 0x7f2db80c0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbf600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c6c00 0x7f2db814d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbf600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80a7ca0 con 0x7f2db80c5340 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbf600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80c1030 con 0x7f2db80c5e30 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbf600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db814d540 con 0x7f2db80c6c00 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbcc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db80c5340 0x7f2db80a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbcc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db80c5340 0x7f2db80a77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43048/0 (socket says 172.21.15.100:43048) 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.435+0000 7f2dbcc00700 1 -- 172.21.15.100:0/862161810 learned_addr learned my addr 172.21.15.100:0/862161810 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2db7e00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80c5e30 0x7f2db80c0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbcc00700 1 -- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c6c00 msgr2=0x7f2db814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbcc00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c6c00 0x7f2db814d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbcc00700 1 -- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80c5e30 msgr2=0x7f2db80c0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbcc00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80c5e30 0x7f2db80c0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbcc00700 1 -- 172.21.15.100:0/862161810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da80092a0 con 0x7f2db80c5340 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2db7e00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80c5e30 0x7f2db80c0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbcc00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db80c5340 0x7f2db80a77b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f2da800e980 tx=0x7f2da8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dafe00700 1 -- 172.21.15.100:0/862161810 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800c850 con 0x7f2db80c5340 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dafe00700 1 -- 172.21.15.100:0/862161810 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800c9b0 con 0x7f2db80c5340 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dafe00700 1 -- 172.21.15.100:0/862161810 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800cd30 con 0x7f2db80c5340 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db0009a20 con 0x7f2db80c5340 2024-01-22T05:39:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.436+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db80a8750 con 0x7f2db80c5340 2024-01-22T05:39:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.437+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db805fdb0 con 0x7f2db80c5340 2024-01-22T05:39:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.438+0000 7f2dafe00700 1 -- 172.21.15.100:0/862161810 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2da8012600 con 0x7f2db80c5340 2024-01-22T05:39:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.439+0000 7f2dafe00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d9005f150 0x7f2d90061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.439+0000 7f2dafe00700 1 -- 172.21.15.100:0/862161810 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5750+0+0 (secure 0 0 0) 0x7f2da807a6e0 con 0x7f2db80c5340 2024-01-22T05:39:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.439+0000 7f2db7e00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d9005f150 0x7f2d90061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.440+0000 7f2db7e00700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d9005f150 0x7f2d90061610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2db80c0660 tx=0x7f2da0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.443+0000 7f2dafe00700 1 -- 172.21.15.100:0/862161810 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2da804ba60 con 0x7f2db80c5340 2024-01-22T05:39:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:31.616+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2db80a85b0 con 0x7f2db80c5340 2024-01-22T05:39:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.217+0000 7f2dafe00700 1 -- 172.21.15.100:0/862161810 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v43) v1 ==== 160+0+0 (secure 0 0 0) 0x7f2db80a85b0 con 0x7f2db80c5340 2024-01-22T05:39:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d9005f150 msgr2=0x7f2d90061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d9005f150 0x7f2d90061610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2db80c0660 tx=0x7f2da0009040).stop 2024-01-22T05:39:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db80c5340 msgr2=0x7f2db80a77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db80c5340 0x7f2db80a77b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f2da800e980 tx=0x7f2da8009060).stop 2024-01-22T05:39:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 shutdown_connections 2024-01-22T05:39:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2d9005f150 0x7f2d90061610 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db80c6c00 0x7f2db814d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db80c5340 0x7f2db80a77b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 --2- 172.21.15.100:0/862161810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80c5e30 0x7f2db80c0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.220+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 >> 172.21.15.100:0/862161810 conn(0x7f2db80c3ca0 msgr2=0x7f2db80a5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.221+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 shutdown_connections 2024-01-22T05:39:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.221+0000 7f2dbf600700 1 -- 172.21.15.100:0/862161810 wait complete. 2024-01-22T05:39:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'data_new' removed 2024-01-22T05:39:32.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:39:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.431+0000 7f2707400700 1 Processor -- start 2024-01-22T05:39:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.431+0000 7f2707400700 1 -- start start 2024-01-22T05:39:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.432+0000 7f2707400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f27000a9f60 0x7f27000aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.432+0000 7f2707400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27000c1940 0x7f27000ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.432+0000 7f2707400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270005e1f0 0x7f270005e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.432+0000 7f2707400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000c74b0 con 0x7f27000c1940 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.432+0000 7f2707400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000cab90 con 0x7f27000a9f60 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.432+0000 7f2707400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270005eb70 con 0x7f270005e1f0 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.432+0000 7f26ffe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27000c1940 0x7f27000ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27000c1940 0x7f27000ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43054/0 (socket says 172.21.15.100:43054) 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 -- 172.21.15.100:0/487975243 learned_addr learned my addr 172.21.15.100:0/487975243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f2705400700 1 --2- 172.21.15.100:0/487975243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270005e1f0 0x7f270005e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f2704a00700 1 --2- 172.21.15.100:0/487975243 >> v2:172.21.15.169:3300/0 conn(0x7f27000a9f60 0x7f27000aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 -- 172.21.15.100:0/487975243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270005e1f0 msgr2=0x7f270005e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 --2- 172.21.15.100:0/487975243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270005e1f0 0x7f270005e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 -- 172.21.15.100:0/487975243 >> v2:172.21.15.169:3300/0 conn(0x7f27000a9f60 msgr2=0x7f27000aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 --2- 172.21.15.100:0/487975243 >> v2:172.21.15.169:3300/0 conn(0x7f27000a9f60 0x7f27000aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 -- 172.21.15.100:0/487975243 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700158660 con 0x7f27000c1940 2024-01-22T05:39:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ffe00700 1 --2- 172.21.15.100:0/487975243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c1940 0x7f27000ca6a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f27000c8850 tx=0x7f26e80090f0).ready entity=mon.0 client_cookie=f78e154343f78014 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ff400700 1 -- 172.21.15.100:0/487975243 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e800f510 con 0x7f27000c1940 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ff400700 1 -- 172.21.15.100:0/487975243 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e800f670 con 0x7f27000c1940 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.433+0000 7f26ff400700 1 -- 172.21.15.100:0/487975243 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e800f9f0 con 0x7f27000c1940 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 -- 172.21.15.100:0/487975243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c1940 msgr2=0x7f27000ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 --2- 172.21.15.100:0/487975243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c1940 0x7f27000ca6a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f27000c8850 tx=0x7f26e80090f0).stop 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 -- 172.21.15.100:0/487975243 shutdown_connections 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 --2- 172.21.15.100:0/487975243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270005e1f0 0x7f270005e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 --2- 172.21.15.100:0/487975243 >> v2:172.21.15.169:3300/0 conn(0x7f27000a9f60 0x7f27000aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 --2- 172.21.15.100:0/487975243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27000c1940 0x7f27000ca6a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 -- 172.21.15.100:0/487975243 >> 172.21.15.100:0/487975243 conn(0x7f27000cada0 msgr2=0x7f27000cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 -- 172.21.15.100:0/487975243 shutdown_connections 2024-01-22T05:39:32.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.434+0000 7f2707400700 1 -- 172.21.15.100:0/487975243 wait complete. 2024-01-22T05:39:32.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.436+0000 7f2707400700 1 Processor -- start 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.436+0000 7f2707400700 1 -- start start 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2707400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f270005e1f0 0x7f2700147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2707400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000a9f60 0x7f27000ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2707400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000c1940 0x7f27000add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2707400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000c2e30 con 0x7f270005e1f0 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2707400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000c2220 con 0x7f27000a9f60 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2707400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000c2500 con 0x7f27000c1940 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f270005e1f0 0x7f2700147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f270005e1f0 0x7f2700147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43064/0 (socket says 172.21.15.100:43064) 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 -- 172.21.15.100:0/952191390 learned_addr learned my addr 172.21.15.100:0/952191390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f26ffe00700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000a9f60 0x7f27000ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2705400700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000c1940 0x7f27000add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 -- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000c1940 msgr2=0x7f27000add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000c1940 0x7f27000add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 -- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000a9f60 msgr2=0x7f27000ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000a9f60 0x7f27000ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.437+0000 7f2704a00700 1 -- 172.21.15.100:0/952191390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e8009370 con 0x7f270005e1f0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.438+0000 7f2704a00700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f270005e1f0 0x7f2700147690 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f26f000e900 tx=0x7f26f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.438+0000 7f26f7e00700 1 -- 172.21.15.100:0/952191390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000c640 con 0x7f270005e1f0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.438+0000 7f26f7e00700 1 -- 172.21.15.100:0/952191390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000c7a0 con 0x7f270005e1f0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.438+0000 7f26f7e00700 1 -- 172.21.15.100:0/952191390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000cb20 con 0x7f270005e1f0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.438+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27000c27e0 con 0x7f270005e1f0 2024-01-22T05:39:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.438+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27000c1e40 con 0x7f270005e1f0 2024-01-22T05:39:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.439+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270005fdb0 con 0x7f270005e1f0 2024-01-22T05:39:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.440+0000 7f26f7e00700 1 -- 172.21.15.100:0/952191390 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f26f001b400 con 0x7f270005e1f0 2024-01-22T05:39:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.440+0000 7f26f7e00700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.440+0000 7f26f7e00700 1 -- 172.21.15.100:0/952191390 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f26f007a300 con 0x7f270005e1f0 2024-01-22T05:39:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.441+0000 7f26ffe00700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.441+0000 7f26ffe00700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f26e8009130 tx=0x7f26e8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.444+0000 7f26f7e00700 1 -- 172.21.15.100:0/952191390 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f26f004b870 con 0x7f270005e1f0 2024-01-22T05:39:32.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.615+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f27000ca030 con 0x7f270005e1f0 2024-01-22T05:39:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.619+0000 7f26f7e00700 1 -- 172.21.15.100:0/952191390 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f26f0016020 con 0x7f270005e1f0 2024-01-22T05:39:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 msgr2=0x7f26d8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f26e8009130 tx=0x7f26e8017000).stop 2024-01-22T05:39:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f270005e1f0 msgr2=0x7f2700147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f270005e1f0 0x7f2700147690 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f26f000e900 tx=0x7f26f0009060).stop 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 shutdown_connections 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f26d805f150 0x7f26d8061610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27000c1940 0x7f27000add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f270005e1f0 0x7f2700147690 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 --2- 172.21.15.100:0/952191390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27000a9f60 0x7f27000ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 >> 172.21.15.100:0/952191390 conn(0x7f27000cada0 msgr2=0x7f2700153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 shutdown_connections 2024-01-22T05:39:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.621+0000 7f2707400700 1 -- 172.21.15.100:0/952191390 wait complete. 2024-01-22T05:39:32.640 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-01-22T05:39:32.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.823+0000 7f5531600700 1 Processor -- start 2024-01-22T05:39:32.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.823+0000 7f5531600700 1 -- start start 2024-01-22T05:39:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.824+0000 7f5531600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f552c0a5ab0 0x7f552c0a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.824+0000 7f5531600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 0x7f552c153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.824+0000 7f5531600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c065760 con 0x7f552c0c0fc0 2024-01-22T05:39:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.824+0000 7f5531600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0bc340 con 0x7f552c0a5ab0 2024-01-22T05:39:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.824+0000 7f5531600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c06a780 con 0x7f552c06a290 2024-01-22T05:39:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.824+0000 7f552aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f552c0a5ab0 0x7f552c0a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f552a000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f552c0c0fc0 0x7f552c069b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43690/0 (socket says 172.21.15.100:43690) 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f552a000700 1 -- 172.21.15.100:0/598708952 learned_addr learned my addr 172.21.15.100:0/598708952 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f552aa00700 1 -- 172.21.15.100:0/598708952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 msgr2=0x7f552c153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f552aa00700 1 --2- 172.21.15.100:0/598708952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 0x7f552c153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f552aa00700 1 -- 172.21.15.100:0/598708952 >> v1:172.21.15.100:6789/0 conn(0x7f552c0c0fc0 legacy=0x7f552c069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f552aa00700 1 -- 172.21.15.100:0/598708952 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0bba50 con 0x7f552c0a5ab0 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f5529600700 1 -- 172.21.15.100:0/598708952 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223177391 0 0) 0x7f552c065760 con 0x7f552c0c0fc0 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f552aa00700 1 --2- 172.21.15.100:0/598708952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0a5ab0 0x7f552c0a5e90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f551c009760 tx=0x7f551c009060).ready entity=mon.0 client_cookie=c507d3c3f5a3dd40 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f5529600700 1 -- 172.21.15.100:0/598708952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0090d0 con 0x7f552c0a5ab0 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f5529600700 1 -- 172.21.15.100:0/598708952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c00b580 con 0x7f552c0a5ab0 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.825+0000 7f5529600700 1 -- 172.21.15.100:0/598708952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c00b900 con 0x7f552c0a5ab0 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 -- 172.21.15.100:0/598708952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0a5ab0 msgr2=0x7f552c0a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 --2- 172.21.15.100:0/598708952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0a5ab0 0x7f552c0a5e90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f551c009760 tx=0x7f551c009060).stop 2024-01-22T05:39:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 -- 172.21.15.100:0/598708952 shutdown_connections 2024-01-22T05:39:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 --2- 172.21.15.100:0/598708952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0a5ab0 0x7f552c0a5e90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 --2- 172.21.15.100:0/598708952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 0x7f552c153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 -- 172.21.15.100:0/598708952 >> 172.21.15.100:0/598708952 conn(0x7f552c063090 msgr2=0x7f552c0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 -- 172.21.15.100:0/598708952 shutdown_connections 2024-01-22T05:39:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.826+0000 7f5531600700 1 -- 172.21.15.100:0/598708952 wait complete. 2024-01-22T05:39:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.827+0000 7f5531600700 1 Processor -- start 2024-01-22T05:39:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.828+0000 7f5531600700 1 -- start start 2024-01-22T05:39:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.828+0000 7f5531600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 0x7f552c14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f5531600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c0a5ab0 0x7f552c150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f5531600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0c0fc0 0x7f552c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f5531600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c151590 con 0x7f552c0c0fc0 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f5531600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c165210 con 0x7f552c0a5ab0 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f5531600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c14c9f0 con 0x7f552c06a290 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0c0fc0 0x7f552c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0c0fc0 0x7f552c1510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43094/0 (socket says 172.21.15.100:43094) 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 -- 172.21.15.100:0/93155158 learned_addr learned my addr 172.21.15.100:0/93155158 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552aa00700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 0x7f552c14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552a000700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c0a5ab0 0x7f552c150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 -- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 msgr2=0x7f552c14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 0x7f552c14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 -- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c0a5ab0 msgr2=0x7f552c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c0a5ab0 0x7f552c150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 -- 172.21.15.100:0/93155158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0092a0 con 0x7f552c0c0fc0 2024-01-22T05:39:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.829+0000 7f552b400700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0c0fc0 0x7f552c1510a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f552400bc60 tx=0x7f5524009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.830+0000 7f5522000700 1 -- 172.21.15.100:0/93155158 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400c630 con 0x7f552c0c0fc0 2024-01-22T05:39:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.830+0000 7f5522000700 1 -- 172.21.15.100:0/93155158 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524010070 con 0x7f552c0c0fc0 2024-01-22T05:39:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.830+0000 7f5522000700 1 -- 172.21.15.100:0/93155158 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400c7b0 con 0x7f552c0c0fc0 2024-01-22T05:39:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.830+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c14bf70 con 0x7f552c0c0fc0 2024-01-22T05:39:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.830+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c164bc0 con 0x7f552c0c0fc0 2024-01-22T05:39:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.831+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c1653c0 con 0x7f552c0c0fc0 2024-01-22T05:39:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.832+0000 7f5522000700 1 -- 172.21.15.100:0/93155158 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f552400cb60 con 0x7f552c0c0fc0 2024-01-22T05:39:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.832+0000 7f5522000700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f550405f150 0x7f5504061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.832+0000 7f5522000700 1 -- 172.21.15.100:0/93155158 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f55240796e0 con 0x7f552c0c0fc0 2024-01-22T05:39:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.833+0000 7f552aa00700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f550405f150 0x7f5504061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.833+0000 7f552aa00700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f550405f150 0x7f5504061610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f552c1535d0 tx=0x7f551c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:32.836+0000 7f5522000700 1 -- 172.21.15.100:0/93155158 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f552c1653c0 con 0x7f552c0c0fc0 2024-01-22T05:39:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.072+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f552c1653c0 con 0x7f552c0c0fc0 2024-01-22T05:39:33.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.225+0000 7f5522000700 1 -- 172.21.15.100:0/93155158 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v102) v1 ==== 147+0+0 (secure 0 0 0) 0x7f552c1653c0 con 0x7f552c0c0fc0 2024-01-22T05:39:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f550405f150 msgr2=0x7f5504061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:33.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f550405f150 0x7f5504061610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f552c1535d0 tx=0x7f551c017000).stop 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0c0fc0 msgr2=0x7f552c1510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0c0fc0 0x7f552c1510a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f552400bc60 tx=0x7f5524009840).stop 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 shutdown_connections 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f550405f150 0x7f5504061610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f552c0c0fc0 0x7f552c1510a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f552c06a290 0x7f552c14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 --2- 172.21.15.100:0/93155158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f552c0a5ab0 0x7f552c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 >> 172.21.15.100:0/93155158 conn(0x7f552c063090 msgr2=0x7f552c064300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.227+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 shutdown_connections 2024-01-22T05:39:33.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.228+0000 7f5531600700 1 -- 172.21.15.100:0/93155158 wait complete. 2024-01-22T05:39:33.246 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-01-22T05:39:33.246 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-22T05:39:33.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-01-22T05:39:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.430+0000 7f19e7200700 1 Processor -- start 2024-01-22T05:39:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.430+0000 7f19e7200700 1 -- start start 2024-01-22T05:39:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.431+0000 7f19e7200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f19e00aa4d0 0x7f19e00c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.431+0000 7f19e7200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19e00c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.431+0000 7f19e7200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00a9250 con 0x7f19e0153fd0 2024-01-22T05:39:33.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.431+0000 7f19e7200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e00a8640 con 0x7f19e00aa4d0 2024-01-22T05:39:33.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.431+0000 7f19e7200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00a8920 con 0x7f19e00a96e0 2024-01-22T05:39:33.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dfe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f19e0153fd0 0x7f19e00a9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53580/0 (socket says 172.21.15.100:53580) 2024-01-22T05:39:33.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dfe00700 1 -- 172.21.15.100:0/2480852855 learned_addr learned my addr 172.21.15.100:0/2480852855 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:33.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19df400700 1 --2- 172.21.15.100:0/2480852855 >> v2:172.21.15.169:3300/0 conn(0x7f19e00aa4d0 0x7f19e00c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19e5200700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19e00c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225309703 0 0) 0x7f19e00a9250 con 0x7f19e0153fd0 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c00033f0 con 0x7f19e0153fd0 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1162641151 0 0) 0x7f19c00033f0 con 0x7f19e0153fd0 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 msgr2=0x7f19e00c0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19e00c0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 >> v2:172.21.15.169:3300/0 conn(0x7f19e00aa4d0 msgr2=0x7f19e00c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 --2- 172.21.15.100:0/2480852855 >> v2:172.21.15.169:3300/0 conn(0x7f19e00aa4d0 0x7f19e00c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00a8c00 con 0x7f19e0153fd0 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f19d0001470 con 0x7f19e0153fd0 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.432+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 >> v1:172.21.15.100:6789/0 conn(0x7f19e0153fd0 legacy=0x7f19e00a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19dea00700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19c00038e0 0x7f19c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19dea00700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19c0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19dea00700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19c0004b80 0x7f19c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00a8640 con 0x7f19c0004b80 2024-01-22T05:39:33.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00a8920 con 0x7f19c00038e0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c000b8e0 con 0x7f19e00a96e0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19e5200700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19c0004b80 0x7f19c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19df400700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19c0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19dfe00700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19c00038e0 0x7f19c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19df400700 1 -- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19c00038e0 msgr2=0x7f19c0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19df400700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19c00038e0 0x7f19c0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19df400700 1 -- 172.21.15.100:0/2480852855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19c0004b80 msgr2=0x7f19c0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19df400700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19c0004b80 0x7f19c0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19df400700 1 -- 172.21.15.100:0/2480852855 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00033f0 con 0x7f19e00a96e0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.433+0000 7f19e5200700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19c0004b80 0x7f19c0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19df400700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19c0004690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f19e00aa8d0 tx=0x7f19c8006f40).ready entity=mon.2 client_cookie=b8bbd05281e73a07 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8009430 con 0x7f19e00a96e0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c800e610 con 0x7f19e00a96e0 2024-01-22T05:39:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19dea00700 1 -- 172.21.15.100:0/2480852855 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800e990 con 0x7f19e00a96e0 2024-01-22T05:39:33.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19e7200700 1 -- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 msgr2=0x7f19c0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:33.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19e7200700 1 --2- 172.21.15.100:0/2480852855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19c0004690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f19e00aa8d0 tx=0x7f19c8006f40).stop 2024-01-22T05:39:33.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19e5200700 1 -- 172.21.15.100:0/2480852855 reap_dead start 2024-01-22T05:39:33.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19e7200700 1 -- 172.21.15.100:0/2480852855 shutdown_connections 2024-01-22T05:39:33.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19e7200700 1 -- 172.21.15.100:0/2480852855 >> 172.21.15.100:0/2480852855 conn(0x7f19e00944d0 msgr2=0x7f19e005e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:33.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.434+0000 7f19e7200700 1 -- 172.21.15.100:0/2480852855 shutdown_connections 2024-01-22T05:39:33.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.435+0000 7f19e7200700 1 -- 172.21.15.100:0/2480852855 wait complete. 2024-01-22T05:39:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.436+0000 7f19e7200700 1 Processor -- start 2024-01-22T05:39:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.436+0000 7f19e7200700 1 -- start start 2024-01-22T05:39:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e7200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19e014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e7200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e014ffe0 0x7f19e00c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e7200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e00c8190 0x7f19e00afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e7200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00c85f0 con 0x7f19e00c8190 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e7200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00c5e40 con 0x7f19e014ffe0 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e7200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00c60e0 con 0x7f19e00a96e0 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e5200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e00c8190 0x7f19e00afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e5200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e00c8190 0x7f19e00afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43596/0 (socket says 172.21.15.100:43596) 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19e5200700 1 -- 172.21.15.100:0/1093250661 learned_addr learned my addr 172.21.15.100:0/1093250661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19df400700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e014ffe0 0x7f19e00c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.437+0000 7f19dfe00700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19e014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e5200700 1 -- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 msgr2=0x7f19e014faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e5200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19e014faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e5200700 1 -- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e014ffe0 msgr2=0x7f19e00c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e5200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e014ffe0 0x7f19e00c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e5200700 1 -- 172.21.15.100:0/1093250661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00c63c0 con 0x7f19e00c8190 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e5200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e00c8190 0x7f19e00afcb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f19e0083ac0 tx=0x7f19d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:33.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19d7400700 1 -- 172.21.15.100:0/1093250661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800e040 con 0x7f19e00c8190 2024-01-22T05:39:33.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19d7400700 1 -- 172.21.15.100:0/1093250661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d800f040 con 0x7f19e00c8190 2024-01-22T05:39:33.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19d7400700 1 -- 172.21.15.100:0/1093250661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800fd70 con 0x7f19e00c8190 2024-01-22T05:39:33.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e00c66a0 con 0x7f19e00c8190 2024-01-22T05:39:33.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.438+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e00b01a0 con 0x7f19e00c8190 2024-01-22T05:39:33.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.439+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e00c6bc0 con 0x7f19e00c8190 2024-01-22T05:39:33.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.440+0000 7f19d7400700 1 -- 172.21.15.100:0/1093250661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f19d8015660 con 0x7f19e00c8190 2024-01-22T05:39:33.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.441+0000 7f19d7400700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f19b805f150 0x7f19b8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:33.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.441+0000 7f19d7400700 1 -- 172.21.15.100:0/1093250661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f19d807a7f0 con 0x7f19e00c8190 2024-01-22T05:39:33.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.441+0000 7f19dfe00700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f19b805f150 0x7f19b8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:33.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.441+0000 7f19dfe00700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f19b805f150 0x7f19b8061610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f19d0001120 tx=0x7f19d0001e90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:33.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.445+0000 7f19d7400700 1 -- 172.21.15.100:0/1093250661 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f19e00c6bc0 con 0x7f19e00c8190 2024-01-22T05:39:33.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:33.682+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f19e00c6bc0 con 0x7f19e00c8190 2024-01-22T05:39:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.228+0000 7f19d7400700 1 -- 172.21.15.100:0/1093250661 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v103) v1 ==== 137+0+0 (secure 0 0 0) 0x7f19e00c6bc0 con 0x7f19e00c8190 2024-01-22T05:39:34.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f19b805f150 msgr2=0x7f19b8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f19b805f150 0x7f19b8061610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f19d0001120 tx=0x7f19d0001e90).stop 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e00c8190 msgr2=0x7f19e00afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e00c8190 0x7f19e00afcb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f19e0083ac0 tx=0x7f19d800b040).stop 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 shutdown_connections 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f19b805f150 0x7f19b8061610 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e00c8190 0x7f19e00afcb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19e00a96e0 0x7f19e014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 --2- 172.21.15.100:0/1093250661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e014ffe0 0x7f19e00c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.230+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 >> 172.21.15.100:0/1093250661 conn(0x7f19e00944d0 msgr2=0x7f19e0063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.231+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 shutdown_connections 2024-01-22T05:39:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.231+0000 7f19e7200700 1 -- 172.21.15.100:0/1093250661 wait complete. 2024-01-22T05:39:34.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T05:39:34.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.437+0000 7f1c29000700 1 Processor -- start 2024-01-22T05:39:34.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.437+0000 7f1c29000700 1 -- start start 2024-01-22T05:39:34.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c29000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c24157d80 0x7f1c24158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c29000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c29000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c240c1a40 con 0x7f1c24154260 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c29000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240cbd30 con 0x7f1c24157d80 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c29000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24158b80 con 0x7f1c241586f0 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c21400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c24157d80 0x7f1c24158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c21400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c24157d80 0x7f1c24158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43612/0 (socket says 172.21.15.100:43612) 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c21400700 1 -- 172.21.15.100:0/3178729789 learned_addr learned my addr 172.21.15.100:0/3178729789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c22800700 1 --2- 172.21.15.100:0/3178729789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c21400700 1 -- 172.21.15.100:0/3178729789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 msgr2=0x7f1c240c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c21400700 1 --2- 172.21.15.100:0/3178729789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c21400700 1 -- 172.21.15.100:0/3178729789 >> v1:172.21.15.100:6789/0 conn(0x7f1c24154260 legacy=0x7f1c240cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c21400700 1 -- 172.21.15.100:0/3178729789 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240c1110 con 0x7f1c24157d80 2024-01-22T05:39:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.439+0000 7f1c20a00700 1 -- 172.21.15.100:0/3178729789 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380907536 0 0) 0x7f1c240c1a40 con 0x7f1c24154260 2024-01-22T05:39:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c21400700 1 --2- 172.21.15.100:0/3178729789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24157d80 0x7f1c24158200 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f1c0c006fd0 tx=0x7f1c0c0090f0).ready entity=mon.0 client_cookie=9c569df903e280e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c20a00700 1 -- 172.21.15.100:0/3178729789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00b600 con 0x7f1c24157d80 2024-01-22T05:39:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c20a00700 1 -- 172.21.15.100:0/3178729789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00b760 con 0x7f1c24157d80 2024-01-22T05:39:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c20a00700 1 -- 172.21.15.100:0/3178729789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00bae0 con 0x7f1c24157d80 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 -- 172.21.15.100:0/3178729789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24157d80 msgr2=0x7f1c24158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 --2- 172.21.15.100:0/3178729789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24157d80 0x7f1c24158200 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f1c0c006fd0 tx=0x7f1c0c0090f0).stop 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 -- 172.21.15.100:0/3178729789 shutdown_connections 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 --2- 172.21.15.100:0/3178729789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 --2- 172.21.15.100:0/3178729789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24157d80 0x7f1c24158200 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 -- 172.21.15.100:0/3178729789 >> 172.21.15.100:0/3178729789 conn(0x7f1c2405e9d0 msgr2=0x7f1c240cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 -- 172.21.15.100:0/3178729789 shutdown_connections 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.440+0000 7f1c29000700 1 -- 172.21.15.100:0/3178729789 wait complete. 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.442+0000 7f1c29000700 1 Processor -- start 2024-01-22T05:39:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.442+0000 7f1c29000700 1 -- start start 2024-01-22T05:39:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c29000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24154260 0x7f1c240af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c29000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c24157d80 0x7f1c24150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c29000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c29000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24150940 con 0x7f1c24154260 2024-01-22T05:39:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c29000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240afea0 con 0x7f1c24157d80 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c29000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240b0180 con 0x7f1c241586f0 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c21e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24154260 0x7f1c240af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c21e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24154260 0x7f1c240af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43624/0 (socket says 172.21.15.100:43624) 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c21e00700 1 -- 172.21.15.100:0/164575517 learned_addr learned my addr 172.21.15.100:0/164575517 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c21400700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c24157d80 0x7f1c24150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.443+0000 7f1c22800700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c21e00700 1 -- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 msgr2=0x7f1c240c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c21e00700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c21e00700 1 -- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c24157d80 msgr2=0x7f1c24150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c21e00700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c24157d80 0x7f1c24150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c21e00700 1 -- 172.21.15.100:0/164575517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c009370 con 0x7f1c24154260 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c22800700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c21400700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c24157d80 0x7f1c24150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c21e00700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24154260 0x7f1c240af900 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1c1400c3c0 tx=0x7f1c14007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c19600700 1 -- 172.21.15.100:0/164575517 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14013450 con 0x7f1c24154260 2024-01-22T05:39:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c19600700 1 -- 172.21.15.100:0/164575517 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140135b0 con 0x7f1c24154260 2024-01-22T05:39:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c19600700 1 -- 172.21.15.100:0/164575517 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14013970 con 0x7f1c24154260 2024-01-22T05:39:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c240b0460 con 0x7f1c24154260 2024-01-22T05:39:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.444+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c24167f30 con 0x7f1c24154260 2024-01-22T05:39:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.445+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2405fdb0 con 0x7f1c24154260 2024-01-22T05:39:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.446+0000 7f1c19600700 1 -- 172.21.15.100:0/164575517 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1c14013d20 con 0x7f1c24154260 2024-01-22T05:39:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.447+0000 7f1c19600700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1bfc05f150 0x7f1bfc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.447+0000 7f1c19600700 1 -- 172.21.15.100:0/164575517 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f1c14079800 con 0x7f1c24154260 2024-01-22T05:39:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.447+0000 7f1c21400700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1bfc05f150 0x7f1bfc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.447+0000 7f1c21400700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1bfc05f150 0x7f1bfc061610 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1c24157bc0 tx=0x7f1c0c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.451+0000 7f1c19600700 1 -- 172.21.15.100:0/164575517 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1c1404acb0 con 0x7f1c24154260 2024-01-22T05:39:34.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.622+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1c240630e0 con 0x7f1c24154260 2024-01-22T05:39:34.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.628+0000 7f1c19600700 1 -- 172.21.15.100:0/164575517 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c1404e2d0 con 0x7f1c24154260 2024-01-22T05:39:34.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1bfc05f150 msgr2=0x7f1bfc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1bfc05f150 0x7f1bfc061610 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1c24157bc0 tx=0x7f1c0c017000).stop 2024-01-22T05:39:34.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24154260 msgr2=0x7f1c240af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:34.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24154260 0x7f1c240af900 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1c1400c3c0 tx=0x7f1c14007e20).stop 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 shutdown_connections 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1bfc05f150 0x7f1bfc061610 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c241586f0 0x7f1c240c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c24154260 0x7f1c240af900 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 --2- 172.21.15.100:0/164575517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c24157d80 0x7f1c24150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 >> 172.21.15.100:0/164575517 conn(0x7f1c2405e9d0 msgr2=0x7f1c241517b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 shutdown_connections 2024-01-22T05:39:34.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:34.630+0000 7f1c29000700 1 -- 172.21.15.100:0/164575517 wait complete. 2024-01-22T05:39:34.648 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:39:34.649 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:39:34.730 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:39:34.824 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:39:34.824 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-22T05:39:34.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:35.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.006+0000 7f03cc800700 1 Processor -- start 2024-01-22T05:39:35.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.007+0000 7f03cc800700 1 -- start start 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03cc800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f03c4154060 0x7f03c4154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03cc800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03c40aa3f0 0x7f03c40c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03cc800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40cb880 con 0x7f03c40a9ec0 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03cc800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40cbb60 con 0x7f03c40aa3f0 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03cc800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40c17d0 con 0x7f03c4154060 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03c9400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03c40aa3f0 0x7f03c40c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03ca800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f03c40a9ec0 0x7f03c40c0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53600/0 (socket says 172.21.15.100:53600) 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03c9400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03c40aa3f0 0x7f03c40c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43630/0 (socket says 172.21.15.100:43630) 2024-01-22T05:39:35.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03ca800700 1 -- 172.21.15.100:0/404543483 learned_addr learned my addr 172.21.15.100:0/404543483 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.008+0000 7f03c9e00700 1 --2- 172.21.15.100:0/404543483 >> v2:172.21.15.169:3300/0 conn(0x7f03c4154060 0x7f03c4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c9400700 1 -- 172.21.15.100:0/404543483 >> v2:172.21.15.169:3300/0 conn(0x7f03c4154060 msgr2=0x7f03c4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c9400700 1 --2- 172.21.15.100:0/404543483 >> v2:172.21.15.169:3300/0 conn(0x7f03c4154060 0x7f03c4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c9400700 1 -- 172.21.15.100:0/404543483 >> v1:172.21.15.100:6789/0 conn(0x7f03c40a9ec0 legacy=0x7f03c40c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c8a00700 1 -- 172.21.15.100:0/404543483 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220503334 0 0) 0x7f03c40cb880 con 0x7f03c40a9ec0 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c9400700 1 -- 172.21.15.100:0/404543483 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40c1ab0 con 0x7f03c40aa3f0 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c9400700 1 --2- 172.21.15.100:0/404543483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c40aa3f0 0x7f03c40c5da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f03c406aea0 tx=0x7f03ac009060).ready entity=mon.0 client_cookie=ca2f8b30c5fcb5b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c8a00700 1 -- 172.21.15.100:0/404543483 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00b580 con 0x7f03c40aa3f0 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c8a00700 1 -- 172.21.15.100:0/404543483 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac00b6e0 con 0x7f03c40aa3f0 2024-01-22T05:39:35.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.009+0000 7f03c8a00700 1 -- 172.21.15.100:0/404543483 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00ba60 con 0x7f03c40aa3f0 2024-01-22T05:39:35.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 -- 172.21.15.100:0/404543483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c40aa3f0 msgr2=0x7f03c40c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:35.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 --2- 172.21.15.100:0/404543483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c40aa3f0 0x7f03c40c5da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f03c406aea0 tx=0x7f03ac009060).stop 2024-01-22T05:39:35.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 -- 172.21.15.100:0/404543483 shutdown_connections 2024-01-22T05:39:35.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 --2- 172.21.15.100:0/404543483 >> v2:172.21.15.169:3300/0 conn(0x7f03c4154060 0x7f03c4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 --2- 172.21.15.100:0/404543483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c40aa3f0 0x7f03c40c5da0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 -- 172.21.15.100:0/404543483 >> 172.21.15.100:0/404543483 conn(0x7f03c405e9d0 msgr2=0x7f03c40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:35.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 -- 172.21.15.100:0/404543483 shutdown_connections 2024-01-22T05:39:35.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.010+0000 7f03cc800700 1 -- 172.21.15.100:0/404543483 wait complete. 2024-01-22T05:39:35.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.011+0000 7f03cc800700 1 Processor -- start 2024-01-22T05:39:35.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.011+0000 7f03cc800700 1 -- start start 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.012+0000 7f03cc800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03c40a9ec0 0x7f03c414ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.012+0000 7f03cc800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c40aa3f0 0x7f03c40c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.012+0000 7f03cc800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c4154060 0x7f03c40abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.012+0000 7f03cc800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c2d60 con 0x7f03c4154060 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.012+0000 7f03cc800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c2430 con 0x7f03c40aa3f0 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.012+0000 7f03cc800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c2710 con 0x7f03c40a9ec0 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c4154060 0x7f03c40abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c4154060 0x7f03c40abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43640/0 (socket says 172.21.15.100:43640) 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 -- 172.21.15.100:0/2549429576 learned_addr learned my addr 172.21.15.100:0/2549429576 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03c9400700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c40aa3f0 0x7f03c40c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03c9e00700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03c40a9ec0 0x7f03c414ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 -- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03c40a9ec0 msgr2=0x7f03c414ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03c40a9ec0 0x7f03c414ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 -- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c40aa3f0 msgr2=0x7f03c40c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c40aa3f0 0x7f03c40c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 -- 172.21.15.100:0/2549429576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0092a0 con 0x7f03c4154060 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03ca800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c4154060 0x7f03c40abb90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f03bc00c7e0 tx=0x7f03bc007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03c1600700 1 -- 172.21.15.100:0/2549429576 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc005d30 con 0x7f03c4154060 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.013+0000 7f03c1600700 1 -- 172.21.15.100:0/2549429576 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc005e90 con 0x7f03c4154060 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.014+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c40c29f0 con 0x7f03c4154060 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.014+0000 7f03c1600700 1 -- 172.21.15.100:0/2549429576 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc007320 con 0x7f03c4154060 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.014+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c40ab6a0 con 0x7f03c4154060 2024-01-22T05:39:35.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.015+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c4083140 con 0x7f03c4154060 2024-01-22T05:39:35.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.015+0000 7f03c1600700 1 -- 172.21.15.100:0/2549429576 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f03bc007710 con 0x7f03c4154060 2024-01-22T05:39:35.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.016+0000 7f03c1600700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f039c05f150 0x7f039c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:35.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.016+0000 7f03c1600700 1 -- 172.21.15.100:0/2549429576 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f03bc079f70 con 0x7f03c4154060 2024-01-22T05:39:35.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.016+0000 7f03c9e00700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f039c05f150 0x7f039c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:35.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.017+0000 7f03c9e00700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f039c05f150 0x7f039c061610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f03b400bb10 tx=0x7f03b4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:35.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.020+0000 7f03c1600700 1 -- 172.21.15.100:0/2549429576 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f03bc04b460 con 0x7f03c4154060 2024-01-22T05:39:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.233+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03c405edb0 con 0x7f03c4154060 2024-01-22T05:39:35.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.233+0000 7f03c1600700 1 -- 172.21.15.100:0/2549429576 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f03bc04ea80 con 0x7f03c4154060 2024-01-22T05:39:35.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:35.234 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/344564312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":344564312},{"type":"v1","addr":"172.21.15.169:6835","nonce":344564312}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2321414326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2321414326},{"type":"v1","addr":"172.21.15.100:6836","nonce":2321414326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/56298333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":56298333},{"type":"v1","addr":"172.21.15.100:6837","nonce":56298333}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4922,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2164131934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2164131934},{"type":"v1","addr":"172.21.15.169:6834","nonce":2164131934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2024-01-22T05:39:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f039c05f150 msgr2=0x7f039c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f039c05f150 0x7f039c061610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f03b400bb10 tx=0x7f03b4008040).stop 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c4154060 msgr2=0x7f03c40abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c4154060 0x7f03c40abb90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f03bc00c7e0 tx=0x7f03bc007f90).stop 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 shutdown_connections 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f039c05f150 0x7f039c061610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c4154060 0x7f03c40abb90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03c40a9ec0 0x7f03c414ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 --2- 172.21.15.100:0/2549429576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c40aa3f0 0x7f03c40c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 >> 172.21.15.100:0/2549429576 conn(0x7f03c405e9d0 msgr2=0x7f03c4150a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 shutdown_connections 2024-01-22T05:39:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:35.235+0000 7f03cc800700 1 -- 172.21.15.100:0/2549429576 wait complete. 2024-01-22T05:39:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-01-22T05:39:35.254 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T05:39:35.254 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T05:39:35.254 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:39:35.254 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:39:35.254 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T05:39:35.254 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T05:39:35.254 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:39:35.254 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:39:35.255 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T05:39:35.255 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T05:39:35.255 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:39:35.255 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:39:35.255 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-22T05:39:35.255 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-22T05:39:35.255 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:39:35.256 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:39:35.267 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:39:35.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T05:39:35.268 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:39:35.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T05:39:35.272 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:39:35.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-22T05:39:35.312 INFO:tasks.ceph.mds.a:Started 2024-01-22T05:39:35.312 DEBUG:teuthology.parallel:result is None 2024-01-22T05:39:35.314 INFO:tasks.ceph.mds.c:Started 2024-01-22T05:39:35.315 DEBUG:teuthology.parallel:result is None 2024-01-22T05:39:35.316 INFO:tasks.ceph.mds.d:Started 2024-01-22T05:39:35.317 DEBUG:teuthology.parallel:result is None 2024-01-22T05:39:35.447 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-22T05:39:35.448 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-22T05:39:35.454 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-01-22T05:39:38.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-22T05:39:41.273 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:39:41.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T05:39:41.278 INFO:tasks.ceph.mds.b:Started 2024-01-22T05:39:41.278 DEBUG:teuthology.parallel:result is None 2024-01-22T05:39:41.279 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T05:39:41.420 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-01-22T05:39:41.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.475+0000 7fe707600700 1 Processor -- start 2024-01-22T05:39:41.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.475+0000 7fe707600700 1 -- start start 2024-01-22T05:39:41.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.476+0000 7fe707600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe7000c5b80 0x7fe70015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.476+0000 7fe707600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe700065000 con 0x7fe700157670 2024-01-22T05:39:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.477+0000 7fe707600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7000c4250 con 0x7fe700157290 2024-01-22T05:39:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.477+0000 7fe707600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe700092820 con 0x7fe7000c5b80 2024-01-22T05:39:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.477+0000 7fe6ffe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe700157670 0x7fe7000c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53634/0 (socket says 172.21.15.100:53634) 2024-01-22T05:39:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.477+0000 7fe6ffe00700 1 -- 172.21.15.100:0/2275180679 learned_addr learned my addr 172.21.15.100:0/2275180679 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.477+0000 7fe705600700 1 --2- 172.21.15.100:0/2275180679 >> v2:172.21.15.169:3300/0 conn(0x7fe7000c5b80 0x7fe70015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.477+0000 7fe6ff400700 1 -- 172.21.15.100:0/2275180679 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781654337 0 0) 0x7fe700065000 con 0x7fe700157670 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.477+0000 7fe6ff400700 1 -- 172.21.15.100:0/2275180679 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e00033f0 con 0x7fe700157670 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe705600700 1 -- 172.21.15.100:0/2275180679 >> v1:172.21.15.169:6789/0 conn(0x7fe700157290 legacy=0x7fe700092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe6ff400700 1 -- 172.21.15.100:0/2275180679 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2897989070 0 0) 0x7fe6e00033f0 con 0x7fe700157670 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe705600700 1 -- 172.21.15.100:0/2275180679 >> v1:172.21.15.100:6789/0 conn(0x7fe700157670 legacy=0x7fe7000c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe705600700 1 -- 172.21.15.100:0/2275180679 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000643f0 con 0x7fe7000c5b80 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe705600700 1 --2- 172.21.15.100:0/2275180679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 0x7fe70015ef00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe6f8009e60 tx=0x7fe6f8009780).ready entity=mon.1 client_cookie=27789dc9219c22e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe6ff400700 1 -- 172.21.15.100:0/2275180679 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800e070 con 0x7fe7000c5b80 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe6ff400700 1 -- 172.21.15.100:0/2275180679 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f800b850 con 0x7fe7000c5b80 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe6ff400700 1 -- 172.21.15.100:0/2275180679 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8001470 con 0x7fe7000c5b80 2024-01-22T05:39:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.478+0000 7fe707600700 1 -- 172.21.15.100:0/2275180679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 msgr2=0x7fe70015ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.479+0000 7fe707600700 1 --2- 172.21.15.100:0/2275180679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 0x7fe70015ef00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe6f8009e60 tx=0x7fe6f8009780).stop 2024-01-22T05:39:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.479+0000 7fe707600700 1 -- 172.21.15.100:0/2275180679 shutdown_connections 2024-01-22T05:39:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.479+0000 7fe707600700 1 --2- 172.21.15.100:0/2275180679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 0x7fe70015ef00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.479+0000 7fe707600700 1 -- 172.21.15.100:0/2275180679 >> 172.21.15.100:0/2275180679 conn(0x7fe70005e9d0 msgr2=0x7fe700091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.479+0000 7fe707600700 1 -- 172.21.15.100:0/2275180679 shutdown_connections 2024-01-22T05:39:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.479+0000 7fe707600700 1 -- 172.21.15.100:0/2275180679 wait complete. 2024-01-22T05:39:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.480+0000 7fe707600700 1 Processor -- start 2024-01-22T05:39:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.480+0000 7fe707600700 1 -- start start 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.481+0000 7fe707600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 0x7fe70014df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.481+0000 7fe707600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe700157290 0x7fe7000adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.481+0000 7fe707600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe700157670 0x7fe7000ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.481+0000 7fe707600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000a8680 con 0x7fe700157290 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.481+0000 7fe707600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000a8f20 con 0x7fe7000c5b80 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.481+0000 7fe707600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000ae960 con 0x7fe700157670 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe700157290 0x7fe7000adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe700157290 0x7fe7000adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43692/0 (socket says 172.21.15.100:43692) 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 -- 172.21.15.100:0/2019591561 learned_addr learned my addr 172.21.15.100:0/2019591561 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe704c00700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 0x7fe70014df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe705600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe700157670 0x7fe7000ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 -- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe700157670 msgr2=0x7fe7000ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe700157670 0x7fe7000ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 -- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 msgr2=0x7fe70014df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 0x7fe70014df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 -- 172.21.15.100:0/2019591561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8009a20 con 0x7fe700157290 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe705600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe700157670 0x7fe7000ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6ffe00700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe700157290 0x7fe7000adba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fe6e800c7e0 tx=0x7fe6e8001a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6f7e00700 1 -- 172.21.15.100:0/2019591561 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8007170 con 0x7fe700157290 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.482+0000 7fe6f7e00700 1 -- 172.21.15.100:0/2019591561 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e80072d0 con 0x7fe700157290 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.483+0000 7fe6f7e00700 1 -- 172.21.15.100:0/2019591561 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80048c0 con 0x7fe700157290 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.483+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000a88d0 con 0x7fe700157290 2024-01-22T05:39:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.483+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70014e460 con 0x7fe700157290 2024-01-22T05:39:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.484+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7000a9090 con 0x7fe700157290 2024-01-22T05:39:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.485+0000 7fe6f7e00700 1 -- 172.21.15.100:0/2019591561 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe6e8004c30 con 0x7fe700157290 2024-01-22T05:39:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.485+0000 7fe6f7e00700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe6d805f150 0x7fe6d8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.485+0000 7fe6f7e00700 1 -- 172.21.15.100:0/2019591561 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe6e80799b0 con 0x7fe700157290 2024-01-22T05:39:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.486+0000 7fe704c00700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe6d805f150 0x7fe6d8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:41.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.486+0000 7fe704c00700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe6d805f150 0x7fe6d8061610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe6f0000f60 tx=0x7fe6f0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:41.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.490+0000 7fe6f7e00700 1 -- 172.21.15.100:0/2019591561 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe6e804af80 con 0x7fe700157290 2024-01-22T05:39:41.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:41.674+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe70005fdb0 con 0x7fe700157290 2024-01-22T05:39:42.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.436+0000 7fe6f7e00700 1 -- 172.21.15.100:0/2019591561 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe6e804e5a0 con 0x7fe700157290 2024-01-22T05:39:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe6d805f150 msgr2=0x7fe6d8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe6d805f150 0x7fe6d8061610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe6f0000f60 tx=0x7fe6f0009040).stop 2024-01-22T05:39:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe700157290 msgr2=0x7fe7000adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe700157290 0x7fe7000adba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fe6e800c7e0 tx=0x7fe6e8001a30).stop 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 shutdown_connections 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe6d805f150 0x7fe6d8061610 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7000c5b80 0x7fe70014df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe700157670 0x7fe7000ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 --2- 172.21.15.100:0/2019591561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe700157290 0x7fe7000adba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 >> 172.21.15.100:0/2019591561 conn(0x7fe70005e9d0 msgr2=0x7fe7000a6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 shutdown_connections 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.439+0000 7fe707600700 1 -- 172.21.15.100:0/2019591561 wait complete. 2024-01-22T05:39:42.441 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-01-22T05:39:42.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T05:39:42.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.642+0000 7fca01400700 1 Processor -- start 2024-01-22T05:39:42.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.643+0000 7fca01400700 1 -- start start 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fca01400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fca01400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc9fc0aa3f0 0x7fc9fc0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fca01400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc0cb880 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fca01400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc0cbb60 con 0x7fc9fc0aa3f0 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fca01400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0c17d0 con 0x7fc9fc154060 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fc9f9e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc9fc0aa3f0 0x7fc9fc0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fc9f9e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc9fc0aa3f0 0x7fc9fc0c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43698/0 (socket says 172.21.15.100:43698) 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.644+0000 7fc9f9e00700 1 -- 172.21.15.100:0/3874274399 learned_addr learned my addr 172.21.15.100:0/3874274399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9fa800700 1 --2- 172.21.15.100:0/3874274399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9e00700 1 -- 172.21.15.100:0/3874274399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 msgr2=0x7fc9fc154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9e00700 1 --2- 172.21.15.100:0/3874274399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9e00700 1 -- 172.21.15.100:0/3874274399 >> v1:172.21.15.169:6789/0 conn(0x7fc9fc0a9ec0 legacy=0x7fc9fc0c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9e00700 1 -- 172.21.15.100:0/3874274399 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0c1ab0 con 0x7fc9fc0aa3f0 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9e00700 1 --2- 172.21.15.100:0/3874274399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0aa3f0 0x7fc9fc0c5da0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc9e4006fd0 tx=0x7fc9e40090f0).ready entity=mon.0 client_cookie=4cd86c6f760dbc27 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9400700 1 -- 172.21.15.100:0/3874274399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400b600 con 0x7fc9fc0aa3f0 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9400700 1 -- 172.21.15.100:0/3874274399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400b760 con 0x7fc9fc0aa3f0 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.645+0000 7fc9f9400700 1 -- 172.21.15.100:0/3874274399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400bb00 con 0x7fc9fc0aa3f0 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 -- 172.21.15.100:0/3874274399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0aa3f0 msgr2=0x7fc9fc0c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 --2- 172.21.15.100:0/3874274399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0aa3f0 0x7fc9fc0c5da0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc9e4006fd0 tx=0x7fc9e40090f0).stop 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 -- 172.21.15.100:0/3874274399 shutdown_connections 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 --2- 172.21.15.100:0/3874274399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 --2- 172.21.15.100:0/3874274399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0aa3f0 0x7fc9fc0c5da0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 -- 172.21.15.100:0/3874274399 >> 172.21.15.100:0/3874274399 conn(0x7fc9fc05e9d0 msgr2=0x7fc9fc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 -- 172.21.15.100:0/3874274399 shutdown_connections 2024-01-22T05:39:42.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.646+0000 7fca01400700 1 -- 172.21.15.100:0/3874274399 wait complete. 2024-01-22T05:39:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.647+0000 7fca01400700 1 Processor -- start 2024-01-22T05:39:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.647+0000 7fca01400700 1 -- start start 2024-01-22T05:39:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.648+0000 7fca01400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0a9ec0 0x7fc9fc149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.648+0000 7fca01400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9fc0aa3f0 0x7fc9fc14a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.648+0000 7fca01400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc0ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.648+0000 7fca01400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0aef00 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.648+0000 7fca01400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0afd60 con 0x7fc9fc0aa3f0 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.648+0000 7fca01400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0af150 con 0x7fc9fc154060 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0a9ec0 0x7fc9fc149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0a9ec0 0x7fc9fc149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43700/0 (socket says 172.21.15.100:43700) 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 -- 172.21.15.100:0/3137688047 learned_addr learned my addr 172.21.15.100:0/3137688047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fb200700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc0ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9f9e00700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9fc0aa3f0 0x7fc9fc14a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 -- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 msgr2=0x7fc9fc0ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc0ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 -- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9fc0aa3f0 msgr2=0x7fc9fc14a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9fc0aa3f0 0x7fc9fc14a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 -- 172.21.15.100:0/3137688047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4009370 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9fa800700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0a9ec0 0x7fc9fc149a00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc9ec00d8c0 tx=0x7fc9ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.649+0000 7fc9f2000700 1 -- 172.21.15.100:0/3137688047 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec011590 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.650+0000 7fc9f2000700 1 -- 172.21.15.100:0/3137688047 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec0116f0 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.650+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc0af430 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.650+0000 7fc9f2000700 1 -- 172.21.15.100:0/3137688047 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec011a70 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.650+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc0af9f0 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.651+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc05fdb0 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.651+0000 7fc9f2000700 1 -- 172.21.15.100:0/3137688047 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc9ec01c460 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.652+0000 7fc9f2000700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc9d405f150 0x7fc9d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.652+0000 7fc9f2000700 1 -- 172.21.15.100:0/3137688047 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc9ec079bc0 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.652+0000 7fc9f9e00700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc9d405f150 0x7fc9d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.653+0000 7fc9f9e00700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc9d405f150 0x7fc9d4061610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc9e4006fd0 tx=0x7fc9e4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.656+0000 7fc9f2000700 1 -- 172.21.15.100:0/3137688047 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc9ec04b0c0 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.888+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc9fc06abb0 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.889+0000 7fc9f2000700 1 -- 172.21.15.100:0/3137688047 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fc9ec011e60 con 0x7fc9fc0a9ec0 2024-01-22T05:39:42.890 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:42.890 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:39:42.890 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-01-22T05:39:42.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1lKhBbExAAP1BrokBcKT5wpIYo2LQizA==", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1l5WvtKBAAGBD5pmKa1sf0TSX+OYjENw==", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1ldUwfHhAAGDh9/oyieZZj+nYGld/h5w==", 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1lo2avMxAAz3VifArccipq4F2K0FH9Kw==", 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAA/61l9LR1NxAAx58Vl+r8QVwCEFHkEv4HJw==", 2024-01-22T05:39:42.893 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAE/61lSe6xDRAAaFPsyQZNCGPUSo/m2jqETQ==", 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.894 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAH/61lK8MxHxAACcVEookX0aW2movigxC2rQ==", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAK/61lnYc0MBAAOR9vmCTVgAEbjys3KinSew==", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAR/61l6P8NGxAA/DPstaukdx0isfDgWNW4MA==", 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAU/61lWuCvLBAA8Cd63Y9QlhRZHSJy/DUb8g==", 2024-01-22T05:39:42.896 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAY/61lYmcMAhAA3ghp6xyqtWETmgFA/Szq8A==", 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAb/61lr2xlExAANagHPAeO/tTQ4KPxCuU6tw==", 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1l5dFcARAAc8i3e2d9UpF5QQY4na57gg==", 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.898 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow r", 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw pool=cephfs_data" 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1lFHj8DhAAz0WTKY0O3XjPGv5O0PRvCQ==", 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-22T05:39:42.899 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.2", 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1lq1AhCBAAmkMcm5COJ2MY+F+ZusDcrw==", 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.3", 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD9/q1lKApFIRAASzUDqwNZORbBGJ0T3aTCKg==", 2024-01-22T05:39:42.900 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD7/q1lJjuZDxAAz1l9858AcZSaDpAyXIZdyA==", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8/q1lBYNsDBAAy201tfKKfFR4d3U8DtGtoQ==", 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD7/q1lKDyANRAALG48jCFnVwioSX/dTJfBNQ==", 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-22T05:39:42.902 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-22T05:39:42.903 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-22T05:39:42.903 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.903 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:42.903 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-01-22T05:39:42.903 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:39:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc9d405f150 msgr2=0x7fc9d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc9d405f150 0x7fc9d4061610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc9e4006fd0 tx=0x7fc9e4017000).stop 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0a9ec0 msgr2=0x7fc9fc149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0a9ec0 0x7fc9fc149a00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc9ec00d8c0 tx=0x7fc9ec008040).stop 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 shutdown_connections 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc9d405f150 0x7fc9d4061610 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9fc154060 0x7fc9fc0ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9fc0a9ec0 0x7fc9fc149a00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 --2- 172.21.15.100:0/3137688047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9fc0aa3f0 0x7fc9fc14a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 >> 172.21.15.100:0/3137688047 conn(0x7fc9fc05e9d0 msgr2=0x7fc9fc0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 shutdown_connections 2024-01-22T05:39:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:42.891+0000 7fca01400700 1 -- 172.21.15.100:0/3137688047 wait complete. 2024-01-22T05:39:42.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:43.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.091+0000 7fcfc3000700 1 Processor -- start 2024-01-22T05:39:43.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.091+0000 7fcfc3000700 1 -- start start 2024-01-22T05:39:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.092+0000 7fcfc3000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a58a0 0x7fcfbc06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.092+0000 7fcfc3000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfbc0681e0 0x7fcfbc068620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.092+0000 7fcfc3000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc065c90 con 0x7fcfbc0a5c80 2024-01-22T05:39:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.092+0000 7fcfc3000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc06a790 con 0x7fcfbc0681e0 2024-01-22T05:39:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.092+0000 7fcfc3000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0bba50 con 0x7fcfbc0a58a0 2024-01-22T05:39:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfbc0681e0 0x7fcfbc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfbc0681e0 0x7fcfbc068620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53128/0 (socket says 172.21.15.100:53128) 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 -- 172.21.15.100:0/221572313 learned_addr learned my addr 172.21.15.100:0/221572313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfbbe00700 1 --2- 172.21.15.100:0/221572313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a58a0 0x7fcfbc06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 -- 172.21.15.100:0/221572313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a58a0 msgr2=0x7fcfbc06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 --2- 172.21.15.100:0/221572313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a58a0 0x7fcfbc06a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 -- 172.21.15.100:0/221572313 >> v1:172.21.15.169:6789/0 conn(0x7fcfbc0a5c80 legacy=0x7fcfbc064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 -- 172.21.15.100:0/221572313 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc068b10 con 0x7fcfbc0681e0 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfc1000700 1 --2- 172.21.15.100:0/221572313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc068620 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fcfb4009f20 tx=0x7fcfb4009840).ready entity=mon.0 client_cookie=3de39f7c5e699245 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfbaa00700 1 -- 172.21.15.100:0/221572313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb400e070 con 0x7fcfbc0681e0 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfbaa00700 1 -- 172.21.15.100:0/221572313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb400ba80 con 0x7fcfbc0681e0 2024-01-22T05:39:43.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.093+0000 7fcfbaa00700 1 -- 172.21.15.100:0/221572313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb400be00 con 0x7fcfbc0681e0 2024-01-22T05:39:43.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 -- 172.21.15.100:0/221572313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 msgr2=0x7fcfbc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 --2- 172.21.15.100:0/221572313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc068620 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fcfb4009f20 tx=0x7fcfb4009840).stop 2024-01-22T05:39:43.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 -- 172.21.15.100:0/221572313 shutdown_connections 2024-01-22T05:39:43.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 --2- 172.21.15.100:0/221572313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc068620 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 --2- 172.21.15.100:0/221572313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a58a0 0x7fcfbc06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 -- 172.21.15.100:0/221572313 >> 172.21.15.100:0/221572313 conn(0x7fcfbc063090 msgr2=0x7fcfbc0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:43.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 -- 172.21.15.100:0/221572313 shutdown_connections 2024-01-22T05:39:43.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.094+0000 7fcfc3000700 1 -- 172.21.15.100:0/221572313 wait complete. 2024-01-22T05:39:43.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.096+0000 7fcfc3000700 1 Processor -- start 2024-01-22T05:39:43.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.096+0000 7fcfc3000700 1 -- start start 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.097+0000 7fcfc3000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc164450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfc3000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfbc0a58a0 0x7fcfbc0a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfc3000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a5c80 0x7fcfbc0a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfc3000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0a5250 con 0x7fcfbc0681e0 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfc3000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc139f80 con 0x7fcfbc0a58a0 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfc3000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0c2be0 con 0x7fcfbc0a5c80 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc164450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53142/0 (socket says 172.21.15.100:53142) 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 -- 172.21.15.100:0/3801510710 learned_addr learned my addr 172.21.15.100:0/3801510710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfc1000700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a5c80 0x7fcfbc0a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbb400700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfbc0a58a0 0x7fcfbc0a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 -- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a5c80 msgr2=0x7fcfbc0a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a5c80 0x7fcfbc0a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 -- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfbc0a58a0 msgr2=0x7fcfbc0a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfbc0a58a0 0x7fcfbc0a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 -- 172.21.15.100:0/3801510710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009ae0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbb400700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfbc0a58a0 0x7fcfbc0a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.098+0000 7fcfbbe00700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc164450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fcfac00d890 tx=0x7fcfac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.099+0000 7fcfb3400700 1 -- 172.21.15.100:0/3801510710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0125f0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.099+0000 7fcfb3400700 1 -- 172.21.15.100:0/3801510710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac012750 con 0x7fcfbc0681e0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.099+0000 7fcfb3400700 1 -- 172.21.15.100:0/3801510710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac012ad0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.099+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc164940 con 0x7fcfbc0681e0 2024-01-22T05:39:43.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.099+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc0c22b0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.100+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc0c2ec0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.100+0000 7fcfb3400700 1 -- 172.21.15.100:0/3801510710 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcfac013480 con 0x7fcfbc0681e0 2024-01-22T05:39:43.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.102+0000 7fcfb3400700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcf9405f150 0x7fcf94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.102+0000 7fcfb3400700 1 -- 172.21.15.100:0/3801510710 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcfac079bf0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.102+0000 7fcfbb400700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcf9405f150 0x7fcf94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.102+0000 7fcfbb400700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcf9405f150 0x7fcf94061610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fcfbc0c0be0 tx=0x7fcfa4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.106+0000 7fcfb3400700 1 -- 172.21.15.100:0/3801510710 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcfac04b1b0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.278+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfbc05fdb0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.279+0000 7fcfb3400700 1 -- 172.21.15.100:0/3801510710 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+13760 (secure 0 0 0) 0x7fcfac04e7d0 con 0x7fcfbc0681e0 2024-01-22T05:39:43.280 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:43.280 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":48,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:42.433966+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcf9405f150 msgr2=0x7fcf94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcf9405f150 0x7fcf94061610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fcfbc0c0be0 tx=0x7fcfa4009040).stop 2024-01-22T05:39:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 msgr2=0x7fcfbc164450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc164450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fcfac00d890 tx=0x7fcfac008040).stop 2024-01-22T05:39:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 shutdown_connections 2024-01-22T05:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcf9405f150 0x7fcf94061610 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfbc0a5c80 0x7fcfbc0a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfbc0681e0 0x7fcfbc164450 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 --2- 172.21.15.100:0/3801510710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfbc0a58a0 0x7fcfbc0a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 >> 172.21.15.100:0/3801510710 conn(0x7fcfbc063090 msgr2=0x7fcfbc0a87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 shutdown_connections 2024-01-22T05:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.281+0000 7fcfc3000700 1 -- 172.21.15.100:0/3801510710 wait complete. 2024-01-22T05:39:43.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-22T05:39:43.300 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:39:43.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.486+0000 7fdab3600700 1 Processor -- start 2024-01-22T05:39:43.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.486+0000 7fdab3600700 1 -- start start 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.487+0000 7fdab3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0a9f60 0x7fdaac0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdab3600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdaac0c1940 0x7fdaac0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdab3600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac0c74b0 con 0x7fdaac05e1f0 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdab3600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0cab90 con 0x7fdaac0c1940 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdab3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac158660 con 0x7fdaac0a9f60 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdaabe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdaac0c1940 0x7fdaac0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdab1600700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdaac05e1f0 0x7fdaac098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46096/0 (socket says 172.21.15.100:46096) 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdab1600700 1 -- 172.21.15.100:0/3824763440 learned_addr learned my addr 172.21.15.100:0/3824763440 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdab0c00700 1 --2- 172.21.15.100:0/3824763440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0a9f60 0x7fdaac0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdaabe00700 1 -- 172.21.15.100:0/3824763440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0a9f60 msgr2=0x7fdaac0aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdaabe00700 1 --2- 172.21.15.100:0/3824763440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0a9f60 0x7fdaac0aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdaabe00700 1 -- 172.21.15.100:0/3824763440 >> v1:172.21.15.100:6789/0 conn(0x7fdaac05e1f0 legacy=0x7fdaac098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdaabe00700 1 -- 172.21.15.100:0/3824763440 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac158940 con 0x7fdaac0c1940 2024-01-22T05:39:43.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.488+0000 7fdaab400700 1 -- 172.21.15.100:0/3824763440 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160937095 0 0) 0x7fdaac0c74b0 con 0x7fdaac05e1f0 2024-01-22T05:39:43.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdaabe00700 1 --2- 172.21.15.100:0/3824763440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0c1940 0x7fdaac0ca6a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fda94009760 tx=0x7fda94009060).ready entity=mon.0 client_cookie=62a59849c0cd4f2d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdaab400700 1 -- 172.21.15.100:0/3824763440 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400f510 con 0x7fdaac0c1940 2024-01-22T05:39:43.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdaab400700 1 -- 172.21.15.100:0/3824763440 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400f670 con 0x7fdaac0c1940 2024-01-22T05:39:43.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdaab400700 1 -- 172.21.15.100:0/3824763440 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400f9f0 con 0x7fdaac0c1940 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdab3600700 1 -- 172.21.15.100:0/3824763440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0c1940 msgr2=0x7fdaac0ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdab3600700 1 --2- 172.21.15.100:0/3824763440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0c1940 0x7fdaac0ca6a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fda94009760 tx=0x7fda94009060).stop 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdab3600700 1 -- 172.21.15.100:0/3824763440 shutdown_connections 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdab3600700 1 --2- 172.21.15.100:0/3824763440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0a9f60 0x7fdaac0aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdab3600700 1 --2- 172.21.15.100:0/3824763440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0c1940 0x7fdaac0ca6a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.489+0000 7fdab3600700 1 -- 172.21.15.100:0/3824763440 >> 172.21.15.100:0/3824763440 conn(0x7fdaac0cada0 msgr2=0x7fdaac0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.490+0000 7fdab3600700 1 -- 172.21.15.100:0/3824763440 shutdown_connections 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.490+0000 7fdab3600700 1 -- 172.21.15.100:0/3824763440 wait complete. 2024-01-22T05:39:43.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.491+0000 7fdab3600700 1 Processor -- start 2024-01-22T05:39:43.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.491+0000 7fdab3600700 1 -- start start 2024-01-22T05:39:43.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdab3600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaac05e1f0 0x7fdaac152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdab3600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0a9f60 0x7fdaac0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdab3600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0c1940 0x7fdaac0c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdab3600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c3850 con 0x7fdaac0a9f60 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdab3600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c3af0 con 0x7fdaac05e1f0 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdab3600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c3dd0 con 0x7fdaac0c1940 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdaabe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0a9f60 0x7fdaac0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdaabe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0a9f60 0x7fdaac0c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53174/0 (socket says 172.21.15.100:53174) 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.492+0000 7fdaabe00700 1 -- 172.21.15.100:0/342715313 learned_addr learned my addr 172.21.15.100:0/342715313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdab1600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0c1940 0x7fdaac0c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaabe00700 1 -- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0c1940 msgr2=0x7fdaac0c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaabe00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0c1940 0x7fdaac0c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdab0c00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaac05e1f0 0x7fdaac152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaabe00700 1 -- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaac05e1f0 msgr2=0x7fdaac152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaabe00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaac05e1f0 0x7fdaac152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaabe00700 1 -- 172.21.15.100:0/342715313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940092a0 con 0x7fdaac0a9f60 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdab1600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0c1940 0x7fdaac0c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:43.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdab0c00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaac05e1f0 0x7fdaac152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:43.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaabe00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0a9f60 0x7fdaac0c45d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fda94011000 tx=0x7fda94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaa3e00700 1 -- 172.21.15.100:0/342715313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400f7e0 con 0x7fdaac0a9f60 2024-01-22T05:39:43.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaa3e00700 1 -- 172.21.15.100:0/342715313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400f940 con 0x7fdaac0a9f60 2024-01-22T05:39:43.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac0c40b0 con 0x7fdaac0a9f60 2024-01-22T05:39:43.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdaa3e00700 1 -- 172.21.15.100:0/342715313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9401c630 con 0x7fdaac0a9f60 2024-01-22T05:39:43.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.493+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac152540 con 0x7fdaac0a9f60 2024-01-22T05:39:43.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.494+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac05fdb0 con 0x7fdaac0a9f60 2024-01-22T05:39:43.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.495+0000 7fdaa3e00700 1 -- 172.21.15.100:0/342715313 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fda9401ca20 con 0x7fdaac0a9f60 2024-01-22T05:39:43.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.496+0000 7fdaa3e00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda8405f150 0x7fda84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.496+0000 7fdaa3e00700 1 -- 172.21.15.100:0/342715313 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fda9407bc20 con 0x7fdaac0a9f60 2024-01-22T05:39:43.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.496+0000 7fdab0c00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda8405f150 0x7fda84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.496+0000 7fdab0c00700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda8405f150 0x7fda84061610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fda9c006d80 tx=0x7fda9c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.500+0000 7fdaa3e00700 1 -- 172.21.15.100:0/342715313 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fda9404d180 con 0x7fdaac0a9f60 2024-01-22T05:39:43.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.667+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdaac0ca030 con 0x7fdaac0a9f60 2024-01-22T05:39:43.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.667+0000 7fdaa3e00700 1 -- 172.21.15.100:0/342715313 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v48) v1 ==== 110+0+10 (secure 0 0 0) 0x7fda9402a020 con 0x7fdaac0a9f60 2024-01-22T05:39:43.668 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda8405f150 msgr2=0x7fda84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda8405f150 0x7fda84061610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fda9c006d80 tx=0x7fda9c008040).stop 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0a9f60 msgr2=0x7fdaac0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0a9f60 0x7fdaac0c45d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fda94011000 tx=0x7fda94017000).stop 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 shutdown_connections 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda8405f150 0x7fda84061610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaac05e1f0 0x7fdaac152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdaac0c1940 0x7fdaac0c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 --2- 172.21.15.100:0/342715313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac0a9f60 0x7fdaac0c45d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.669+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 >> 172.21.15.100:0/342715313 conn(0x7fdaac0cada0 msgr2=0x7fdaac0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.670+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 shutdown_connections 2024-01-22T05:39:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.670+0000 7fdab3600700 1 -- 172.21.15.100:0/342715313 wait complete. 2024-01-22T05:39:43.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:39:43.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.872+0000 7efec4a00700 1 Processor -- start 2024-01-22T05:39:43.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.872+0000 7efec4a00700 1 -- start start 2024-01-22T05:39:43.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.873+0000 7efec4a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc0a9f60 0x7efebc0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.873+0000 7efec4a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0c74b0 con 0x7efebc0c1940 2024-01-22T05:39:43.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.873+0000 7efec4a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc158660 con 0x7efebc05e900 2024-01-22T05:39:43.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.873+0000 7efec4a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc158940 con 0x7efebc0a9f60 2024-01-22T05:39:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.873+0000 7efec1600700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efebc0c1940 0x7efebc05e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46112/0 (socket says 172.21.15.100:46112) 2024-01-22T05:39:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.873+0000 7efec1600700 1 -- 172.21.15.100:0/1701797173 learned_addr learned my addr 172.21.15.100:0/1701797173 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec2000700 1 --2- 172.21.15.100:0/1701797173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc0a9f60 0x7efebc0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009845678 0 0) 0x7efebc0c74b0 con 0x7efebc0c1940 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe9c0033f0 con 0x7efebc0c1940 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794022367 0 0) 0x7efebc158660 con 0x7efebc05e900 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efebc0c74b0 con 0x7efebc05e900 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec2000700 1 -- 172.21.15.100:0/1701797173 >> v1:172.21.15.169:6789/0 conn(0x7efebc05e900 legacy=0x7efebc098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec2000700 1 -- 172.21.15.100:0/1701797173 >> v1:172.21.15.100:6789/0 conn(0x7efebc0c1940 legacy=0x7efebc05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374979833 0 0) 0x7efe9c0033f0 con 0x7efebc0c1940 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec2000700 1 -- 172.21.15.100:0/1701797173 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0c7140 con 0x7efebc0a9f60 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.874+0000 7efec2000700 1 --2- 172.21.15.100:0/1701797173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc0a9f60 0x7efebc0aa340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efeac009790 tx=0x7efeac009060).ready entity=mon.2 client_cookie=636200d660c36e0b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4001470 con 0x7efebc0a9f60 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac011400 con 0x7efebc0a9f60 2024-01-22T05:39:43.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec0c00700 1 -- 172.21.15.100:0/1701797173 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011780 con 0x7efebc0a9f60 2024-01-22T05:39:43.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec4a00700 1 -- 172.21.15.100:0/1701797173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc0a9f60 msgr2=0x7efebc0aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec4a00700 1 --2- 172.21.15.100:0/1701797173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc0a9f60 0x7efebc0aa340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efeac009790 tx=0x7efeac009060).stop 2024-01-22T05:39:43.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec4a00700 1 -- 172.21.15.100:0/1701797173 shutdown_connections 2024-01-22T05:39:43.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec4a00700 1 --2- 172.21.15.100:0/1701797173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc0a9f60 0x7efebc0aa340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec4a00700 1 -- 172.21.15.100:0/1701797173 >> 172.21.15.100:0/1701797173 conn(0x7efebc0cada0 msgr2=0x7efebc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:43.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec4a00700 1 -- 172.21.15.100:0/1701797173 shutdown_connections 2024-01-22T05:39:43.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.875+0000 7efec4a00700 1 -- 172.21.15.100:0/1701797173 wait complete. 2024-01-22T05:39:43.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.877+0000 7efec4a00700 1 Processor -- start 2024-01-22T05:39:43.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.877+0000 7efec4a00700 1 -- start start 2024-01-22T05:39:43.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec4a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc05e900 0x7efebc1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec4a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0a9f60 0x7efebc152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec4a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efebc0c1940 0x7efebc0c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec4a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc154ad0 con 0x7efebc0a9f60 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec4a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0ab800 con 0x7efebc0c1940 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec4a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0c3510 con 0x7efebc05e900 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec1600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0a9f60 0x7efebc152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec1600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0a9f60 0x7efebc152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53182/0 (socket says 172.21.15.100:53182) 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec1600700 1 -- 172.21.15.100:0/2036771707 learned_addr learned my addr 172.21.15.100:0/2036771707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec2000700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc05e900 0x7efebc1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec2a00700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efebc0c1940 0x7efebc0c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec1600700 1 -- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc05e900 msgr2=0x7efebc1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec1600700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc05e900 0x7efebc1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec1600700 1 -- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efebc0c1940 msgr2=0x7efebc0c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.878+0000 7efec1600700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efebc0c1940 0x7efebc0c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.879+0000 7efec1600700 1 -- 172.21.15.100:0/2036771707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0092a0 con 0x7efebc0a9f60 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.879+0000 7efec1600700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0a9f60 0x7efebc152c00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7efea400c810 tx=0x7efea4001960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.879+0000 7efeb9600700 1 -- 172.21.15.100:0/2036771707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40072e0 con 0x7efebc0a9f60 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.879+0000 7efeb9600700 1 -- 172.21.15.100:0/2036771707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4007440 con 0x7efebc0a9f60 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.879+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0abac0 con 0x7efebc0a9f60 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.879+0000 7efeb9600700 1 -- 172.21.15.100:0/2036771707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40057a0 con 0x7efebc0a9f60 2024-01-22T05:39:43.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.879+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0c2cf0 con 0x7efebc0a9f60 2024-01-22T05:39:43.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.880+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0abc50 con 0x7efebc0a9f60 2024-01-22T05:39:43.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.881+0000 7efeb9600700 1 -- 172.21.15.100:0/2036771707 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efea4005bd0 con 0x7efebc0a9f60 2024-01-22T05:39:43.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.881+0000 7efeb9600700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe9405f150 0x7efe94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:43.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.882+0000 7efeb9600700 1 -- 172.21.15.100:0/2036771707 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7efea4079830 con 0x7efebc0a9f60 2024-01-22T05:39:43.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.882+0000 7efec2000700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe9405f150 0x7efe94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:43.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.882+0000 7efec2000700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe9405f150 0x7efe94061610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7efeac0096e0 tx=0x7efeac016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:43.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:43.885+0000 7efeb9600700 1 -- 172.21.15.100:0/2036771707 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efea404ad90 con 0x7efebc0a9f60 2024-01-22T05:39:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.054+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efebc05eda0 con 0x7efebc0a9f60 2024-01-22T05:39:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.054+0000 7efeb9600700 1 -- 172.21.15.100:0/2036771707 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7efea404e3b0 con 0x7efebc0a9f60 2024-01-22T05:39:44.056 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:39:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe9405f150 msgr2=0x7efe94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe9405f150 0x7efe94061610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7efeac0096e0 tx=0x7efeac016000).stop 2024-01-22T05:39:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0a9f60 msgr2=0x7efebc152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0a9f60 0x7efebc152c00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7efea400c810 tx=0x7efea4001960).stop 2024-01-22T05:39:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 shutdown_connections 2024-01-22T05:39:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efe9405f150 0x7efe94061610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efebc0c1940 0x7efebc0c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efebc05e900 0x7efebc1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 --2- 172.21.15.100:0/2036771707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0a9f60 0x7efebc152c00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 >> 172.21.15.100:0/2036771707 conn(0x7efebc0cada0 msgr2=0x7efebc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.056+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 shutdown_connections 2024-01-22T05:39:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.057+0000 7efec4a00700 1 -- 172.21.15.100:0/2036771707 wait complete. 2024-01-22T05:39:44.075 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T05:39:44.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.259+0000 7f1deda00700 1 Processor -- start 2024-01-22T05:39:44.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.259+0000 7f1deda00700 1 -- start start 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.260+0000 7f1deda00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1de806a290 0x7f1de8153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.260+0000 7f1deda00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de8065760 con 0x7f1de80a5ab0 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.260+0000 7f1deda00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80bc340 con 0x7f1de80a5e90 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.260+0000 7f1deda00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de806a780 con 0x7f1de806a290 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de6a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1de80a5ab0 0x7f1de80c0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46120/0 (socket says 172.21.15.100:46120) 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de6a00700 1 -- 172.21.15.100:0/4034664157 learned_addr learned my addr 172.21.15.100:0/4034664157 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de7400700 1 --2- 172.21.15.100:0/4034664157 >> v2:172.21.15.169:3300/0 conn(0x7f1de806a290 0x7f1de8153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de5600700 1 -- 172.21.15.100:0/4034664157 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11908553 0 0) 0x7f1de8065760 con 0x7f1de80a5ab0 2024-01-22T05:39:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de5600700 1 -- 172.21.15.100:0/4034664157 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc80033f0 con 0x7f1de80a5ab0 2024-01-22T05:39:44.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de5600700 1 -- 172.21.15.100:0/4034664157 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2023986213 0 0) 0x7f1dc80033f0 con 0x7f1de80a5ab0 2024-01-22T05:39:44.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de7400700 1 -- 172.21.15.100:0/4034664157 >> v1:172.21.15.169:6789/0 conn(0x7f1de80a5e90 legacy=0x7f1de8069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de7400700 1 -- 172.21.15.100:0/4034664157 >> v1:172.21.15.100:6789/0 conn(0x7f1de80a5ab0 legacy=0x7f1de80c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.261+0000 7f1de7400700 1 -- 172.21.15.100:0/4034664157 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80bba50 con 0x7f1de806a290 2024-01-22T05:39:44.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.262+0000 7f1de7400700 1 --2- 172.21.15.100:0/4034664157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 0x7f1de8153da0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1de0009e60 tx=0x7f1de0009780).ready entity=mon.1 client_cookie=d6374901365a4b28 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:44.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.262+0000 7f1de5600700 1 -- 172.21.15.100:0/4034664157 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000e070 con 0x7f1de806a290 2024-01-22T05:39:44.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.265+0000 7f1de5600700 1 -- 172.21.15.100:0/4034664157 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000b850 con 0x7f1de806a290 2024-01-22T05:39:44.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.265+0000 7f1de5600700 1 -- 172.21.15.100:0/4034664157 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8001470 con 0x7f1de806a290 2024-01-22T05:39:44.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.266+0000 7f1deda00700 1 -- 172.21.15.100:0/4034664157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 msgr2=0x7f1de8153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.266+0000 7f1deda00700 1 --2- 172.21.15.100:0/4034664157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 0x7f1de8153da0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1de0009e60 tx=0x7f1de0009780).stop 2024-01-22T05:39:44.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.266+0000 7f1deda00700 1 -- 172.21.15.100:0/4034664157 shutdown_connections 2024-01-22T05:39:44.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.266+0000 7f1deda00700 1 --2- 172.21.15.100:0/4034664157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 0x7f1de8153da0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.266+0000 7f1deda00700 1 -- 172.21.15.100:0/4034664157 >> 172.21.15.100:0/4034664157 conn(0x7f1de8063090 msgr2=0x7f1de80c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:44.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.266+0000 7f1deda00700 1 -- 172.21.15.100:0/4034664157 shutdown_connections 2024-01-22T05:39:44.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.266+0000 7f1deda00700 1 -- 172.21.15.100:0/4034664157 wait complete. 2024-01-22T05:39:44.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.267+0000 7f1deda00700 1 Processor -- start 2024-01-22T05:39:44.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.268+0000 7f1deda00700 1 -- start start 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.268+0000 7f1deda00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 0x7f1de80aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.268+0000 7f1deda00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1de80a5ab0 0x7f1de80c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.268+0000 7f1deda00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de80a5e90 0x7f1de80bda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.268+0000 7f1deda00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80be700 con 0x7f1de80a5e90 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.268+0000 7f1deda00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80be9e0 con 0x7f1de806a290 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1deda00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80aa130 con 0x7f1de80a5ab0 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de80a5e90 0x7f1de80bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de80a5e90 0x7f1de80bda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53190/0 (socket says 172.21.15.100:53190) 2024-01-22T05:39:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 -- 172.21.15.100:0/545234390 learned_addr learned my addr 172.21.15.100:0/545234390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de6a00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 0x7f1de80aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de6000700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1de80a5ab0 0x7f1de80c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 -- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1de80a5ab0 msgr2=0x7f1de80c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1de80a5ab0 0x7f1de80c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 -- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 msgr2=0x7f1de80aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 0x7f1de80aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 -- 172.21.15.100:0/545234390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009a20 con 0x7f1de80a5e90 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.269+0000 7f1de7400700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de80a5e90 0x7f1de80bda60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1de000a000 tx=0x7f1de80bbbe0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.270+0000 7f1dde000700 1 -- 172.21.15.100:0/545234390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0012e40 con 0x7f1de80a5e90 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.270+0000 7f1dde000700 1 -- 172.21.15.100:0/545234390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0007080 con 0x7f1de80a5e90 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.270+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de80aa410 con 0x7f1de80a5e90 2024-01-22T05:39:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.270+0000 7f1dde000700 1 -- 172.21.15.100:0/545234390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de001e650 con 0x7f1de80a5e90 2024-01-22T05:39:44.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.270+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de80ab100 con 0x7f1de80a5e90 2024-01-22T05:39:44.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.271+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de80aa930 con 0x7f1de80a5e90 2024-01-22T05:39:44.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.272+0000 7f1dde000700 1 -- 172.21.15.100:0/545234390 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1de0003040 con 0x7f1de80a5e90 2024-01-22T05:39:44.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.272+0000 7f1dde000700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1dc005f150 0x7f1dc0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.272+0000 7f1dde000700 1 -- 172.21.15.100:0/545234390 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1de007b2c0 con 0x7f1de80a5e90 2024-01-22T05:39:44.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.273+0000 7f1de6a00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1dc005f150 0x7f1dc0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.273+0000 7f1de6a00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1dc005f150 0x7f1dc0061610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1dd80011e0 tx=0x7f1dd80019d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:44.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.277+0000 7f1dde000700 1 -- 172.21.15.100:0/545234390 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1de80aa930 con 0x7f1de80a5e90 2024-01-22T05:39:44.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.449+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1de80aa930 con 0x7f1de80a5e90 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.450+0000 7f1dde000700 1 -- 172.21.15.100:0/545234390 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1de80aa930 con 0x7f1de80a5e90 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "device_health_metrics" 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-22T05:39:44.451 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 2, 2024-01-22T05:39:44.452 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "rbd" 2024-01-22T05:39:44.452 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:39:44.452 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-22T05:39:44.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1dc005f150 msgr2=0x7f1dc0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1dc005f150 0x7f1dc0061610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1dd80011e0 tx=0x7f1dd80019d0).stop 2024-01-22T05:39:44.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de80a5e90 msgr2=0x7f1de80bda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de80a5e90 0x7f1de80bda60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1de000a000 tx=0x7f1de80bbbe0).stop 2024-01-22T05:39:44.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 shutdown_connections 2024-01-22T05:39:44.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1dc005f150 0x7f1dc0061610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1de806a290 0x7f1de80aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de80a5e90 0x7f1de80bda60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 --2- 172.21.15.100:0/545234390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1de80a5ab0 0x7f1de80c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 >> 172.21.15.100:0/545234390 conn(0x7f1de8063090 msgr2=0x7f1de814eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:44.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 shutdown_connections 2024-01-22T05:39:44.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.452+0000 7f1deda00700 1 -- 172.21.15.100:0/545234390 wait complete. 2024-01-22T05:39:44.470 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T05:39:44.471 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-22T05:39:44.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.658+0000 7ffb5b400700 1 Processor -- start 2024-01-22T05:39:44.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.658+0000 7ffb5b400700 1 -- start start 2024-01-22T05:39:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb5b400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffb54154260 0x7ffb540cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb5b400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffb540c5c80 0x7ffb540c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb5b400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb540c1a40 con 0x7ffb540c65f0 2024-01-22T05:39:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb5b400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540cbd30 con 0x7ffb54154260 2024-01-22T05:39:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb5b400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540c6a80 con 0x7ffb540c5c80 2024-01-22T05:39:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb58a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffb54154260 0x7ffb540cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb58a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffb54154260 0x7ffb540cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53206/0 (socket says 172.21.15.100:53206) 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb59400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ffb540c65f0 0x7ffb54157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46134/0 (socket says 172.21.15.100:46134) 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.659+0000 7ffb58a00700 1 -- 172.21.15.100:0/2417061915 learned_addr learned my addr 172.21.15.100:0/2417061915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb53e00700 1 --2- 172.21.15.100:0/2417061915 >> v2:172.21.15.169:3300/0 conn(0x7ffb540c5c80 0x7ffb540c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb58a00700 1 -- 172.21.15.100:0/2417061915 >> v2:172.21.15.169:3300/0 conn(0x7ffb540c5c80 msgr2=0x7ffb540c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb58a00700 1 --2- 172.21.15.100:0/2417061915 >> v2:172.21.15.169:3300/0 conn(0x7ffb540c5c80 0x7ffb540c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb58a00700 1 -- 172.21.15.100:0/2417061915 >> v1:172.21.15.100:6789/0 conn(0x7ffb540c65f0 legacy=0x7ffb54157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb58a00700 1 -- 172.21.15.100:0/2417061915 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540c1110 con 0x7ffb54154260 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb53400700 1 -- 172.21.15.100:0/2417061915 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305175089 0 0) 0x7ffb540c1a40 con 0x7ffb540c65f0 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb58a00700 1 --2- 172.21.15.100:0/2417061915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb54154260 0x7ffb540cb4e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ffb54083230 tx=0x7ffb44009060).ready entity=mon.0 client_cookie=2230f5f7f0056669 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb53400700 1 -- 172.21.15.100:0/2417061915 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44005880 con 0x7ffb54154260 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb53400700 1 -- 172.21.15.100:0/2417061915 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb440059e0 con 0x7ffb54154260 2024-01-22T05:39:44.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.660+0000 7ffb53400700 1 -- 172.21.15.100:0/2417061915 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44005d60 con 0x7ffb54154260 2024-01-22T05:39:44.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 -- 172.21.15.100:0/2417061915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb54154260 msgr2=0x7ffb540cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 --2- 172.21.15.100:0/2417061915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb54154260 0x7ffb540cb4e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ffb54083230 tx=0x7ffb44009060).stop 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 -- 172.21.15.100:0/2417061915 shutdown_connections 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 --2- 172.21.15.100:0/2417061915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb54154260 0x7ffb540cb4e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 --2- 172.21.15.100:0/2417061915 >> v2:172.21.15.169:3300/0 conn(0x7ffb540c5c80 0x7ffb540c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 -- 172.21.15.100:0/2417061915 >> 172.21.15.100:0/2417061915 conn(0x7ffb5405e9d0 msgr2=0x7ffb540cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 -- 172.21.15.100:0/2417061915 shutdown_connections 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.661+0000 7ffb5b400700 1 -- 172.21.15.100:0/2417061915 wait complete. 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.662+0000 7ffb5b400700 1 Processor -- start 2024-01-22T05:39:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.663+0000 7ffb5b400700 1 -- start start 2024-01-22T05:39:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.663+0000 7ffb5b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb540c5c80 0x7ffb541656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.663+0000 7ffb5b400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb540c65f0 0x7ffb54167370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.663+0000 7ffb5b400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54154260 0x7ffb54164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb5b400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c9460 con 0x7ffb540c5c80 2024-01-22T05:39:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb5b400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb541514a0 con 0x7ffb54154260 2024-01-22T05:39:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb5b400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540abaa0 con 0x7ffb540c65f0 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb540c5c80 0x7ffb541656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb540c5c80 0x7ffb541656f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53222/0 (socket says 172.21.15.100:53222) 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 -- 172.21.15.100:0/3302203592 learned_addr learned my addr 172.21.15.100:0/3302203592 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb53e00700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb540c65f0 0x7ffb54167370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb59400700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54154260 0x7ffb54164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 -- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb540c65f0 msgr2=0x7ffb54167370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb540c65f0 0x7ffb54167370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 -- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54154260 msgr2=0x7ffb54164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54154260 0x7ffb54164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 -- 172.21.15.100:0/3302203592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009300 con 0x7ffb540c5c80 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.664+0000 7ffb58a00700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb540c5c80 0x7ffb541656f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7ffb44009f30 tx=0x7ffb44016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.665+0000 7ffb4be00700 1 -- 172.21.15.100:0/3302203592 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400b600 con 0x7ffb540c5c80 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.665+0000 7ffb4be00700 1 -- 172.21.15.100:0/3302203592 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4400b760 con 0x7ffb540c5c80 2024-01-22T05:39:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.665+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54167860 con 0x7ffb540c5c80 2024-01-22T05:39:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.665+0000 7ffb4be00700 1 -- 172.21.15.100:0/3302203592 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400bae0 con 0x7ffb540c5c80 2024-01-22T05:39:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.665+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb540ab7c0 con 0x7ffb540c5c80 2024-01-22T05:39:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.666+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5405fdb0 con 0x7ffb540c5c80 2024-01-22T05:39:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.667+0000 7ffb4be00700 1 -- 172.21.15.100:0/3302203592 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ffb44018070 con 0x7ffb540c5c80 2024-01-22T05:39:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.667+0000 7ffb4be00700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ffb2c05f150 0x7ffb2c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.667+0000 7ffb4be00700 1 -- 172.21.15.100:0/3302203592 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ffb4407ad70 con 0x7ffb540c5c80 2024-01-22T05:39:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.668+0000 7ffb53e00700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ffb2c05f150 0x7ffb2c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.668+0000 7ffb53e00700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ffb2c05f150 0x7ffb2c061610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ffb540ab0b0 tx=0x7ffb3c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.672+0000 7ffb4be00700 1 -- 172.21.15.100:0/3302203592 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffb4404c390 con 0x7ffb540c5c80 2024-01-22T05:39:44.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:44.841+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7ffb54084940 con 0x7ffb540c5c80 2024-01-22T05:39:45.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.297+0000 7ffb4be00700 1 -- 172.21.15.100:0/3302203592 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 152+0+0 (secure 0 0 0) 0x7ffb44006ad0 con 0x7ffb540c5c80 2024-01-22T05:39:45.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ffb2c05f150 msgr2=0x7ffb2c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:45.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ffb2c05f150 0x7ffb2c061610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ffb540ab0b0 tx=0x7ffb3c008040).stop 2024-01-22T05:39:45.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb540c5c80 msgr2=0x7ffb541656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:45.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb540c5c80 0x7ffb541656f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7ffb44009f30 tx=0x7ffb44016000).stop 2024-01-22T05:39:45.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 shutdown_connections 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ffb2c05f150 0x7ffb2c061610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54154260 0x7ffb54164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb540c5c80 0x7ffb541656f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 --2- 172.21.15.100:0/3302203592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb540c65f0 0x7ffb54167370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 >> 172.21.15.100:0/3302203592 conn(0x7ffb5405e9d0 msgr2=0x7ffb540a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 shutdown_connections 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.301+0000 7ffb5b400700 1 -- 172.21.15.100:0/3302203592 wait complete. 2024-01-22T05:39:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-01-22T05:39:45.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T05:39:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.509+0000 7ff5ffc00700 1 Processor -- start 2024-01-22T05:39:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.510+0000 7ff5ffc00700 1 -- start start 2024-01-22T05:39:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5ffc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f80681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5ffc00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5f8138820 0x7ff5f80686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5ffc00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f8064520 con 0x7ff5f80c5120 2024-01-22T05:39:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5ffc00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f8064e30 con 0x7ff5f8138820 2024-01-22T05:39:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5ffc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f8068bc0 con 0x7ff5f8138440 2024-01-22T05:39:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5f7e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5f8138820 0x7ff5f80686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5fdc00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff5f80c5120 0x7ff5f80c55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46146/0 (socket says 172.21.15.100:46146) 2024-01-22T05:39:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5fdc00700 1 -- 172.21.15.100:0/2138100770 learned_addr learned my addr 172.21.15.100:0/2138100770 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.511+0000 7ff5fd200700 1 --2- 172.21.15.100:0/2138100770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f80681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:45.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7400700 1 -- 172.21.15.100:0/2138100770 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172674057 0 0) 0x7ff5f8064520 con 0x7ff5f80c5120 2024-01-22T05:39:45.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7e00700 1 -- 172.21.15.100:0/2138100770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 msgr2=0x7ff5f80681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:45.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7e00700 1 --2- 172.21.15.100:0/2138100770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f80681e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7e00700 1 -- 172.21.15.100:0/2138100770 >> v1:172.21.15.100:6789/0 conn(0x7ff5f80c5120 legacy=0x7ff5f80c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:45.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7e00700 1 -- 172.21.15.100:0/2138100770 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80c5e50 con 0x7ff5f8138820 2024-01-22T05:39:45.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7e00700 1 --2- 172.21.15.100:0/2138100770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f80686d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7ff5e0009760 tx=0x7ff5e0009060).ready entity=mon.0 client_cookie=9720e2710363ae3a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7400700 1 -- 172.21.15.100:0/2138100770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00090d0 con 0x7ff5f8138820 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7400700 1 -- 172.21.15.100:0/2138100770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e000f510 con 0x7ff5f8138820 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.512+0000 7ff5f7400700 1 -- 172.21.15.100:0/2138100770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000f890 con 0x7ff5f8138820 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 -- 172.21.15.100:0/2138100770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 msgr2=0x7ff5f80686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/2138100770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f80686d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7ff5e0009760 tx=0x7ff5e0009060).stop 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 -- 172.21.15.100:0/2138100770 shutdown_connections 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/2138100770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f80681e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/2138100770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f80686d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 -- 172.21.15.100:0/2138100770 >> 172.21.15.100:0/2138100770 conn(0x7ff5f80630c0 msgr2=0x7ff5f80c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 -- 172.21.15.100:0/2138100770 shutdown_connections 2024-01-22T05:39:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.513+0000 7ff5ffc00700 1 -- 172.21.15.100:0/2138100770 wait complete. 2024-01-22T05:39:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.514+0000 7ff5ffc00700 1 Processor -- start 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.514+0000 7ff5ffc00700 1 -- start start 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.515+0000 7ff5ffc00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f80c5120 0x7ff5f81507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.515+0000 7ff5ffc00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f8167a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.515+0000 7ff5ffc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f8167f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.515+0000 7ff5ffc00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f8168470 con 0x7ff5f8138820 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.515+0000 7ff5ffc00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f812d920 con 0x7ff5f80c5120 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.515+0000 7ff5ffc00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80bdcc0 con 0x7ff5f8138440 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f8167f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f8167f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53230/0 (socket says 172.21.15.100:53230) 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 -- 172.21.15.100:0/1910487546 learned_addr learned my addr 172.21.15.100:0/1910487546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5f7e00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f8167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fd200700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f80c5120 0x7ff5f81507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 -- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 msgr2=0x7ff5f8167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f8167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 -- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f80c5120 msgr2=0x7ff5f81507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f80c5120 0x7ff5f81507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 -- 172.21.15.100:0/1910487546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00092a0 con 0x7ff5f8138820 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5fdc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f8167f80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff5f000c790 tx=0x7ff5f0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5efe00700 1 -- 172.21.15.100:0/1910487546 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0005d30 con 0x7ff5f8138820 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5efe00700 1 -- 172.21.15.100:0/1910487546 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0007110 con 0x7ff5f8138820 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f812cd10 con 0x7ff5f8138820 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.516+0000 7ff5efe00700 1 -- 172.21.15.100:0/1910487546 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00074d0 con 0x7ff5f8138820 2024-01-22T05:39:45.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.517+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f812d2d0 con 0x7ff5f8138820 2024-01-22T05:39:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.518+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f812dab0 con 0x7ff5f8138820 2024-01-22T05:39:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.518+0000 7ff5efe00700 1 -- 172.21.15.100:0/1910487546 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff5f0007840 con 0x7ff5f8138820 2024-01-22T05:39:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.519+0000 7ff5efe00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5d005f150 0x7ff5d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.519+0000 7ff5efe00700 1 -- 172.21.15.100:0/1910487546 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ff5f0079f50 con 0x7ff5f8138820 2024-01-22T05:39:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.519+0000 7ff5fd200700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5d005f150 0x7ff5d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:45.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.520+0000 7ff5fd200700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5d005f150 0x7ff5d0061610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff5e8009c30 tx=0x7ff5e8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:45.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.524+0000 7ff5efe00700 1 -- 172.21.15.100:0/1910487546 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5f004b340 con 0x7ff5f8138820 2024-01-22T05:39:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:45.693+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff5f805fdb0 con 0x7ff5f8138820 2024-01-22T05:39:45.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-01-22T05:39:46.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.279+0000 7ff5efe00700 1 -- 172.21.15.100:0/1910487546 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff5f004e960 con 0x7ff5f8138820 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.288+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5d005f150 msgr2=0x7ff5d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.288+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5d005f150 0x7ff5d0061610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff5e8009c30 tx=0x7ff5e8009060).stop 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.288+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 msgr2=0x7ff5f8167f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.288+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f8167f80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff5f000c790 tx=0x7ff5f0007f30).stop 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.289+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 shutdown_connections 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.289+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff5d005f150 0x7ff5d0061610 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0x7ff5e8009c30 tx=0x7ff5e8009060).stop 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.289+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f80c5120 0x7ff5f81507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.289+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8138820 0x7ff5f8167f80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.289+0000 7ff5ffc00700 1 --2- 172.21.15.100:0/1910487546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5f8138440 0x7ff5f8167a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.289+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 >> 172.21.15.100:0/1910487546 conn(0x7ff5f80630c0 msgr2=0x7ff5f8151780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:46.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.290+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 shutdown_connections 2024-01-22T05:39:46.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.291+0000 7ff5ffc00700 1 -- 172.21.15.100:0/1910487546 wait complete. 2024-01-22T05:39:46.297 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-01-22T05:39:46.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T05:39:46.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.512+0000 7fb753a00700 1 Processor -- start 2024-01-22T05:39:46.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.512+0000 7fb753a00700 1 -- start start 2024-01-22T05:39:46.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb753a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb74c0a9f60 0x7fb74c0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb753a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb74c0c1940 0x7fb74c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb753a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74c0c74b0 con 0x7fb74c05e1f0 2024-01-22T05:39:46.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb753a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74c0cab90 con 0x7fb74c0a9f60 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb753a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74c158660 con 0x7fb74c0c1940 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb74c0a9f60 0x7fb74c0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb74c05e1f0 0x7fb74c098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46148/0 (socket says 172.21.15.100:46148) 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751a00700 1 -- 172.21.15.100:0/775255654 learned_addr learned my addr 172.21.15.100:0/775255654 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751000700 1 --2- 172.21.15.100:0/775255654 >> v2:172.21.15.100:3300/0 conn(0x7fb74c0a9f60 0x7fb74c0aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53244/0 (socket says 172.21.15.100:53244) 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb74be00700 1 --2- 172.21.15.100:0/775255654 >> v2:172.21.15.169:3300/0 conn(0x7fb74c0c1940 0x7fb74c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751000700 1 -- 172.21.15.100:0/775255654 >> v2:172.21.15.169:3300/0 conn(0x7fb74c0c1940 msgr2=0x7fb74c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751000700 1 --2- 172.21.15.100:0/775255654 >> v2:172.21.15.169:3300/0 conn(0x7fb74c0c1940 0x7fb74c0ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751000700 1 -- 172.21.15.100:0/775255654 >> v1:172.21.15.100:6789/0 conn(0x7fb74c05e1f0 legacy=0x7fb74c098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.514+0000 7fb751000700 1 -- 172.21.15.100:0/775255654 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c158940 con 0x7fb74c0a9f60 2024-01-22T05:39:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb751000700 1 --2- 172.21.15.100:0/775255654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c0a9f60 0x7fb74c0aa340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fb74c0c88d0 tx=0x7fb73c009060).ready entity=mon.0 client_cookie=c30e1eed9bebd1b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb74b400700 1 -- 172.21.15.100:0/775255654 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00b580 con 0x7fb74c0a9f60 2024-01-22T05:39:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb74b400700 1 -- 172.21.15.100:0/775255654 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00b6e0 con 0x7fb74c0a9f60 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb74b400700 1 -- 172.21.15.100:0/775255654 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00ba60 con 0x7fb74c0a9f60 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb753a00700 1 -- 172.21.15.100:0/775255654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c0a9f60 msgr2=0x7fb74c0aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb753a00700 1 --2- 172.21.15.100:0/775255654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c0a9f60 0x7fb74c0aa340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fb74c0c88d0 tx=0x7fb73c009060).stop 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb753a00700 1 -- 172.21.15.100:0/775255654 shutdown_connections 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb753a00700 1 --2- 172.21.15.100:0/775255654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c0a9f60 0x7fb74c0aa340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb753a00700 1 --2- 172.21.15.100:0/775255654 >> v2:172.21.15.169:3300/0 conn(0x7fb74c0c1940 0x7fb74c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.515+0000 7fb753a00700 1 -- 172.21.15.100:0/775255654 >> 172.21.15.100:0/775255654 conn(0x7fb74c0cada0 msgr2=0x7fb74c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.516+0000 7fb753a00700 1 -- 172.21.15.100:0/775255654 shutdown_connections 2024-01-22T05:39:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.516+0000 7fb753a00700 1 -- 172.21.15.100:0/775255654 wait complete. 2024-01-22T05:39:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.518+0000 7fb753a00700 1 Processor -- start 2024-01-22T05:39:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.518+0000 7fb753a00700 1 -- start start 2024-01-22T05:39:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb753a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c05e1f0 0x7fb74c0c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb753a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb74c0a9f60 0x7fb74c0c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb753a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb74c0c1940 0x7fb74c152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb753a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0ab6c0 con 0x7fb74c05e1f0 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb753a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0c32b0 con 0x7fb74c0c1940 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb753a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0c3590 con 0x7fb74c0a9f60 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb751000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c05e1f0 0x7fb74c0c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb751000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c05e1f0 0x7fb74c0c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53248/0 (socket says 172.21.15.100:53248) 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.519+0000 7fb751000700 1 -- 172.21.15.100:0/3300633576 learned_addr learned my addr 172.21.15.100:0/3300633576 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb74be00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb74c0a9f60 0x7fb74c0c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb74c0c1940 0x7fb74c152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751000700 1 -- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb74c0a9f60 msgr2=0x7fb74c0c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751000700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb74c0a9f60 0x7fb74c0c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751000700 1 -- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb74c0c1940 msgr2=0x7fb74c152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751000700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb74c0c1940 0x7fb74c152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751000700 1 -- 172.21.15.100:0/3300633576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c0092a0 con 0x7fb74c05e1f0 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb74be00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb74c0a9f60 0x7fb74c0c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb74c0c1940 0x7fb74c152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb751000700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c05e1f0 0x7fb74c0c2cf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fb73c009e80 tx=0x7fb73c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb743e00700 1 -- 172.21.15.100:0/3300633576 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00ba60 con 0x7fb74c05e1f0 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb743e00700 1 -- 172.21.15.100:0/3300633576 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c000c90 con 0x7fb74c05e1f0 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb743e00700 1 -- 172.21.15.100:0/3300633576 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c01b640 con 0x7fb74c05e1f0 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c0c3870 con 0x7fb74c05e1f0 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.520+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c0c48e0 con 0x7fb74c05e1f0 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.522+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c05fdb0 con 0x7fb74c05e1f0 2024-01-22T05:39:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.522+0000 7fb743e00700 1 -- 172.21.15.100:0/3300633576 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb73c01b9f0 con 0x7fb74c05e1f0 2024-01-22T05:39:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.523+0000 7fb743e00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72405f150 0x7fb724061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.523+0000 7fb743e00700 1 -- 172.21.15.100:0/3300633576 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fb73c07bb00 con 0x7fb74c05e1f0 2024-01-22T05:39:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.523+0000 7fb74be00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72405f150 0x7fb724061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.524+0000 7fb74be00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72405f150 0x7fb724061610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb74c0c31e0 tx=0x7fb734008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.528+0000 7fb743e00700 1 -- 172.21.15.100:0/3300633576 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb73c04ce30 con 0x7fb74c05e1f0 2024-01-22T05:39:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.738+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb74c0ca030 con 0x7fb74c05e1f0 2024-01-22T05:39:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.745+0000 7fb743e00700 1 -- 172.21.15.100:0/3300633576 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb73c050450 con 0x7fb74c05e1f0 2024-01-22T05:39:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.749+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72405f150 msgr2=0x7fb724061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.749+0000 7fb753a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72405f150 0x7fb724061610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb74c0c31e0 tx=0x7fb734008040).stop 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.750+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c05e1f0 msgr2=0x7fb74c0c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.750+0000 7fb753a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c05e1f0 0x7fb74c0c2cf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fb73c009e80 tx=0x7fb73c017000).stop 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.751+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 shutdown_connections 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.751+0000 7fb753a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb72405f150 0x7fb724061610 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.751+0000 7fb753a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb74c0c1940 0x7fb74c152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.751+0000 7fb753a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74c05e1f0 0x7fb74c0c2cf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.751+0000 7fb753a00700 1 --2- 172.21.15.100:0/3300633576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb74c0a9f60 0x7fb74c0c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.751+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 >> 172.21.15.100:0/3300633576 conn(0x7fb74c0cada0 msgr2=0x7fb74c157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:46.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.752+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 shutdown_connections 2024-01-22T05:39:46.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.754+0000 7fb753a00700 1 -- 172.21.15.100:0/3300633576 wait complete. 2024-01-22T05:39:46.758 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 8 and data pool 9 2024-01-22T05:39:46.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:46.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.965+0000 7f394c600700 1 Processor -- start 2024-01-22T05:39:46.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.965+0000 7f394c600700 1 -- start start 2024-01-22T05:39:46.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.966+0000 7f394c600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3944154060 0x7f3944154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.966+0000 7f394c600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f39440c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.966+0000 7f394c600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440cb880 con 0x7f39440a9ec0 2024-01-22T05:39:46.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.966+0000 7f394c600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39440cbb60 con 0x7f3944154060 2024-01-22T05:39:46.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.966+0000 7f394c600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440c17d0 con 0x7f39440aa3f0 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3944154060 0x7f3944154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3944154060 0x7f3944154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53260/0 (socket says 172.21.15.100:53260) 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 -- 172.21.15.100:0/182064833 learned_addr learned my addr 172.21.15.100:0/182064833 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949200700 1 --2- 172.21.15.100:0/182064833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f39440c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 -- 172.21.15.100:0/182064833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 msgr2=0x7f39440c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 --2- 172.21.15.100:0/182064833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f39440c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 -- 172.21.15.100:0/182064833 >> v1:172.21.15.169:6789/0 conn(0x7f39440a9ec0 legacy=0x7f39440c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 -- 172.21.15.100:0/182064833 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39440c1ab0 con 0x7f3944154060 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3949c00700 1 --2- 172.21.15.100:0/182064833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f3944154440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f3934006fd0 tx=0x7f39340090f0).ready entity=mon.0 client_cookie=eba7d06c7e2d88b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3943e00700 1 -- 172.21.15.100:0/182064833 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400b600 con 0x7f3944154060 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3943e00700 1 -- 172.21.15.100:0/182064833 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400b760 con 0x7f3944154060 2024-01-22T05:39:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.967+0000 7f3943e00700 1 -- 172.21.15.100:0/182064833 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400bae0 con 0x7f3944154060 2024-01-22T05:39:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 -- 172.21.15.100:0/182064833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 msgr2=0x7f3944154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 --2- 172.21.15.100:0/182064833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f3944154440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f3934006fd0 tx=0x7f39340090f0).stop 2024-01-22T05:39:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 -- 172.21.15.100:0/182064833 shutdown_connections 2024-01-22T05:39:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 --2- 172.21.15.100:0/182064833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f3944154440 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 --2- 172.21.15.100:0/182064833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f39440c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 -- 172.21.15.100:0/182064833 >> 172.21.15.100:0/182064833 conn(0x7f394405e9d0 msgr2=0x7f39440cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 -- 172.21.15.100:0/182064833 shutdown_connections 2024-01-22T05:39:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.968+0000 7f394c600700 1 -- 172.21.15.100:0/182064833 wait complete. 2024-01-22T05:39:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.970+0000 7f394c600700 1 Processor -- start 2024-01-22T05:39:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.970+0000 7f394c600700 1 -- start start 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.970+0000 7f394c600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39440a9ec0 0x7f39440af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394c600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f394414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394c600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f39440afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394c600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394414a5f0 con 0x7f3944154060 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394c600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3944154440 con 0x7f39440a9ec0 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394c600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440b0140 con 0x7f39440aa3f0 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f39440afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f39440afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53268/0 (socket says 172.21.15.100:53268) 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 -- 172.21.15.100:0/2621809986 learned_addr learned my addr 172.21.15.100:0/2621809986 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f3949c00700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39440a9ec0 0x7f39440af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f3949200700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f394414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 -- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 msgr2=0x7f394414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f394414a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 -- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39440a9ec0 msgr2=0x7f39440af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39440a9ec0 0x7f39440af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 -- 172.21.15.100:0/2621809986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934009370 con 0x7f3944154060 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f3949200700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f394414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.971+0000 7f394a600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f39440afc50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f393c00c790 tx=0x7f393c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.972+0000 7f3940c00700 1 -- 172.21.15.100:0/2621809986 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c010510 con 0x7f3944154060 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.972+0000 7f3940c00700 1 -- 172.21.15.100:0/2621809986 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c010670 con 0x7f3944154060 2024-01-22T05:39:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.972+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39440b0410 con 0x7f3944154060 2024-01-22T05:39:46.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.972+0000 7f3940c00700 1 -- 172.21.15.100:0/2621809986 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0109f0 con 0x7f3944154060 2024-01-22T05:39:46.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.972+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39440b09d0 con 0x7f3944154060 2024-01-22T05:39:46.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.973+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39440c5270 con 0x7f3944154060 2024-01-22T05:39:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.974+0000 7f3940c00700 1 -- 172.21.15.100:0/2621809986 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f393c01b400 con 0x7f3944154060 2024-01-22T05:39:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.974+0000 7f3940c00700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f391c05f120 0x7f391c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.975+0000 7f3940c00700 1 -- 172.21.15.100:0/2621809986 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f393c07a040 con 0x7f3944154060 2024-01-22T05:39:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.975+0000 7f3949c00700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f391c05f120 0x7f391c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.975+0000 7f3949c00700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f391c05f120 0x7f391c0615e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f3934009130 tx=0x7f3934017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:46.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:46.979+0000 7f3940c00700 1 -- 172.21.15.100:0/2621809986 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f393c04b270 con 0x7f3944154060 2024-01-22T05:39:47.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.148+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394406abb0 con 0x7f3944154060 2024-01-22T05:39:47.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.149+0000 7f3940c00700 1 -- 172.21.15.100:0/2621809986 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f393c04e890 con 0x7f3944154060 2024-01-22T05:39:47.150 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:47.151 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":51,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:46.740409+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:39:44.885259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:39:45.737245+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.151+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f391c05f120 msgr2=0x7f391c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.151+0000 7f394c600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f391c05f120 0x7f391c0615e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f3934009130 tx=0x7f3934017000).stop 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.151+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 msgr2=0x7f39440afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.151+0000 7f394c600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f39440afc50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f393c00c790 tx=0x7f393c0015e0).stop 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 shutdown_connections 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f391c05f120 0x7f391c0615e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39440a9ec0 0x7f39440af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3944154060 0x7f39440afc50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 --2- 172.21.15.100:0/2621809986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39440aa3f0 0x7f394414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 >> 172.21.15.100:0/2621809986 conn(0x7f394405e9d0 msgr2=0x7f39440a8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 shutdown_connections 2024-01-22T05:39:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.152+0000 7f394c600700 1 -- 172.21.15.100:0/2621809986 wait complete. 2024-01-22T05:39:47.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:47.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.355+0000 7ff139800700 1 Processor -- start 2024-01-22T05:39:47.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.355+0000 7ff139800700 1 -- start start 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.356+0000 7ff139800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff134153ee0 0x7ff1340c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.356+0000 7ff139800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1341542c0 0x7ff1340c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.356+0000 7ff139800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1340928b0 con 0x7ff1340be2d0 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.356+0000 7ff139800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340c4870 con 0x7ff1341542c0 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.356+0000 7ff139800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340bef90 con 0x7ff134153ee0 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1341542c0 0x7ff1340c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1341542c0 0x7ff1340c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53284/0 (socket says 172.21.15.100:53284) 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 -- 172.21.15.100:0/1660479477 learned_addr learned my addr 172.21.15.100:0/1660479477 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132a00700 1 --2- 172.21.15.100:0/1660479477 >> v2:172.21.15.169:3300/0 conn(0x7ff134153ee0 0x7ff1340c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 -- 172.21.15.100:0/1660479477 >> v2:172.21.15.169:3300/0 conn(0x7ff134153ee0 msgr2=0x7ff1340c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 --2- 172.21.15.100:0/1660479477 >> v2:172.21.15.169:3300/0 conn(0x7ff134153ee0 0x7ff1340c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 -- 172.21.15.100:0/1660479477 >> v1:172.21.15.169:6789/0 conn(0x7ff1340be2d0 legacy=0x7ff1340be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 -- 172.21.15.100:0/1660479477 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340bfba0 con 0x7ff1341542c0 2024-01-22T05:39:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff132000700 1 --2- 172.21.15.100:0/1660479477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1341542c0 0x7ff1340c4380 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7ff134063410 tx=0x7ff11c0090f0).ready entity=mon.0 client_cookie=dfa2745dc685330e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff131600700 1 -- 172.21.15.100:0/1660479477 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00b5a0 con 0x7ff1341542c0 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff131600700 1 -- 172.21.15.100:0/1660479477 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00b700 con 0x7ff1341542c0 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.357+0000 7ff131600700 1 -- 172.21.15.100:0/1660479477 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00ba80 con 0x7ff1341542c0 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 -- 172.21.15.100:0/1660479477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1341542c0 msgr2=0x7ff1340c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 --2- 172.21.15.100:0/1660479477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1341542c0 0x7ff1340c4380 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7ff134063410 tx=0x7ff11c0090f0).stop 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 -- 172.21.15.100:0/1660479477 shutdown_connections 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 --2- 172.21.15.100:0/1660479477 >> v2:172.21.15.169:3300/0 conn(0x7ff134153ee0 0x7ff1340c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 --2- 172.21.15.100:0/1660479477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1341542c0 0x7ff1340c4380 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 -- 172.21.15.100:0/1660479477 >> 172.21.15.100:0/1660479477 conn(0x7ff134091a00 msgr2=0x7ff134091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 -- 172.21.15.100:0/1660479477 shutdown_connections 2024-01-22T05:39:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.358+0000 7ff139800700 1 -- 172.21.15.100:0/1660479477 wait complete. 2024-01-22T05:39:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.360+0000 7ff139800700 1 Processor -- start 2024-01-22T05:39:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.360+0000 7ff139800700 1 -- start start 2024-01-22T05:39:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff139800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1340be2d0 0x7ff134150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff139800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff134153ee0 0x7ff1340ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff139800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1341542c0 0x7ff1340a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff139800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340ace90 con 0x7ff1340be2d0 2024-01-22T05:39:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff139800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340ad170 con 0x7ff1341542c0 2024-01-22T05:39:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff139800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340ad450 con 0x7ff134153ee0 2024-01-22T05:39:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1340be2d0 0x7ff134150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1340be2d0 0x7ff134150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53290/0 (socket says 172.21.15.100:53290) 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 -- 172.21.15.100:0/4187613096 learned_addr learned my addr 172.21.15.100:0/4187613096 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132000700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff134153ee0 0x7ff1340ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff133400700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1341542c0 0x7ff1340a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 -- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff134153ee0 msgr2=0x7ff1340ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff134153ee0 0x7ff1340ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 -- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1341542c0 msgr2=0x7ff1340a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1341542c0 0x7ff1340a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 -- 172.21.15.100:0/4187613096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009370 con 0x7ff1340be2d0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.361+0000 7ff132a00700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1340be2d0 0x7ff134150ce0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff12400d860 tx=0x7ff124008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.362+0000 7ff12a000700 1 -- 172.21.15.100:0/4187613096 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240125f0 con 0x7ff1340be2d0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.362+0000 7ff12a000700 1 -- 172.21.15.100:0/4187613096 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124012750 con 0x7ff1340be2d0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.362+0000 7ff12a000700 1 -- 172.21.15.100:0/4187613096 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124012ad0 con 0x7ff1340be2d0 2024-01-22T05:39:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.362+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff134164880 con 0x7ff1340be2d0 2024-01-22T05:39:47.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.362+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff134164530 con 0x7ff1340be2d0 2024-01-22T05:39:47.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.363+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13405fdb0 con 0x7ff1340be2d0 2024-01-22T05:39:47.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.363+0000 7ff12a000700 1 -- 172.21.15.100:0/4187613096 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff124013480 con 0x7ff1340be2d0 2024-01-22T05:39:47.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.364+0000 7ff12a000700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff10c05f150 0x7ff10c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.364+0000 7ff12a000700 1 -- 172.21.15.100:0/4187613096 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff12407a570 con 0x7ff1340be2d0 2024-01-22T05:39:47.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.364+0000 7ff132000700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff10c05f150 0x7ff10c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.365+0000 7ff132000700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff10c05f150 0x7ff10c061610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff11c009130 tx=0x7ff11c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.368+0000 7ff12a000700 1 -- 172.21.15.100:0/4187613096 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff12404b7e0 con 0x7ff1340be2d0 2024-01-22T05:39:47.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.539+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1340bf270 con 0x7ff1340be2d0 2024-01-22T05:39:47.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.540+0000 7ff12a000700 1 -- 172.21.15.100:0/4187613096 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16989 (secure 0 0 0) 0x7ff12404ee00 con 0x7ff1340be2d0 2024-01-22T05:39:47.541 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:47.541 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":51,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:46.740409+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:39:44.885259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:39:45.737245+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:47.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.541+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff10c05f150 msgr2=0x7ff10c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.541+0000 7ff139800700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff10c05f150 0x7ff10c061610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff11c009130 tx=0x7ff11c015000).stop 2024-01-22T05:39:47.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.541+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1340be2d0 msgr2=0x7ff134150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.541+0000 7ff139800700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1340be2d0 0x7ff134150ce0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff12400d860 tx=0x7ff124008040).stop 2024-01-22T05:39:47.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 shutdown_connections 2024-01-22T05:39:47.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff10c05f150 0x7ff10c061610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1341542c0 0x7ff1340a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1340be2d0 0x7ff134150ce0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 --2- 172.21.15.100:0/4187613096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff134153ee0 0x7ff1340ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 >> 172.21.15.100:0/4187613096 conn(0x7ff134091a00 msgr2=0x7ff1340c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:47.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 shutdown_connections 2024-01-22T05:39:47.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.542+0000 7ff139800700 1 -- 172.21.15.100:0/4187613096 wait complete. 2024-01-22T05:39:47.561 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T05:39:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.746+0000 7f2b9c600700 1 Processor -- start 2024-01-22T05:39:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.746+0000 7f2b9c600700 1 -- start start 2024-01-22T05:39:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.747+0000 7f2b9c600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.747+0000 7f2b9c600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b940c74b0 con 0x7f2b940a9f60 2024-01-22T05:39:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.747+0000 7f2b9c600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b94158660 con 0x7f2b940c1940 2024-01-22T05:39:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.747+0000 7f2b9c600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94158940 con 0x7f2b9405e900 2024-01-22T05:39:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.747+0000 7f2b99c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2b940a9f60 0x7f2b9405e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46162/0 (socket says 172.21.15.100:46162) 2024-01-22T05:39:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b99c00700 1 -- 172.21.15.100:0/1020638175 learned_addr learned my addr 172.21.15.100:0/1020638175 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b99200700 1 --2- 172.21.15.100:0/1020638175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b93e00700 1 -- 172.21.15.100:0/1020638175 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885715790 0 0) 0x7f2b940c74b0 con 0x7f2b940a9f60 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b93e00700 1 -- 172.21.15.100:0/1020638175 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b740033f0 con 0x7f2b940a9f60 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b93e00700 1 -- 172.21.15.100:0/1020638175 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399357915 0 0) 0x7f2b740033f0 con 0x7f2b940a9f60 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b99200700 1 -- 172.21.15.100:0/1020638175 >> v1:172.21.15.169:6789/0 conn(0x7f2b940c1940 legacy=0x7f2b94098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b99200700 1 -- 172.21.15.100:0/1020638175 >> v1:172.21.15.100:6789/0 conn(0x7f2b940a9f60 legacy=0x7f2b9405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b99200700 1 -- 172.21.15.100:0/1020638175 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940c7140 con 0x7f2b9405e900 2024-01-22T05:39:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.748+0000 7f2b99200700 1 --2- 172.21.15.100:0/1020638175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940aa340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2b7c009790 tx=0x7f2b7c009060).ready entity=mon.2 client_cookie=f06c0b0c48e65fdd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.750+0000 7f2b93e00700 1 -- 172.21.15.100:0/1020638175 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84001470 con 0x7f2b9405e900 2024-01-22T05:39:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.750+0000 7f2b93e00700 1 -- 172.21.15.100:0/1020638175 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c011400 con 0x7f2b9405e900 2024-01-22T05:39:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.750+0000 7f2b93e00700 1 -- 172.21.15.100:0/1020638175 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011780 con 0x7f2b9405e900 2024-01-22T05:39:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.751+0000 7f2b9c600700 1 -- 172.21.15.100:0/1020638175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 msgr2=0x7f2b940aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.751+0000 7f2b9c600700 1 --2- 172.21.15.100:0/1020638175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940aa340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2b7c009790 tx=0x7f2b7c009060).stop 2024-01-22T05:39:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.751+0000 7f2b9c600700 1 -- 172.21.15.100:0/1020638175 shutdown_connections 2024-01-22T05:39:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.751+0000 7f2b9c600700 1 --2- 172.21.15.100:0/1020638175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940aa340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.751+0000 7f2b9c600700 1 -- 172.21.15.100:0/1020638175 >> 172.21.15.100:0/1020638175 conn(0x7f2b940cada0 msgr2=0x7f2b940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.751+0000 7f2b9c600700 1 -- 172.21.15.100:0/1020638175 shutdown_connections 2024-01-22T05:39:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.751+0000 7f2b9c600700 1 -- 172.21.15.100:0/1020638175 wait complete. 2024-01-22T05:39:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.752+0000 7f2b9c600700 1 Processor -- start 2024-01-22T05:39:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.753+0000 7f2b9c600700 1 -- start start 2024-01-22T05:39:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.753+0000 7f2b9c600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.753+0000 7f2b9c600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b940a9f60 0x7f2b94156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b9c600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b940c1940 0x7f2b94164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b9c600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b941573f0 con 0x7f2b940a9f60 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b9c600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94155210 con 0x7f2b940c1940 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b9c600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b940c2ef0 con 0x7f2b9405e900 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b940a9f60 0x7f2b94156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b940a9f60 0x7f2b94156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53306/0 (socket says 172.21.15.100:53306) 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 -- 172.21.15.100:0/3289502088 learned_addr learned my addr 172.21.15.100:0/3289502088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99c00700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b9a600700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b940c1940 0x7f2b94164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 -- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 msgr2=0x7f2b940ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 -- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b940c1940 msgr2=0x7f2b94164120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b940c1940 0x7f2b94164120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 -- 172.21.15.100:0/3289502088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0092a0 con 0x7f2b940a9f60 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.754+0000 7f2b99200700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b940a9f60 0x7f2b94156c60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f2b940c8880 tx=0x7f2b7c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.755+0000 7f2b90c00700 1 -- 172.21.15.100:0/3289502088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0108b0 con 0x7f2b940a9f60 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.755+0000 7f2b90c00700 1 -- 172.21.15.100:0/3289502088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c010a10 con 0x7f2b940a9f60 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.755+0000 7f2b90c00700 1 -- 172.21.15.100:0/3289502088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c010db0 con 0x7f2b940a9f60 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.755+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b94157150 con 0x7f2b940a9f60 2024-01-22T05:39:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.755+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b940c2c10 con 0x7f2b940a9f60 2024-01-22T05:39:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.756+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b94155350 con 0x7f2b940a9f60 2024-01-22T05:39:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.757+0000 7f2b90c00700 1 -- 172.21.15.100:0/3289502088 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2b7c01d640 con 0x7f2b940a9f60 2024-01-22T05:39:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.757+0000 7f2b90c00700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2b6c05f150 0x7f2b6c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.757+0000 7f2b90c00700 1 -- 172.21.15.100:0/3289502088 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2b7c07b830 con 0x7f2b940a9f60 2024-01-22T05:39:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.758+0000 7f2b99c00700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2b6c05f150 0x7f2b6c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.758+0000 7f2b99c00700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2b6c05f150 0x7f2b6c061610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2b840011e0 tx=0x7f2b84000bc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.761+0000 7f2b90c00700 1 -- 172.21.15.100:0/3289502088 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2b94155350 con 0x7f2b940a9f60 2024-01-22T05:39:47.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:47.977+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2b94155350 con 0x7f2b940a9f60 2024-01-22T05:39:48.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.755+0000 7f2b90c00700 1 -- 172.21.15.100:0/3289502088 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2b94155350 con 0x7f2b940a9f60 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2b6c05f150 msgr2=0x7f2b6c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2b6c05f150 0x7f2b6c061610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2b840011e0 tx=0x7f2b84000bc0).stop 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b940a9f60 msgr2=0x7f2b94156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b940a9f60 0x7f2b94156c60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f2b940c8880 tx=0x7f2b7c016000).stop 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 shutdown_connections 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f2b6c05f150 0x7f2b6c061610 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b940c1940 0x7f2b94164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b9405e900 0x7f2b940ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 --2- 172.21.15.100:0/3289502088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b940a9f60 0x7f2b94156c60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.758+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 >> 172.21.15.100:0/3289502088 conn(0x7f2b940cada0 msgr2=0x7f2b940cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.759+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 shutdown_connections 2024-01-22T05:39:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.759+0000 7f2b9c600700 1 -- 172.21.15.100:0/3289502088 wait complete. 2024-01-22T05:39:48.779 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T05:39:48.779 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T05:39:48.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.969+0000 7f9d0b000700 1 Processor -- start 2024-01-22T05:39:48.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.969+0000 7f9d0b000700 1 -- start start 2024-01-22T05:39:48.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.970+0000 7f9d0b000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d040a9f60 0x7f9d040aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:48.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d0b000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9d040c1940 0x7f9d040ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:48.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d0b000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d040c74b0 con 0x7f9d0405e1f0 2024-01-22T05:39:48.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d0b000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040cab90 con 0x7f9d040c1940 2024-01-22T05:39:48.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d0b000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04158660 con 0x7f9d040a9f60 2024-01-22T05:39:48.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d03e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d040a9f60 0x7f9d040aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:48.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d03400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9d040c1940 0x7f9d040ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d03e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d040a9f60 0x7f9d040aa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:42084/0 (socket says 172.21.15.100:42084) 2024-01-22T05:39:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.971+0000 7f9d03e00700 1 -- 172.21.15.100:0/3337080443 learned_addr learned my addr 172.21.15.100:0/3337080443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d03e00700 1 -- 172.21.15.100:0/3337080443 >> v2:172.21.15.169:3300/0 conn(0x7f9d040c1940 msgr2=0x7f9d040ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d03e00700 1 --2- 172.21.15.100:0/3337080443 >> v2:172.21.15.169:3300/0 conn(0x7f9d040c1940 0x7f9d040ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d03e00700 1 -- 172.21.15.100:0/3337080443 >> v1:172.21.15.169:6789/0 conn(0x7f9d0405e1f0 legacy=0x7f9d04098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d03e00700 1 -- 172.21.15.100:0/3337080443 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d04158940 con 0x7f9d040a9f60 2024-01-22T05:39:48.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d03400700 1 --2- 172.21.15.100:0/3337080443 >> v2:172.21.15.169:3300/0 conn(0x7f9d040c1940 0x7f9d040ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d03e00700 1 --2- 172.21.15.100:0/3337080443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d040a9f60 0x7f9d040aa340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9cf4006fd0 tx=0x7f9cf40090f0).ready entity=mon.2 client_cookie=79953d8583a0de0c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d02a00700 1 -- 172.21.15.100:0/3337080443 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400b580 con 0x7f9d040a9f60 2024-01-22T05:39:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d02a00700 1 -- 172.21.15.100:0/3337080443 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400b6e0 con 0x7f9d040a9f60 2024-01-22T05:39:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.972+0000 7f9d02a00700 1 -- 172.21.15.100:0/3337080443 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400ba60 con 0x7f9d040a9f60 2024-01-22T05:39:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 -- 172.21.15.100:0/3337080443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d040a9f60 msgr2=0x7f9d040aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 --2- 172.21.15.100:0/3337080443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d040a9f60 0x7f9d040aa340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9cf4006fd0 tx=0x7f9cf40090f0).stop 2024-01-22T05:39:48.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 -- 172.21.15.100:0/3337080443 shutdown_connections 2024-01-22T05:39:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 --2- 172.21.15.100:0/3337080443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d040a9f60 0x7f9d040aa340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 --2- 172.21.15.100:0/3337080443 >> v2:172.21.15.169:3300/0 conn(0x7f9d040c1940 0x7f9d040ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 -- 172.21.15.100:0/3337080443 >> 172.21.15.100:0/3337080443 conn(0x7f9d040cada0 msgr2=0x7f9d040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 -- 172.21.15.100:0/3337080443 shutdown_connections 2024-01-22T05:39:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.973+0000 7f9d0b000700 1 -- 172.21.15.100:0/3337080443 wait complete. 2024-01-22T05:39:48.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.974+0000 7f9d0b000700 1 Processor -- start 2024-01-22T05:39:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.974+0000 7f9d0b000700 1 -- start start 2024-01-22T05:39:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.975+0000 7f9d0b000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d0405e1f0 0x7f9d04152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.975+0000 7f9d0b000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d040a9f60 0x7f9d040aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.975+0000 7f9d0b000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040c1940 0x7f9d040ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.975+0000 7f9d0b000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04165630 con 0x7f9d040c1940 2024-01-22T05:39:48.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.975+0000 7f9d0b000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040c36b0 con 0x7f9d040a9f60 2024-01-22T05:39:48.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.975+0000 7f9d0b000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04165350 con 0x7f9d0405e1f0 2024-01-22T05:39:48.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.975+0000 7f9d09000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040c1940 0x7f9d040ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:48.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d040a9f60 0x7f9d040aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:48.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d0405e1f0 0x7f9d04152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:48.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d040a9f60 0x7f9d040aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:51058/0 (socket says 172.21.15.100:51058) 2024-01-22T05:39:48.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03400700 1 -- 172.21.15.100:0/25985996 learned_addr learned my addr 172.21.15.100:0/25985996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:48.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03e00700 1 -- 172.21.15.100:0/25985996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d040a9f60 msgr2=0x7f9d040aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:48.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03e00700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d040a9f60 0x7f9d040aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03e00700 1 -- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040c1940 msgr2=0x7f9d040ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03e00700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040c1940 0x7f9d040ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03e00700 1 -- 172.21.15.100:0/25985996 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0092a0 con 0x7f9d0405e1f0 2024-01-22T05:39:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d09000700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040c1940 0x7f9d040ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9d03e00700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d0405e1f0 0x7f9d04152ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9cf4014000 tx=0x7f9cf4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:48.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.976+0000 7f9cfb400700 1 -- 172.21.15.100:0/25985996 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4000bc0 con 0x7f9d0405e1f0 2024-01-22T05:39:48.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.977+0000 7f9cfb400700 1 -- 172.21.15.100:0/25985996 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400b850 con 0x7f9d0405e1f0 2024-01-22T05:39:48.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.977+0000 7f9cfb400700 1 -- 172.21.15.100:0/25985996 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4000d20 con 0x7f9d0405e1f0 2024-01-22T05:39:48.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.977+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf4009370 con 0x7f9d0405e1f0 2024-01-22T05:39:48.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.977+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d040c3c30 con 0x7f9d0405e1f0 2024-01-22T05:39:48.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.978+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0405fdb0 con 0x7f9d0405e1f0 2024-01-22T05:39:48.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.978+0000 7f9cfb400700 1 -- 172.21.15.100:0/25985996 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9cf401c8c0 con 0x7f9d0405e1f0 2024-01-22T05:39:48.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.979+0000 7f9cfb400700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cdc05f150 0x7f9cdc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:48.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.979+0000 7f9cfb400700 1 -- 172.21.15.100:0/25985996 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9cf407be50 con 0x7f9d0405e1f0 2024-01-22T05:39:48.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.979+0000 7f9d03400700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cdc05f150 0x7f9cdc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:48.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.980+0000 7f9d03400700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cdc05f150 0x7f9cdc061610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9d04156f70 tx=0x7f9cec009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:48.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:48.985+0000 7f9cfb400700 1 -- 172.21.15.100:0/25985996 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9cf404d060 con 0x7f9d0405e1f0 2024-01-22T05:39:49.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:49.198+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9d040ca030 con 0x7f9d0405e1f0 2024-01-22T05:39:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.177+0000 7f9cfb400700 1 -- 172.21.15.100:0/25985996 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9cf402a070 con 0x7f9d0405e1f0 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cdc05f150 msgr2=0x7f9cdc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cdc05f150 0x7f9cdc061610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9d04156f70 tx=0x7f9cec009060).stop 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d0405e1f0 msgr2=0x7f9d04152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d0405e1f0 0x7f9d04152ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9cf4014000 tx=0x7f9cf4017000).stop 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 shutdown_connections 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cdc05f150 0x7f9cdc061610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040c1940 0x7f9d040ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d0405e1f0 0x7f9d04152ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 --2- 172.21.15.100:0/25985996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d040a9f60 0x7f9d040aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.179+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 >> 172.21.15.100:0/25985996 conn(0x7f9d040cada0 msgr2=0x7f9d04063130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.180+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 shutdown_connections 2024-01-22T05:39:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.180+0000 7f9d0b000700 1 -- 172.21.15.100:0/25985996 wait complete. 2024-01-22T05:39:50.200 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T05:39:50.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.386+0000 7f1648800700 1 Processor -- start 2024-01-22T05:39:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.386+0000 7f1648800700 1 -- start start 2024-01-22T05:39:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1648800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1640153ee0 0x7f16400c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1648800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16400c7d30 0x7f16400be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1648800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16400928b0 con 0x7f16401542c0 2024-01-22T05:39:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1648800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400bef90 con 0x7f1640153ee0 2024-01-22T05:39:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1648800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400bf270 con 0x7f16400c7d30 2024-01-22T05:39:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1646800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16400c7d30 0x7f16400be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1645e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1640153ee0 0x7f16400c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1646800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16400c7d30 0x7f16400be9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:42108/0 (socket says 172.21.15.100:42108) 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.388+0000 7f1646800700 1 -- 172.21.15.100:0/4252528555 learned_addr learned my addr 172.21.15.100:0/4252528555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1644a00700 1 -- 172.21.15.100:0/4252528555 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221509836 0 0) 0x7f16400928b0 con 0x7f16401542c0 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1644a00700 1 -- 172.21.15.100:0/4252528555 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16200033f0 con 0x7f16401542c0 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1646800700 1 -- 172.21.15.100:0/4252528555 >> v2:172.21.15.169:3300/0 conn(0x7f1640153ee0 msgr2=0x7f16400c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1646800700 1 --2- 172.21.15.100:0/4252528555 >> v2:172.21.15.169:3300/0 conn(0x7f1640153ee0 0x7f16400c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1646800700 1 -- 172.21.15.100:0/4252528555 >> v1:172.21.15.169:6789/0 conn(0x7f16401542c0 legacy=0x7f16400be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1646800700 1 -- 172.21.15.100:0/4252528555 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400bfba0 con 0x7f16400c7d30 2024-01-22T05:39:50.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1645e00700 1 --2- 172.21.15.100:0/4252528555 >> v2:172.21.15.169:3300/0 conn(0x7f1640153ee0 0x7f16400c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1646800700 1 --2- 172.21.15.100:0/4252528555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16400c7d30 0x7f16400be9e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1638009f20 tx=0x7f1638009840).ready entity=mon.2 client_cookie=29404ff255809f90 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1644a00700 1 -- 172.21.15.100:0/4252528555 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800e070 con 0x7f16400c7d30 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1644a00700 1 -- 172.21.15.100:0/4252528555 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800b970 con 0x7f16400c7d30 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.389+0000 7f1644a00700 1 -- 172.21.15.100:0/4252528555 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800bcf0 con 0x7f16400c7d30 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 -- 172.21.15.100:0/4252528555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16400c7d30 msgr2=0x7f16400be9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 --2- 172.21.15.100:0/4252528555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16400c7d30 0x7f16400be9e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1638009f20 tx=0x7f1638009840).stop 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 -- 172.21.15.100:0/4252528555 shutdown_connections 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 --2- 172.21.15.100:0/4252528555 >> v2:172.21.15.169:3300/0 conn(0x7f1640153ee0 0x7f16400c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 --2- 172.21.15.100:0/4252528555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16400c7d30 0x7f16400be9e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 -- 172.21.15.100:0/4252528555 >> 172.21.15.100:0/4252528555 conn(0x7f1640091a00 msgr2=0x7f1640091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 -- 172.21.15.100:0/4252528555 shutdown_connections 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.390+0000 7f1648800700 1 -- 172.21.15.100:0/4252528555 wait complete. 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.391+0000 7f1648800700 1 Processor -- start 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.392+0000 7f1648800700 1 -- start start 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.392+0000 7f1648800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16400c7d30 0x7f1640152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.392+0000 7f1648800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1640153ee0 0x7f16400abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.392+0000 7f1648800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16401542c0 0x7f16400ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.392+0000 7f1648800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1640156060 con 0x7f16400c7d30 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.392+0000 7f1648800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16401562f0 con 0x7f1640153ee0 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.392+0000 7f1648800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16401565d0 con 0x7f16401542c0 2024-01-22T05:39:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16400c7d30 0x7f1640152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16400c7d30 0x7f1640152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53312/0 (socket says 172.21.15.100:53312) 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 -- 172.21.15.100:0/529532674 learned_addr learned my addr 172.21.15.100:0/529532674 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1646800700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16401542c0 0x7f16400ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645400700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1640153ee0 0x7f16400abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 -- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16401542c0 msgr2=0x7f16400ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16401542c0 0x7f16400ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 -- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1640153ee0 msgr2=0x7f16400abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1640153ee0 0x7f16400abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 -- 172.21.15.100:0/529532674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630009250 con 0x7f16400c7d30 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645400700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1640153ee0 0x7f16400abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.393+0000 7f1645e00700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16400c7d30 0x7f1640152c30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f163000ec80 tx=0x7f1630006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.394+0000 7f163d600700 1 -- 172.21.15.100:0/529532674 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630005880 con 0x7f16400c7d30 2024-01-22T05:39:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.394+0000 7f163d600700 1 -- 172.21.15.100:0/529532674 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16300059e0 con 0x7f16400c7d30 2024-01-22T05:39:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.394+0000 7f163d600700 1 -- 172.21.15.100:0/529532674 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630005d60 con 0x7f16400c7d30 2024-01-22T05:39:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.394+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638009ae0 con 0x7f16400c7d30 2024-01-22T05:39:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.394+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1640156b90 con 0x7f16400c7d30 2024-01-22T05:39:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.395+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164005fdb0 con 0x7f16400c7d30 2024-01-22T05:39:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.396+0000 7f163d600700 1 -- 172.21.15.100:0/529532674 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f163000ca60 con 0x7f16400c7d30 2024-01-22T05:39:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.396+0000 7f163d600700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f161805f150 0x7f1618061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.396+0000 7f163d600700 1 -- 172.21.15.100:0/529532674 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f163007a490 con 0x7f16400c7d30 2024-01-22T05:39:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.397+0000 7f1645400700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f161805f150 0x7f1618061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.397+0000 7f1645400700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f161805f150 0x7f1618061610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1628007fd0 tx=0x7f1628009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.400+0000 7f163d600700 1 -- 172.21.15.100:0/529532674 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f163004b6a0 con 0x7f16400c7d30 2024-01-22T05:39:50.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.611+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1640156f00 con 0x7f16400c7d30 2024-01-22T05:39:50.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.611+0000 7f163d600700 1 -- 172.21.15.100:0/529532674 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f1630016020 con 0x7f16400c7d30 2024-01-22T05:39:50.611 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:50.611 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4035127106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4035127106},{"type":"v1","addr":"172.21.15.169:6833","nonce":4035127106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2883555784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2883555784},{"type":"v1","addr":"172.21.15.169:6835","nonce":2883555784}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2387513263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2387513263},{"type":"v1","addr":"172.21.15.100:6836","nonce":2387513263}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:39:46.740767+0000","modified":"2024-01-22T05:39:50.173071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/2256257950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2256257950},{"type":"v1","addr":"172.21.15.100:6837","nonce":2256257950}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f161805f150 msgr2=0x7f1618061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f161805f150 0x7f1618061610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1628007fd0 tx=0x7f1628009040).stop 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16400c7d30 msgr2=0x7f1640152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16400c7d30 0x7f1640152c30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f163000ec80 tx=0x7f1630006f40).stop 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 shutdown_connections 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f161805f150 0x7f1618061610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16401542c0 0x7f16400ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16400c7d30 0x7f1640152c30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 --2- 172.21.15.100:0/529532674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1640153ee0 0x7f16400abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.613+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 >> 172.21.15.100:0/529532674 conn(0x7f1640091a00 msgr2=0x7f16400c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.614+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 shutdown_connections 2024-01-22T05:39:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.614+0000 7f1648800700 1 -- 172.21.15.100:0/529532674 wait complete. 2024-01-22T05:39:50.615 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-01-22T05:39:50.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:39:50.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.813+0000 7fed3ac00700 1 Processor -- start 2024-01-22T05:39:50.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.813+0000 7fed3ac00700 1 -- start start 2024-01-22T05:39:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.814+0000 7fed3ac00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed34153fb0 0x7fed340c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed3ac00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fed340640f0 0x7fed3415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed3ac00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed340c5d20 con 0x7fed340a7c90 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed3ac00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed340c57a0 con 0x7fed34153fb0 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed3ac00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed340c16c0 con 0x7fed340640f0 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed33e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed34153fb0 0x7fed340c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed33e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed34153fb0 0x7fed340c0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53326/0 (socket says 172.21.15.100:53326) 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed33e00700 1 -- 172.21.15.100:0/3946548036 learned_addr learned my addr 172.21.15.100:0/3946548036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed38c00700 1 --2- 172.21.15.100:0/3946548036 >> v2:172.21.15.169:3300/0 conn(0x7fed340640f0 0x7fed3415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed33e00700 1 -- 172.21.15.100:0/3946548036 >> v2:172.21.15.169:3300/0 conn(0x7fed340640f0 msgr2=0x7fed3415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed33e00700 1 --2- 172.21.15.100:0/3946548036 >> v2:172.21.15.169:3300/0 conn(0x7fed340640f0 0x7fed3415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed33e00700 1 -- 172.21.15.100:0/3946548036 >> v1:172.21.15.169:6789/0 conn(0x7fed340a7c90 legacy=0x7fed340639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.815+0000 7fed33e00700 1 -- 172.21.15.100:0/3946548036 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340c19a0 con 0x7fed34153fb0 2024-01-22T05:39:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed33e00700 1 --2- 172.21.15.100:0/3946548036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340c0e30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fed34065820 tx=0x7fed240090f0).ready entity=mon.0 client_cookie=a5210d0325390270 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed32a00700 1 -- 172.21.15.100:0/3946548036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400b520 con 0x7fed34153fb0 2024-01-22T05:39:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed32a00700 1 -- 172.21.15.100:0/3946548036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2400b680 con 0x7fed34153fb0 2024-01-22T05:39:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed32a00700 1 -- 172.21.15.100:0/3946548036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400ba00 con 0x7fed34153fb0 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 -- 172.21.15.100:0/3946548036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 msgr2=0x7fed340c0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 --2- 172.21.15.100:0/3946548036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340c0e30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fed34065820 tx=0x7fed240090f0).stop 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 -- 172.21.15.100:0/3946548036 shutdown_connections 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 --2- 172.21.15.100:0/3946548036 >> v2:172.21.15.169:3300/0 conn(0x7fed340640f0 0x7fed3415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 --2- 172.21.15.100:0/3946548036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340c0e30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 -- 172.21.15.100:0/3946548036 >> 172.21.15.100:0/3946548036 conn(0x7fed340c78a0 msgr2=0x7fed340c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 -- 172.21.15.100:0/3946548036 shutdown_connections 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.816+0000 7fed3ac00700 1 -- 172.21.15.100:0/3946548036 wait complete. 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.818+0000 7fed3ac00700 1 Processor -- start 2024-01-22T05:39:50.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.818+0000 7fed3ac00700 1 -- start start 2024-01-22T05:39:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed3ac00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed340640f0 0x7fed340ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed3ac00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed340a7c90 0x7fed340c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed3ac00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed3ac00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340ac250 con 0x7fed34153fb0 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed3ac00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340ac530 con 0x7fed340a7c90 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed3ac00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340ac810 con 0x7fed340640f0 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed38c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed38c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53336/0 (socket says 172.21.15.100:53336) 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed38c00700 1 -- 172.21.15.100:0/4221686052 learned_addr learned my addr 172.21.15.100:0/4221686052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed33e00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed340640f0 0x7fed340ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.819+0000 7fed33400700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed340a7c90 0x7fed340c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed38c00700 1 -- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed340640f0 msgr2=0x7fed340ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed38c00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed340640f0 0x7fed340ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed38c00700 1 -- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed340a7c90 msgr2=0x7fed340c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:50.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed38c00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed340a7c90 0x7fed340c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed38c00700 1 -- 172.21.15.100:0/4221686052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24009370 con 0x7fed34153fb0 2024-01-22T05:39:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed38c00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340ad2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fed2c009e90 tx=0x7fed2c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed2b400700 1 -- 172.21.15.100:0/4221686052 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00caa0 con 0x7fed34153fb0 2024-01-22T05:39:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed2b400700 1 -- 172.21.15.100:0/4221686052 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c00f040 con 0x7fed34153fb0 2024-01-22T05:39:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed340acaf0 con 0x7fed34153fb0 2024-01-22T05:39:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed2b400700 1 -- 172.21.15.100:0/4221686052 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00ce10 con 0x7fed34153fb0 2024-01-22T05:39:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.820+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed340abe40 con 0x7fed34153fb0 2024-01-22T05:39:50.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.821+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed340c0090 con 0x7fed34153fb0 2024-01-22T05:39:50.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.822+0000 7fed2b400700 1 -- 172.21.15.100:0/4221686052 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fed2c013610 con 0x7fed34153fb0 2024-01-22T05:39:50.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.823+0000 7fed2b400700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fed0c05f150 0x7fed0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:50.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.823+0000 7fed2b400700 1 -- 172.21.15.100:0/4221686052 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fed2c07ab10 con 0x7fed34153fb0 2024-01-22T05:39:50.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.823+0000 7fed33e00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fed0c05f150 0x7fed0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:50.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.824+0000 7fed33e00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fed0c05f150 0x7fed0c061610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fed24009130 tx=0x7fed24017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:50.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.827+0000 7fed2b400700 1 -- 172.21.15.100:0/4221686052 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fed2c04bd20 con 0x7fed34153fb0 2024-01-22T05:39:50.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.997+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed3405fdb0 con 0x7fed34153fb0 2024-01-22T05:39:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:50.998+0000 7fed2b400700 1 -- 172.21.15.100:0/4221686052 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fed2c04f340 con 0x7fed34153fb0 2024-01-22T05:39:50.998 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:50.998 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":52,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:47.743074+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:39:44.885259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:39:45.737245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fed0c05f150 msgr2=0x7fed0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fed0c05f150 0x7fed0c061610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fed24009130 tx=0x7fed24017000).stop 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 msgr2=0x7fed340ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340ad2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fed2c009e90 tx=0x7fed2c00b040).stop 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 shutdown_connections 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fed0c05f150 0x7fed0c061610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed34153fb0 0x7fed340ad2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed340640f0 0x7fed340ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 --2- 172.21.15.100:0/4221686052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed340a7c90 0x7fed340c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 >> 172.21.15.100:0/4221686052 conn(0x7fed340c78a0 msgr2=0x7fed341563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:51.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 shutdown_connections 2024-01-22T05:39:51.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.000+0000 7fed3ac00700 1 -- 172.21.15.100:0/4221686052 wait complete. 2024-01-22T05:39:51.018 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T05:39:51.018 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:39:51.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.205+0000 7fd9eec00700 1 Processor -- start 2024-01-22T05:39:51.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.205+0000 7fd9eec00700 1 -- start start 2024-01-22T05:39:51.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.206+0000 7fd9eec00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd9e8153ee0 0x7fd9e80c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.206+0000 7fd9eec00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e80c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.206+0000 7fd9eec00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80928b0 con 0x7fd9e80be2d0 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.206+0000 7fd9eec00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e80c4870 con 0x7fd9e8153ee0 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.206+0000 7fd9eec00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80bef90 con 0x7fd9e81542c0 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e7e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd9e8153ee0 0x7fd9e80c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9ecc00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd9e80be2d0 0x7fd9e80be760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46178/0 (socket says 172.21.15.100:46178) 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9ecc00700 1 -- 172.21.15.100:0/1651773796 learned_addr learned my addr 172.21.15.100:0/1651773796 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e7400700 1 --2- 172.21.15.100:0/1651773796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e80c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e6a00700 1 -- 172.21.15.100:0/1651773796 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866887001 0 0) 0x7fd9e80928b0 con 0x7fd9e80be2d0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e6a00700 1 -- 172.21.15.100:0/1651773796 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c80033f0 con 0x7fd9e80be2d0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e7e00700 1 -- 172.21.15.100:0/1651773796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 msgr2=0x7fd9e80c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e7e00700 1 --2- 172.21.15.100:0/1651773796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e80c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e7e00700 1 -- 172.21.15.100:0/1651773796 >> v1:172.21.15.100:6789/0 conn(0x7fd9e80be2d0 legacy=0x7fd9e80be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e7e00700 1 -- 172.21.15.100:0/1651773796 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80bfba0 con 0x7fd9e8153ee0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.207+0000 7fd9e7e00700 1 --2- 172.21.15.100:0/1651773796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80c3e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd9d8006fd0 tx=0x7fd9d8006f40).ready entity=mon.0 client_cookie=72d3226b3ba6b39a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9e6a00700 1 -- 172.21.15.100:0/1651773796 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8005880 con 0x7fd9e8153ee0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9e6a00700 1 -- 172.21.15.100:0/1651773796 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d80059e0 con 0x7fd9e8153ee0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9e6a00700 1 -- 172.21.15.100:0/1651773796 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8005d60 con 0x7fd9e8153ee0 2024-01-22T05:39:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 -- 172.21.15.100:0/1651773796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 msgr2=0x7fd9e80c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 --2- 172.21.15.100:0/1651773796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80c3e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd9d8006fd0 tx=0x7fd9d8006f40).stop 2024-01-22T05:39:51.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 -- 172.21.15.100:0/1651773796 shutdown_connections 2024-01-22T05:39:51.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 --2- 172.21.15.100:0/1651773796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80c3e90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 --2- 172.21.15.100:0/1651773796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e80c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 -- 172.21.15.100:0/1651773796 >> 172.21.15.100:0/1651773796 conn(0x7fd9e8091a00 msgr2=0x7fd9e8091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:51.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 -- 172.21.15.100:0/1651773796 shutdown_connections 2024-01-22T05:39:51.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.208+0000 7fd9eec00700 1 -- 172.21.15.100:0/1651773796 wait complete. 2024-01-22T05:39:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.210+0000 7fd9eec00700 1 Processor -- start 2024-01-22T05:39:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.210+0000 7fd9eec00700 1 -- start start 2024-01-22T05:39:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9eec00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e80be2d0 0x7fd9e8150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9eec00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9eec00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e8152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9eec00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80ae530 con 0x7fd9e8153ee0 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9eec00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c02c0 con 0x7fd9e80be2d0 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9eec00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c0b60 con 0x7fd9e81542c0 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53354/0 (socket says 172.21.15.100:53354) 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9e7400700 1 -- 172.21.15.100:0/3787817275 learned_addr learned my addr 172.21.15.100:0/3787817275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.211+0000 7fd9e7e00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e80be2d0 0x7fd9e8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9ecc00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e8152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9e7400700 1 -- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 msgr2=0x7fd9e8152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9e7400700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e8152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9e7400700 1 -- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e80be2d0 msgr2=0x7fd9e8150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9e7400700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e80be2d0 0x7fd9e8150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9e7400700 1 -- 172.21.15.100:0/3787817275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8009250 con 0x7fd9e8153ee0 2024-01-22T05:39:51.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9ecc00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e8152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:51.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9e7400700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80ae040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fd9d000e900 tx=0x7fd9d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:51.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9df400700 1 -- 172.21.15.100:0/3787817275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000c640 con 0x7fd9e8153ee0 2024-01-22T05:39:51.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9df400700 1 -- 172.21.15.100:0/3787817275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000c7a0 con 0x7fd9e8153ee0 2024-01-22T05:39:51.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e8150970 con 0x7fd9e8153ee0 2024-01-22T05:39:51.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9df400700 1 -- 172.21.15.100:0/3787817275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000cb20 con 0x7fd9e8153ee0 2024-01-22T05:39:51.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.212+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e80c07f0 con 0x7fd9e8153ee0 2024-01-22T05:39:51.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.213+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e80c0cf0 con 0x7fd9e8153ee0 2024-01-22T05:39:51.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.214+0000 7fd9df400700 1 -- 172.21.15.100:0/3787817275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd9d001b400 con 0x7fd9e8153ee0 2024-01-22T05:39:51.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.215+0000 7fd9df400700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd9c005f150 0x7fd9c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.215+0000 7fd9df400700 1 -- 172.21.15.100:0/3787817275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd9d007a6c0 con 0x7fd9e8153ee0 2024-01-22T05:39:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.215+0000 7fd9e7e00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd9c005f150 0x7fd9c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.216+0000 7fd9e7e00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd9c005f150 0x7fd9c0061610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fd9d8006f80 tx=0x7fd9d8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.219+0000 7fd9df400700 1 -- 172.21.15.100:0/3787817275 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd9d004b870 con 0x7fd9e8153ee0 2024-01-22T05:39:51.239 INFO:tasks.ceph.mds.a.smithi100.stderr:2024-01-22T05:39:51.239+0000 7f79f0200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:39:51.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.385+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9e805fdb0 con 0x7fd9c005f150 2024-01-22T05:39:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.396+0000 7fd9df400700 1 -- 172.21.15.100:0/3787817275 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353482 (secure 0 0 0) 0x7fd9e805fdb0 con 0x7fd9c005f150 2024-01-22T05:39:51.402 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd9c005f150 msgr2=0x7fd9c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd9c005f150 0x7fd9c0061610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fd9d8006f80 tx=0x7fd9d8015000).stop 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 msgr2=0x7fd9e80ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80ae040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fd9d000e900 tx=0x7fd9d0009060).stop 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 shutdown_connections 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd9c005f150 0x7fd9c0061610 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e80be2d0 0x7fd9e8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e81542c0 0x7fd9e8152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 --2- 172.21.15.100:0/3787817275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9e8153ee0 0x7fd9e80ae040 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 >> 172.21.15.100:0/3787817275 conn(0x7fd9e8091a00 msgr2=0x7fd9e8067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 shutdown_connections 2024-01-22T05:39:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.401+0000 7fd9eec00700 1 -- 172.21.15.100:0/3787817275 wait complete. 2024-01-22T05:39:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:39:51.418 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-01-22T05:39:51.153264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381300,"kb_used_data":4532,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593420,"statfs":{"total":773094113280,"available":770655662080,"internally_reserved":0,"allocated":4640768,"data_stored":2012320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8960,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.063540"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279902+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277466+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747364+0000","last_change":"2024-01-22T05:39:46.309910+0000","last_active":"2024-01-22T05:39:46.747364+0000","last_peered":"2024-01-22T05:39:46.747364+0000","last_clean":"2024-01-22T05:39:46.747364+0000","last_became_active":"2024-01-22T05:39:46.308571+0000","last_became_peered":"2024-01-22T05:39:46.308571+0000","last_unstale":"2024-01-22T05:39:46.747364+0000","last_undegraded":"2024-01-22T05:39:46.747364+0000","last_fullsized":"2024-01-22T05:39:46.747364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301970+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277927+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281423+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300753+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283558+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747599+0000","last_change":"2024-01-22T05:39:46.310167+0000","last_active":"2024-01-22T05:39:46.747599+0000","last_peered":"2024-01-22T05:39:46.747599+0000","last_clean":"2024-01-22T05:39:46.747599+0000","last_became_active":"2024-01-22T05:39:46.308743+0000","last_became_peered":"2024-01-22T05:39:46.308743+0000","last_unstale":"2024-01-22T05:39:46.747599+0000","last_undegraded":"2024-01-22T05:39:46.747599+0000","last_fullsized":"2024-01-22T05:39:46.747599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302838+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279265+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.768775+0000","last_change":"2024-01-22T05:39:46.763814+0000","last_active":"2024-01-22T05:39:46.768775+0000","last_peered":"2024-01-22T05:39:46.768775+0000","last_clean":"2024-01-22T05:39:46.768775+0000","last_became_active":"2024-01-22T05:39:46.763536+0000","last_became_peered":"2024-01-22T05:39:46.763536+0000","last_unstale":"2024-01-22T05:39:46.768775+0000","last_undegraded":"2024-01-22T05:39:46.768775+0000","last_fullsized":"2024-01-22T05:39:46.768775+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.282748+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283646+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278501+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301690+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281326+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279475+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301077+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773120+0000","last_change":"2024-01-22T05:39:46.768342+0000","last_active":"2024-01-22T05:39:46.773120+0000","last_peered":"2024-01-22T05:39:46.773120+0000","last_clean":"2024-01-22T05:39:46.773120+0000","last_became_active":"2024-01-22T05:39:46.768063+0000","last_became_peered":"2024-01-22T05:39:46.768063+0000","last_unstale":"2024-01-22T05:39:46.773120+0000","last_undegraded":"2024-01-22T05:39:46.773120+0000","last_fullsized":"2024-01-22T05:39:46.773120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775994+0000","last_change":"2024-01-22T05:39:46.304812+0000","last_active":"2024-01-22T05:39:46.775994+0000","last_peered":"2024-01-22T05:39:46.775994+0000","last_clean":"2024-01-22T05:39:46.775994+0000","last_became_active":"2024-01-22T05:39:46.304410+0000","last_became_peered":"2024-01-22T05:39:46.304410+0000","last_unstale":"2024-01-22T05:39:46.775994+0000","last_undegraded":"2024-01-22T05:39:46.775994+0000","last_fullsized":"2024-01-22T05:39:46.775994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278328+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.765647+0000","last_change":"2024-01-22T05:39:46.762645+0000","last_active":"2024-01-22T05:39:46.765647+0000","last_peered":"2024-01-22T05:39:46.765647+0000","last_clean":"2024-01-22T05:39:46.765647+0000","last_became_active":"2024-01-22T05:39:46.762233+0000","last_became_peered":"2024-01-22T05:39:46.762233+0000","last_unstale":"2024-01-22T05:39:46.765647+0000","last_undegraded":"2024-01-22T05:39:46.765647+0000","last_fullsized":"2024-01-22T05:39:46.765647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300797+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746539+0000","last_change":"2024-01-22T05:39:46.304785+0000","last_active":"2024-01-22T05:39:46.746539+0000","last_peered":"2024-01-22T05:39:46.746539+0000","last_clean":"2024-01-22T05:39:46.746539+0000","last_became_active":"2024-01-22T05:39:46.304460+0000","last_became_peered":"2024-01-22T05:39:46.304460+0000","last_unstale":"2024-01-22T05:39:46.746539+0000","last_undegraded":"2024-01-22T05:39:46.746539+0000","last_fullsized":"2024-01-22T05:39:46.746539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745821+0000","last_change":"2024-01-22T05:39:46.309461+0000","last_active":"2024-01-22T05:39:46.745821+0000","last_peered":"2024-01-22T05:39:46.745821+0000","last_clean":"2024-01-22T05:39:46.745821+0000","last_became_active":"2024-01-22T05:39:46.308091+0000","last_became_peered":"2024-01-22T05:39:46.308091+0000","last_unstale":"2024-01-22T05:39:46.745821+0000","last_undegraded":"2024-01-22T05:39:46.745821+0000","last_fullsized":"2024-01-22T05:39:46.745821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746747+0000","last_change":"2024-01-22T05:39:46.294516+0000","last_active":"2024-01-22T05:39:46.746747+0000","last_peered":"2024-01-22T05:39:46.746747+0000","last_clean":"2024-01-22T05:39:46.746747+0000","last_became_active":"2024-01-22T05:39:46.294176+0000","last_became_peered":"2024-01-22T05:39:46.294176+0000","last_unstale":"2024-01-22T05:39:46.746747+0000","last_undegraded":"2024-01-22T05:39:46.746747+0000","last_fullsized":"2024-01-22T05:39:46.746747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278853+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747046+0000","last_change":"2024-01-22T05:39:46.300671+0000","last_active":"2024-01-22T05:39:46.747046+0000","last_peered":"2024-01-22T05:39:46.747046+0000","last_clean":"2024-01-22T05:39:46.747046+0000","last_became_active":"2024-01-22T05:39:46.300342+0000","last_became_peered":"2024-01-22T05:39:46.300342+0000","last_unstale":"2024-01-22T05:39:46.747046+0000","last_undegraded":"2024-01-22T05:39:46.747046+0000","last_fullsized":"2024-01-22T05:39:46.747046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281403+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277953+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279330+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280572+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763977+0000","last_change":"2024-01-22T05:39:46.758220+0000","last_active":"2024-01-22T05:39:46.763977+0000","last_peered":"2024-01-22T05:39:46.763977+0000","last_clean":"2024-01-22T05:39:46.763977+0000","last_became_active":"2024-01-22T05:39:46.756667+0000","last_became_peered":"2024-01-22T05:39:46.756667+0000","last_unstale":"2024-01-22T05:39:46.763977+0000","last_undegraded":"2024-01-22T05:39:46.763977+0000","last_fullsized":"2024-01-22T05:39:46.763977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745951+0000","last_change":"2024-01-22T05:39:46.304938+0000","last_active":"2024-01-22T05:39:46.745951+0000","last_peered":"2024-01-22T05:39:46.745951+0000","last_clean":"2024-01-22T05:39:46.745951+0000","last_became_active":"2024-01-22T05:39:46.304555+0000","last_became_peered":"2024-01-22T05:39:46.304555+0000","last_unstale":"2024-01-22T05:39:46.745951+0000","last_undegraded":"2024-01-22T05:39:46.745951+0000","last_fullsized":"2024-01-22T05:39:46.745951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.774199+0000","last_change":"2024-01-22T05:39:46.292886+0000","last_active":"2024-01-22T05:39:46.774199+0000","last_peered":"2024-01-22T05:39:46.774199+0000","last_clean":"2024-01-22T05:39:46.774199+0000","last_became_active":"2024-01-22T05:39:46.292155+0000","last_became_peered":"2024-01-22T05:39:46.292155+0000","last_unstale":"2024-01-22T05:39:46.774199+0000","last_undegraded":"2024-01-22T05:39:46.774199+0000","last_fullsized":"2024-01-22T05:39:46.774199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283061+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278773+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280141+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277389+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763322+0000","last_change":"2024-01-22T05:39:46.759089+0000","last_active":"2024-01-22T05:39:46.763322+0000","last_peered":"2024-01-22T05:39:46.763322+0000","last_clean":"2024-01-22T05:39:46.763322+0000","last_became_active":"2024-01-22T05:39:46.758756+0000","last_became_peered":"2024-01-22T05:39:46.758756+0000","last_unstale":"2024-01-22T05:39:46.763322+0000","last_undegraded":"2024-01-22T05:39:46.763322+0000","last_fullsized":"2024-01-22T05:39:46.763322+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277998+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300622+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300167+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302449+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280609+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300621+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300843+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280129+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280090+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280972+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281494+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277942+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300075+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281658+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277442+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277937+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300106+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277560+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459487+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:43.459487+0000","last_peered":"2024-01-22T05:39:43.459487+0000","last_clean":"2024-01-22T05:39:43.459487+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:43.459487+0000","last_undegraded":"2024-01-22T05:39:43.459487+0000","last_fullsized":"2024-01-22T05:39:43.459487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300880+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747088+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:39:46.747088+0000","last_peered":"2024-01-22T05:39:46.747088+0000","last_clean":"2024-01-22T05:39:46.747088+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:39:46.747088+0000","last_undegraded":"2024-01-22T05:39:46.747088+0000","last_fullsized":"2024-01-22T05:39:46.747088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459488+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:43.459488+0000","last_peered":"2024-01-22T05:39:43.459488+0000","last_clean":"2024-01-22T05:39:43.459488+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:43.459488+0000","last_undegraded":"2024-01-22T05:39:43.459488+0000","last_fullsized":"2024-01-22T05:39:43.459488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300171+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300136+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.438439+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:42.438439+0000","last_peered":"2024-01-22T05:39:42.438439+0000","last_clean":"2024-01-22T05:39:42.438439+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:42.438439+0000","last_undegraded":"2024-01-22T05:39:42.438439+0000","last_fullsized":"2024-01-22T05:39:42.438439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459369+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:43.459369+0000","last_peered":"2024-01-22T05:39:43.459369+0000","last_clean":"2024-01-22T05:39:43.459369+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:43.459369+0000","last_undegraded":"2024-01-22T05:39:43.459369+0000","last_fullsized":"2024-01-22T05:39:43.459369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779816+0000","last_change":"2024-01-22T05:39:46.303506+0000","last_active":"2024-01-22T05:39:46.779816+0000","last_peered":"2024-01-22T05:39:46.779816+0000","last_clean":"2024-01-22T05:39:46.779816+0000","last_became_active":"2024-01-22T05:39:46.303207+0000","last_became_peered":"2024-01-22T05:39:46.303207+0000","last_unstale":"2024-01-22T05:39:46.779816+0000","last_undegraded":"2024-01-22T05:39:46.779816+0000","last_fullsized":"2024-01-22T05:39:46.779816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.544833+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:42.544833+0000","last_peered":"2024-01-22T05:39:42.544833+0000","last_clean":"2024-01-22T05:39:42.544833+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:42.544833+0000","last_undegraded":"2024-01-22T05:39:42.544833+0000","last_fullsized":"2024-01-22T05:39:42.544833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300135+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302016+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459971+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:43.459971+0000","last_peered":"2024-01-22T05:39:43.459971+0000","last_clean":"2024-01-22T05:39:43.459971+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:43.459971+0000","last_undegraded":"2024-01-22T05:39:43.459971+0000","last_fullsized":"2024-01-22T05:39:43.459971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73099999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.56499999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82999999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.503}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.91800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.376}]},{"osd":1,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.58499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.622}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.498},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:39:51.425 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:39:51.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.641+0000 7fe1d2a00700 1 Processor -- start 2024-01-22T05:39:51.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.641+0000 7fe1d2a00700 1 -- start start 2024-01-22T05:39:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.642+0000 7fe1d2a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc1508f0 0x7fe1cc069390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.642+0000 7fe1d2a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe1cc069880 0x7fe1cc0c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.642+0000 7fe1d2a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc0bcc90 con 0x7fe1cc150510 2024-01-22T05:39:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.642+0000 7fe1d2a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0bd830 con 0x7fe1cc069880 2024-01-22T05:39:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.642+0000 7fe1d2a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0bc080 con 0x7fe1cc1508f0 2024-01-22T05:39:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1cbe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe1cc150510 0x7fe1cc0bd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46190/0 (socket says 172.21.15.100:46190) 2024-01-22T05:39:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1cbe00700 1 -- 172.21.15.100:0/1369418500 learned_addr learned my addr 172.21.15.100:0/1369418500 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1cb400700 1 --2- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc1508f0 0x7fe1cc069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1d0a00700 1 --2- 172.21.15.100:0/1369418500 >> v2:172.21.15.169:3300/0 conn(0x7fe1cc069880 0x7fe1cc0c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1caa00700 1 -- 172.21.15.100:0/1369418500 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191706809 0 0) 0x7fe1cc0bcc90 con 0x7fe1cc150510 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1caa00700 1 -- 172.21.15.100:0/1369418500 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac0033f0 con 0x7fe1cc150510 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1d0a00700 1 -- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc1508f0 msgr2=0x7fe1cc069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1d0a00700 1 --2- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc1508f0 0x7fe1cc069390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1d0a00700 1 -- 172.21.15.100:0/1369418500 >> v1:172.21.15.100:6789/0 conn(0x7fe1cc150510 legacy=0x7fe1cc0bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1d0a00700 1 -- 172.21.15.100:0/1369418500 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0bc360 con 0x7fe1cc069880 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.643+0000 7fe1cb400700 1 --2- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc1508f0 0x7fe1cc069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1d0a00700 1 --2- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc0c1900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fe1c400f300 tx=0x7fe1c400db90).ready entity=mon.1 client_cookie=7dbe9404ded721ac server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1caa00700 1 -- 172.21.15.100:0/1369418500 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4012070 con 0x7fe1cc069880 2024-01-22T05:39:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1caa00700 1 -- 172.21.15.100:0/1369418500 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c400fe80 con 0x7fe1cc069880 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1caa00700 1 -- 172.21.15.100:0/1369418500 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400d2e0 con 0x7fe1cc069880 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1d2a00700 1 -- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 msgr2=0x7fe1cc0c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc0c1900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fe1c400f300 tx=0x7fe1c400db90).stop 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1d2a00700 1 -- 172.21.15.100:0/1369418500 shutdown_connections 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc0c1900 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/1369418500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc1508f0 0x7fe1cc069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.644+0000 7fe1d2a00700 1 -- 172.21.15.100:0/1369418500 >> 172.21.15.100:0/1369418500 conn(0x7fe1cc063090 msgr2=0x7fe1cc0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.645+0000 7fe1d2a00700 1 -- 172.21.15.100:0/1369418500 shutdown_connections 2024-01-22T05:39:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.645+0000 7fe1d2a00700 1 -- 172.21.15.100:0/1369418500 wait complete. 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.646+0000 7fe1d2a00700 1 Processor -- start 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.646+0000 7fe1d2a00700 1 -- start start 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d2a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d2a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc150510 0x7fe1cc0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc1508f0 0x7fe1cc0a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d2a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0ab850 con 0x7fe1cc1508f0 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d2a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0a8e70 con 0x7fe1cc069880 2024-01-22T05:39:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d2a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0a9150 con 0x7fe1cc150510 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d0a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc1508f0 0x7fe1cc0a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d0a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc1508f0 0x7fe1cc0a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53368/0 (socket says 172.21.15.100:53368) 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.647+0000 7fe1d0a00700 1 -- 172.21.15.100:0/2960751131 learned_addr learned my addr 172.21.15.100:0/2960751131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1cb400700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc150510 0x7fe1cc0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1cbe00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d0a00700 1 -- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc150510 msgr2=0x7fe1cc0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d0a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc150510 0x7fe1cc0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d0a00700 1 -- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 msgr2=0x7fe1cc14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d0a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d0a00700 1 -- 172.21.15.100:0/2960751131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b400c3c0 con 0x7fe1cc1508f0 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1cb400700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc150510 0x7fe1cc0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1cbe00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d0a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc1508f0 0x7fe1cc0a6480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe1c400f8f0 tx=0x7fe1c400db90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1c3400700 1 -- 172.21.15.100:0/2960751131 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4017420 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1c3400700 1 -- 172.21.15.100:0/2960751131 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4017580 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c400de30 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1c3400700 1 -- 172.21.15.100:0/2960751131 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4017900 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.648+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc0ab4a0 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.649+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc05fdb0 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.650+0000 7fe1c3400700 1 -- 172.21.15.100:0/2960751131 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe1c4003040 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.651+0000 7fe1c3400700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe1a405f150 0x7fe1a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.651+0000 7fe1c3400700 1 -- 172.21.15.100:0/2960751131 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe1c4080170 con 0x7fe1cc1508f0 2024-01-22T05:39:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.651+0000 7fe1cbe00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe1a405f150 0x7fe1a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:51.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.652+0000 7fe1cbe00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe1a405f150 0x7fe1a4061610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe1bc005750 tx=0x7fe1bc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:51.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.655+0000 7fe1c3400700 1 -- 172.21.15.100:0/2960751131 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe1c4051380 con 0x7fe1cc1508f0 2024-01-22T05:39:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.821+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1cc0bc640 con 0x7fe1a405f150 2024-01-22T05:39:51.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.831+0000 7fe1c3400700 1 -- 172.21.15.100:0/2960751131 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353482 (secure 0 0 0) 0x7fe1cc0bc640 con 0x7fe1a405f150 2024-01-22T05:39:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.836+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe1a405f150 msgr2=0x7fe1a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.836+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe1a405f150 0x7fe1a4061610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe1bc005750 tx=0x7fe1bc009040).stop 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.836+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc1508f0 msgr2=0x7fe1cc0a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.836+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc1508f0 0x7fe1cc0a6480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe1c400f8f0 tx=0x7fe1c400db90).stop 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.836+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 shutdown_connections 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.837+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fe1a405f150 0x7fe1a4061610 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.837+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1cc069880 0x7fe1cc14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.837+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc1508f0 0x7fe1cc0a6480 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.837+0000 7fe1d2a00700 1 --2- 172.21.15.100:0/2960751131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1cc150510 0x7fe1cc0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:51.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.837+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 >> 172.21.15.100:0/2960751131 conn(0x7fe1cc063090 msgr2=0x7fe1cc0c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:51.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.837+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 shutdown_connections 2024-01-22T05:39:51.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:51.837+0000 7fe1d2a00700 1 -- 172.21.15.100:0/2960751131 wait complete. 2024-01-22T05:39:51.841 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:39:51.854 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-01-22T05:39:51.153264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381300,"kb_used_data":4532,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593420,"statfs":{"total":773094113280,"available":770655662080,"internally_reserved":0,"allocated":4640768,"data_stored":2012320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8960,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.063540"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279902+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277466+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747364+0000","last_change":"2024-01-22T05:39:46.309910+0000","last_active":"2024-01-22T05:39:46.747364+0000","last_peered":"2024-01-22T05:39:46.747364+0000","last_clean":"2024-01-22T05:39:46.747364+0000","last_became_active":"2024-01-22T05:39:46.308571+0000","last_became_peered":"2024-01-22T05:39:46.308571+0000","last_unstale":"2024-01-22T05:39:46.747364+0000","last_undegraded":"2024-01-22T05:39:46.747364+0000","last_fullsized":"2024-01-22T05:39:46.747364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301970+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277927+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281423+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300753+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283558+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747599+0000","last_change":"2024-01-22T05:39:46.310167+0000","last_active":"2024-01-22T05:39:46.747599+0000","last_peered":"2024-01-22T05:39:46.747599+0000","last_clean":"2024-01-22T05:39:46.747599+0000","last_became_active":"2024-01-22T05:39:46.308743+0000","last_became_peered":"2024-01-22T05:39:46.308743+0000","last_unstale":"2024-01-22T05:39:46.747599+0000","last_undegraded":"2024-01-22T05:39:46.747599+0000","last_fullsized":"2024-01-22T05:39:46.747599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302838+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279265+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.768775+0000","last_change":"2024-01-22T05:39:46.763814+0000","last_active":"2024-01-22T05:39:46.768775+0000","last_peered":"2024-01-22T05:39:46.768775+0000","last_clean":"2024-01-22T05:39:46.768775+0000","last_became_active":"2024-01-22T05:39:46.763536+0000","last_became_peered":"2024-01-22T05:39:46.763536+0000","last_unstale":"2024-01-22T05:39:46.768775+0000","last_undegraded":"2024-01-22T05:39:46.768775+0000","last_fullsized":"2024-01-22T05:39:46.768775+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.282748+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283646+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278501+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301690+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281326+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279475+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301077+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773120+0000","last_change":"2024-01-22T05:39:46.768342+0000","last_active":"2024-01-22T05:39:46.773120+0000","last_peered":"2024-01-22T05:39:46.773120+0000","last_clean":"2024-01-22T05:39:46.773120+0000","last_became_active":"2024-01-22T05:39:46.768063+0000","last_became_peered":"2024-01-22T05:39:46.768063+0000","last_unstale":"2024-01-22T05:39:46.773120+0000","last_undegraded":"2024-01-22T05:39:46.773120+0000","last_fullsized":"2024-01-22T05:39:46.773120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775994+0000","last_change":"2024-01-22T05:39:46.304812+0000","last_active":"2024-01-22T05:39:46.775994+0000","last_peered":"2024-01-22T05:39:46.775994+0000","last_clean":"2024-01-22T05:39:46.775994+0000","last_became_active":"2024-01-22T05:39:46.304410+0000","last_became_peered":"2024-01-22T05:39:46.304410+0000","last_unstale":"2024-01-22T05:39:46.775994+0000","last_undegraded":"2024-01-22T05:39:46.775994+0000","last_fullsized":"2024-01-22T05:39:46.775994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278328+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.765647+0000","last_change":"2024-01-22T05:39:46.762645+0000","last_active":"2024-01-22T05:39:46.765647+0000","last_peered":"2024-01-22T05:39:46.765647+0000","last_clean":"2024-01-22T05:39:46.765647+0000","last_became_active":"2024-01-22T05:39:46.762233+0000","last_became_peered":"2024-01-22T05:39:46.762233+0000","last_unstale":"2024-01-22T05:39:46.765647+0000","last_undegraded":"2024-01-22T05:39:46.765647+0000","last_fullsized":"2024-01-22T05:39:46.765647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300797+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746539+0000","last_change":"2024-01-22T05:39:46.304785+0000","last_active":"2024-01-22T05:39:46.746539+0000","last_peered":"2024-01-22T05:39:46.746539+0000","last_clean":"2024-01-22T05:39:46.746539+0000","last_became_active":"2024-01-22T05:39:46.304460+0000","last_became_peered":"2024-01-22T05:39:46.304460+0000","last_unstale":"2024-01-22T05:39:46.746539+0000","last_undegraded":"2024-01-22T05:39:46.746539+0000","last_fullsized":"2024-01-22T05:39:46.746539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745821+0000","last_change":"2024-01-22T05:39:46.309461+0000","last_active":"2024-01-22T05:39:46.745821+0000","last_peered":"2024-01-22T05:39:46.745821+0000","last_clean":"2024-01-22T05:39:46.745821+0000","last_became_active":"2024-01-22T05:39:46.308091+0000","last_became_peered":"2024-01-22T05:39:46.308091+0000","last_unstale":"2024-01-22T05:39:46.745821+0000","last_undegraded":"2024-01-22T05:39:46.745821+0000","last_fullsized":"2024-01-22T05:39:46.745821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746747+0000","last_change":"2024-01-22T05:39:46.294516+0000","last_active":"2024-01-22T05:39:46.746747+0000","last_peered":"2024-01-22T05:39:46.746747+0000","last_clean":"2024-01-22T05:39:46.746747+0000","last_became_active":"2024-01-22T05:39:46.294176+0000","last_became_peered":"2024-01-22T05:39:46.294176+0000","last_unstale":"2024-01-22T05:39:46.746747+0000","last_undegraded":"2024-01-22T05:39:46.746747+0000","last_fullsized":"2024-01-22T05:39:46.746747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278853+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747046+0000","last_change":"2024-01-22T05:39:46.300671+0000","last_active":"2024-01-22T05:39:46.747046+0000","last_peered":"2024-01-22T05:39:46.747046+0000","last_clean":"2024-01-22T05:39:46.747046+0000","last_became_active":"2024-01-22T05:39:46.300342+0000","last_became_peered":"2024-01-22T05:39:46.300342+0000","last_unstale":"2024-01-22T05:39:46.747046+0000","last_undegraded":"2024-01-22T05:39:46.747046+0000","last_fullsized":"2024-01-22T05:39:46.747046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281403+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277953+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279330+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280572+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763977+0000","last_change":"2024-01-22T05:39:46.758220+0000","last_active":"2024-01-22T05:39:46.763977+0000","last_peered":"2024-01-22T05:39:46.763977+0000","last_clean":"2024-01-22T05:39:46.763977+0000","last_became_active":"2024-01-22T05:39:46.756667+0000","last_became_peered":"2024-01-22T05:39:46.756667+0000","last_unstale":"2024-01-22T05:39:46.763977+0000","last_undegraded":"2024-01-22T05:39:46.763977+0000","last_fullsized":"2024-01-22T05:39:46.763977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745951+0000","last_change":"2024-01-22T05:39:46.304938+0000","last_active":"2024-01-22T05:39:46.745951+0000","last_peered":"2024-01-22T05:39:46.745951+0000","last_clean":"2024-01-22T05:39:46.745951+0000","last_became_active":"2024-01-22T05:39:46.304555+0000","last_became_peered":"2024-01-22T05:39:46.304555+0000","last_unstale":"2024-01-22T05:39:46.745951+0000","last_undegraded":"2024-01-22T05:39:46.745951+0000","last_fullsized":"2024-01-22T05:39:46.745951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.774199+0000","last_change":"2024-01-22T05:39:46.292886+0000","last_active":"2024-01-22T05:39:46.774199+0000","last_peered":"2024-01-22T05:39:46.774199+0000","last_clean":"2024-01-22T05:39:46.774199+0000","last_became_active":"2024-01-22T05:39:46.292155+0000","last_became_peered":"2024-01-22T05:39:46.292155+0000","last_unstale":"2024-01-22T05:39:46.774199+0000","last_undegraded":"2024-01-22T05:39:46.774199+0000","last_fullsized":"2024-01-22T05:39:46.774199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283061+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278773+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280141+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277389+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763322+0000","last_change":"2024-01-22T05:39:46.759089+0000","last_active":"2024-01-22T05:39:46.763322+0000","last_peered":"2024-01-22T05:39:46.763322+0000","last_clean":"2024-01-22T05:39:46.763322+0000","last_became_active":"2024-01-22T05:39:46.758756+0000","last_became_peered":"2024-01-22T05:39:46.758756+0000","last_unstale":"2024-01-22T05:39:46.763322+0000","last_undegraded":"2024-01-22T05:39:46.763322+0000","last_fullsized":"2024-01-22T05:39:46.763322+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277998+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300622+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300167+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302449+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280609+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300621+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300843+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280129+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280090+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280972+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281494+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277942+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300075+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281658+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277442+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277937+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300106+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277560+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459487+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:43.459487+0000","last_peered":"2024-01-22T05:39:43.459487+0000","last_clean":"2024-01-22T05:39:43.459487+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:43.459487+0000","last_undegraded":"2024-01-22T05:39:43.459487+0000","last_fullsized":"2024-01-22T05:39:43.459487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300880+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747088+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:39:46.747088+0000","last_peered":"2024-01-22T05:39:46.747088+0000","last_clean":"2024-01-22T05:39:46.747088+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:39:46.747088+0000","last_undegraded":"2024-01-22T05:39:46.747088+0000","last_fullsized":"2024-01-22T05:39:46.747088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459488+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:43.459488+0000","last_peered":"2024-01-22T05:39:43.459488+0000","last_clean":"2024-01-22T05:39:43.459488+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:43.459488+0000","last_undegraded":"2024-01-22T05:39:43.459488+0000","last_fullsized":"2024-01-22T05:39:43.459488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300171+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300136+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.438439+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:42.438439+0000","last_peered":"2024-01-22T05:39:42.438439+0000","last_clean":"2024-01-22T05:39:42.438439+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:42.438439+0000","last_undegraded":"2024-01-22T05:39:42.438439+0000","last_fullsized":"2024-01-22T05:39:42.438439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459369+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:43.459369+0000","last_peered":"2024-01-22T05:39:43.459369+0000","last_clean":"2024-01-22T05:39:43.459369+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:43.459369+0000","last_undegraded":"2024-01-22T05:39:43.459369+0000","last_fullsized":"2024-01-22T05:39:43.459369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779816+0000","last_change":"2024-01-22T05:39:46.303506+0000","last_active":"2024-01-22T05:39:46.779816+0000","last_peered":"2024-01-22T05:39:46.779816+0000","last_clean":"2024-01-22T05:39:46.779816+0000","last_became_active":"2024-01-22T05:39:46.303207+0000","last_became_peered":"2024-01-22T05:39:46.303207+0000","last_unstale":"2024-01-22T05:39:46.779816+0000","last_undegraded":"2024-01-22T05:39:46.779816+0000","last_fullsized":"2024-01-22T05:39:46.779816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.544833+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:42.544833+0000","last_peered":"2024-01-22T05:39:42.544833+0000","last_clean":"2024-01-22T05:39:42.544833+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:42.544833+0000","last_undegraded":"2024-01-22T05:39:42.544833+0000","last_fullsized":"2024-01-22T05:39:42.544833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300135+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302016+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459971+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:43.459971+0000","last_peered":"2024-01-22T05:39:43.459971+0000","last_clean":"2024-01-22T05:39:43.459971+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:43.459971+0000","last_undegraded":"2024-01-22T05:39:43.459971+0000","last_fullsized":"2024-01-22T05:39:43.459971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73099999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.56499999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82999999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.503}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.91800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.376}]},{"osd":1,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.58499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.622}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.498},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:39:51.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:39:52.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.077+0000 7fcb67a00700 1 Processor -- start 2024-01-22T05:39:52.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.077+0000 7fcb67a00700 1 -- start start 2024-01-22T05:39:52.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.079+0000 7fcb67a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5e90 0x7fcb60069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.079+0000 7fcb67a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcb6006a070 0x7fcb60153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.079+0000 7fcb67a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb60065760 con 0x7fcb600a5ab0 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.079+0000 7fcb67a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600a62f0 con 0x7fcb6006a070 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.079+0000 7fcb67a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600bc340 con 0x7fcb600a5e90 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.079+0000 7fcb65000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcb600a5ab0 0x7fcb600c0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46206/0 (socket says 172.21.15.100:46206) 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.079+0000 7fcb65000700 1 -- 172.21.15.100:0/2144077921 learned_addr learned my addr 172.21.15.100:0/2144077921 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb65a00700 1 --2- 172.21.15.100:0/2144077921 >> v2:172.21.15.169:3300/0 conn(0x7fcb6006a070 0x7fcb60153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb5fe00700 1 --2- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5e90 0x7fcb60069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb5f400700 1 -- 172.21.15.100:0/2144077921 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811575050 0 0) 0x7fcb60065760 con 0x7fcb600a5ab0 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb5f400700 1 -- 172.21.15.100:0/2144077921 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb400033f0 con 0x7fcb600a5ab0 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb65a00700 1 -- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5e90 msgr2=0x7fcb60069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb65a00700 1 --2- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5e90 0x7fcb60069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb65a00700 1 -- 172.21.15.100:0/2144077921 >> v1:172.21.15.100:6789/0 conn(0x7fcb600a5ab0 legacy=0x7fcb600c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb5f400700 1 -- 172.21.15.100:0/2144077921 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2749342258 0 0) 0x7fcb400033f0 con 0x7fcb600a5ab0 2024-01-22T05:39:52.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb65a00700 1 -- 172.21.15.100:0/2144077921 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6006a500 con 0x7fcb6006a070 2024-01-22T05:39:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.080+0000 7fcb65a00700 1 --2- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb6006a070 0x7fcb60153da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fcb58009e60 tx=0x7fcb58009780).ready entity=mon.1 client_cookie=23c41538ad8ab3d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb5f400700 1 -- 172.21.15.100:0/2144077921 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800e070 con 0x7fcb6006a070 2024-01-22T05:39:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb5f400700 1 -- 172.21.15.100:0/2144077921 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800b7a0 con 0x7fcb6006a070 2024-01-22T05:39:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb5f400700 1 -- 172.21.15.100:0/2144077921 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50001470 con 0x7fcb6006a070 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 -- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb6006a070 msgr2=0x7fcb60153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 --2- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb6006a070 0x7fcb60153da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fcb58009e60 tx=0x7fcb58009780).stop 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 -- 172.21.15.100:0/2144077921 shutdown_connections 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 --2- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb6006a070 0x7fcb60153da0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 --2- 172.21.15.100:0/2144077921 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5e90 0x7fcb60069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 -- 172.21.15.100:0/2144077921 >> 172.21.15.100:0/2144077921 conn(0x7fcb60063090 msgr2=0x7fcb600c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 -- 172.21.15.100:0/2144077921 shutdown_connections 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.081+0000 7fcb67a00700 1 -- 172.21.15.100:0/2144077921 wait complete. 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.083+0000 7fcb67a00700 1 Processor -- start 2024-01-22T05:39:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.083+0000 7fcb67a00700 1 -- start start 2024-01-22T05:39:52.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb67a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb6006a070 0x7fcb60144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb67a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5ab0 0x7fcb600a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb67a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb600a5e90 0x7fcb600aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb67a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600aa560 con 0x7fcb6006a070 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb67a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600aca90 con 0x7fcb600a5e90 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb67a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600a70a0 con 0x7fcb600a5ab0 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb65000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb6006a070 0x7fcb60144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb65000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb6006a070 0x7fcb60144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53370/0 (socket says 172.21.15.100:53370) 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb65000700 1 -- 172.21.15.100:0/1666637681 learned_addr learned my addr 172.21.15.100:0/1666637681 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb65000700 1 -- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5ab0 msgr2=0x7fcb600a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb65000700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5ab0 0x7fcb600a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb65a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb600a5e90 0x7fcb600aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.084+0000 7fcb65000700 1 -- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb600a5e90 msgr2=0x7fcb600aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb65000700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb600a5e90 0x7fcb600aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb65000700 1 -- 172.21.15.100:0/1666637681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009a20 con 0x7fcb6006a070 2024-01-22T05:39:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb65a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb600a5e90 0x7fcb600aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb65000700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb6006a070 0x7fcb60144e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcb5000c810 tx=0x7fcb50001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb57e00700 1 -- 172.21.15.100:0/1666637681 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50007170 con 0x7fcb6006a070 2024-01-22T05:39:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb57e00700 1 -- 172.21.15.100:0/1666637681 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb500072d0 con 0x7fcb6006a070 2024-01-22T05:39:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb57e00700 1 -- 172.21.15.100:0/1666637681 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500048c0 con 0x7fcb6006a070 2024-01-22T05:39:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb600a7380 con 0x7fcb6006a070 2024-01-22T05:39:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.085+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb600a7940 con 0x7fcb6006a070 2024-01-22T05:39:52.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.086+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6005fdb0 con 0x7fcb6006a070 2024-01-22T05:39:52.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.087+0000 7fcb57e00700 1 -- 172.21.15.100:0/1666637681 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcb50004c70 con 0x7fcb6006a070 2024-01-22T05:39:52.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.088+0000 7fcb57e00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcb3805f150 0x7fcb38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.088+0000 7fcb57e00700 1 -- 172.21.15.100:0/1666637681 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcb50079f10 con 0x7fcb6006a070 2024-01-22T05:39:52.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.088+0000 7fcb5fe00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcb3805f150 0x7fcb38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.089+0000 7fcb5fe00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcb3805f150 0x7fcb38061610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fcb60153580 tx=0x7fcb48009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.092+0000 7fcb57e00700 1 -- 172.21.15.100:0/1666637681 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb5004b120 con 0x7fcb6006a070 2024-01-22T05:39:52.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.259+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb600c7590 con 0x7fcb3805f150 2024-01-22T05:39:52.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.268+0000 7fcb57e00700 1 -- 172.21.15.100:0/1666637681 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353482 (secure 0 0 0) 0x7fcb600c7590 con 0x7fcb3805f150 2024-01-22T05:39:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:52.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcb3805f150 msgr2=0x7fcb38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcb3805f150 0x7fcb38061610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fcb60153580 tx=0x7fcb48009060).stop 2024-01-22T05:39:52.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb6006a070 msgr2=0x7fcb60144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb6006a070 0x7fcb60144e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcb5000c810 tx=0x7fcb50001b50).stop 2024-01-22T05:39:52.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 shutdown_connections 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fcb3805f150 0x7fcb38061610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb600a5e90 0x7fcb600aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb6006a070 0x7fcb60144e00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 --2- 172.21.15.100:0/1666637681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb600a5ab0 0x7fcb600a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 >> 172.21.15.100:0/1666637681 conn(0x7fcb60063090 msgr2=0x7fcb600c2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 shutdown_connections 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.273+0000 7fcb67a00700 1 -- 172.21.15.100:0/1666637681 wait complete. 2024-01-22T05:39:52.277 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:39:52.290 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-01-22T05:39:51.153264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381300,"kb_used_data":4532,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593420,"statfs":{"total":773094113280,"available":770655662080,"internally_reserved":0,"allocated":4640768,"data_stored":2012320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8960,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.063540"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279902+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277466+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747364+0000","last_change":"2024-01-22T05:39:46.309910+0000","last_active":"2024-01-22T05:39:46.747364+0000","last_peered":"2024-01-22T05:39:46.747364+0000","last_clean":"2024-01-22T05:39:46.747364+0000","last_became_active":"2024-01-22T05:39:46.308571+0000","last_became_peered":"2024-01-22T05:39:46.308571+0000","last_unstale":"2024-01-22T05:39:46.747364+0000","last_undegraded":"2024-01-22T05:39:46.747364+0000","last_fullsized":"2024-01-22T05:39:46.747364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301970+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277927+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281423+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300753+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283558+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747599+0000","last_change":"2024-01-22T05:39:46.310167+0000","last_active":"2024-01-22T05:39:46.747599+0000","last_peered":"2024-01-22T05:39:46.747599+0000","last_clean":"2024-01-22T05:39:46.747599+0000","last_became_active":"2024-01-22T05:39:46.308743+0000","last_became_peered":"2024-01-22T05:39:46.308743+0000","last_unstale":"2024-01-22T05:39:46.747599+0000","last_undegraded":"2024-01-22T05:39:46.747599+0000","last_fullsized":"2024-01-22T05:39:46.747599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302838+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279265+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.768775+0000","last_change":"2024-01-22T05:39:46.763814+0000","last_active":"2024-01-22T05:39:46.768775+0000","last_peered":"2024-01-22T05:39:46.768775+0000","last_clean":"2024-01-22T05:39:46.768775+0000","last_became_active":"2024-01-22T05:39:46.763536+0000","last_became_peered":"2024-01-22T05:39:46.763536+0000","last_unstale":"2024-01-22T05:39:46.768775+0000","last_undegraded":"2024-01-22T05:39:46.768775+0000","last_fullsized":"2024-01-22T05:39:46.768775+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.282748+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283646+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278501+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301690+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281326+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279475+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301077+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773120+0000","last_change":"2024-01-22T05:39:46.768342+0000","last_active":"2024-01-22T05:39:46.773120+0000","last_peered":"2024-01-22T05:39:46.773120+0000","last_clean":"2024-01-22T05:39:46.773120+0000","last_became_active":"2024-01-22T05:39:46.768063+0000","last_became_peered":"2024-01-22T05:39:46.768063+0000","last_unstale":"2024-01-22T05:39:46.773120+0000","last_undegraded":"2024-01-22T05:39:46.773120+0000","last_fullsized":"2024-01-22T05:39:46.773120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775994+0000","last_change":"2024-01-22T05:39:46.304812+0000","last_active":"2024-01-22T05:39:46.775994+0000","last_peered":"2024-01-22T05:39:46.775994+0000","last_clean":"2024-01-22T05:39:46.775994+0000","last_became_active":"2024-01-22T05:39:46.304410+0000","last_became_peered":"2024-01-22T05:39:46.304410+0000","last_unstale":"2024-01-22T05:39:46.775994+0000","last_undegraded":"2024-01-22T05:39:46.775994+0000","last_fullsized":"2024-01-22T05:39:46.775994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278328+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.765647+0000","last_change":"2024-01-22T05:39:46.762645+0000","last_active":"2024-01-22T05:39:46.765647+0000","last_peered":"2024-01-22T05:39:46.765647+0000","last_clean":"2024-01-22T05:39:46.765647+0000","last_became_active":"2024-01-22T05:39:46.762233+0000","last_became_peered":"2024-01-22T05:39:46.762233+0000","last_unstale":"2024-01-22T05:39:46.765647+0000","last_undegraded":"2024-01-22T05:39:46.765647+0000","last_fullsized":"2024-01-22T05:39:46.765647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300797+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746539+0000","last_change":"2024-01-22T05:39:46.304785+0000","last_active":"2024-01-22T05:39:46.746539+0000","last_peered":"2024-01-22T05:39:46.746539+0000","last_clean":"2024-01-22T05:39:46.746539+0000","last_became_active":"2024-01-22T05:39:46.304460+0000","last_became_peered":"2024-01-22T05:39:46.304460+0000","last_unstale":"2024-01-22T05:39:46.746539+0000","last_undegraded":"2024-01-22T05:39:46.746539+0000","last_fullsized":"2024-01-22T05:39:46.746539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745821+0000","last_change":"2024-01-22T05:39:46.309461+0000","last_active":"2024-01-22T05:39:46.745821+0000","last_peered":"2024-01-22T05:39:46.745821+0000","last_clean":"2024-01-22T05:39:46.745821+0000","last_became_active":"2024-01-22T05:39:46.308091+0000","last_became_peered":"2024-01-22T05:39:46.308091+0000","last_unstale":"2024-01-22T05:39:46.745821+0000","last_undegraded":"2024-01-22T05:39:46.745821+0000","last_fullsized":"2024-01-22T05:39:46.745821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746747+0000","last_change":"2024-01-22T05:39:46.294516+0000","last_active":"2024-01-22T05:39:46.746747+0000","last_peered":"2024-01-22T05:39:46.746747+0000","last_clean":"2024-01-22T05:39:46.746747+0000","last_became_active":"2024-01-22T05:39:46.294176+0000","last_became_peered":"2024-01-22T05:39:46.294176+0000","last_unstale":"2024-01-22T05:39:46.746747+0000","last_undegraded":"2024-01-22T05:39:46.746747+0000","last_fullsized":"2024-01-22T05:39:46.746747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278853+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747046+0000","last_change":"2024-01-22T05:39:46.300671+0000","last_active":"2024-01-22T05:39:46.747046+0000","last_peered":"2024-01-22T05:39:46.747046+0000","last_clean":"2024-01-22T05:39:46.747046+0000","last_became_active":"2024-01-22T05:39:46.300342+0000","last_became_peered":"2024-01-22T05:39:46.300342+0000","last_unstale":"2024-01-22T05:39:46.747046+0000","last_undegraded":"2024-01-22T05:39:46.747046+0000","last_fullsized":"2024-01-22T05:39:46.747046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281403+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277953+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279330+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280572+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763977+0000","last_change":"2024-01-22T05:39:46.758220+0000","last_active":"2024-01-22T05:39:46.763977+0000","last_peered":"2024-01-22T05:39:46.763977+0000","last_clean":"2024-01-22T05:39:46.763977+0000","last_became_active":"2024-01-22T05:39:46.756667+0000","last_became_peered":"2024-01-22T05:39:46.756667+0000","last_unstale":"2024-01-22T05:39:46.763977+0000","last_undegraded":"2024-01-22T05:39:46.763977+0000","last_fullsized":"2024-01-22T05:39:46.763977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745951+0000","last_change":"2024-01-22T05:39:46.304938+0000","last_active":"2024-01-22T05:39:46.745951+0000","last_peered":"2024-01-22T05:39:46.745951+0000","last_clean":"2024-01-22T05:39:46.745951+0000","last_became_active":"2024-01-22T05:39:46.304555+0000","last_became_peered":"2024-01-22T05:39:46.304555+0000","last_unstale":"2024-01-22T05:39:46.745951+0000","last_undegraded":"2024-01-22T05:39:46.745951+0000","last_fullsized":"2024-01-22T05:39:46.745951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.774199+0000","last_change":"2024-01-22T05:39:46.292886+0000","last_active":"2024-01-22T05:39:46.774199+0000","last_peered":"2024-01-22T05:39:46.774199+0000","last_clean":"2024-01-22T05:39:46.774199+0000","last_became_active":"2024-01-22T05:39:46.292155+0000","last_became_peered":"2024-01-22T05:39:46.292155+0000","last_unstale":"2024-01-22T05:39:46.774199+0000","last_undegraded":"2024-01-22T05:39:46.774199+0000","last_fullsized":"2024-01-22T05:39:46.774199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283061+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278773+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280141+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277389+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763322+0000","last_change":"2024-01-22T05:39:46.759089+0000","last_active":"2024-01-22T05:39:46.763322+0000","last_peered":"2024-01-22T05:39:46.763322+0000","last_clean":"2024-01-22T05:39:46.763322+0000","last_became_active":"2024-01-22T05:39:46.758756+0000","last_became_peered":"2024-01-22T05:39:46.758756+0000","last_unstale":"2024-01-22T05:39:46.763322+0000","last_undegraded":"2024-01-22T05:39:46.763322+0000","last_fullsized":"2024-01-22T05:39:46.763322+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277998+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300622+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300167+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302449+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280609+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300621+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300843+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280129+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280090+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280972+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281494+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277942+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300075+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281658+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277442+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277937+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300106+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277560+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459487+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:43.459487+0000","last_peered":"2024-01-22T05:39:43.459487+0000","last_clean":"2024-01-22T05:39:43.459487+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:43.459487+0000","last_undegraded":"2024-01-22T05:39:43.459487+0000","last_fullsized":"2024-01-22T05:39:43.459487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300880+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747088+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:39:46.747088+0000","last_peered":"2024-01-22T05:39:46.747088+0000","last_clean":"2024-01-22T05:39:46.747088+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:39:46.747088+0000","last_undegraded":"2024-01-22T05:39:46.747088+0000","last_fullsized":"2024-01-22T05:39:46.747088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459488+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:43.459488+0000","last_peered":"2024-01-22T05:39:43.459488+0000","last_clean":"2024-01-22T05:39:43.459488+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:43.459488+0000","last_undegraded":"2024-01-22T05:39:43.459488+0000","last_fullsized":"2024-01-22T05:39:43.459488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300171+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300136+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.438439+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:42.438439+0000","last_peered":"2024-01-22T05:39:42.438439+0000","last_clean":"2024-01-22T05:39:42.438439+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:42.438439+0000","last_undegraded":"2024-01-22T05:39:42.438439+0000","last_fullsized":"2024-01-22T05:39:42.438439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459369+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:43.459369+0000","last_peered":"2024-01-22T05:39:43.459369+0000","last_clean":"2024-01-22T05:39:43.459369+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:43.459369+0000","last_undegraded":"2024-01-22T05:39:43.459369+0000","last_fullsized":"2024-01-22T05:39:43.459369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779816+0000","last_change":"2024-01-22T05:39:46.303506+0000","last_active":"2024-01-22T05:39:46.779816+0000","last_peered":"2024-01-22T05:39:46.779816+0000","last_clean":"2024-01-22T05:39:46.779816+0000","last_became_active":"2024-01-22T05:39:46.303207+0000","last_became_peered":"2024-01-22T05:39:46.303207+0000","last_unstale":"2024-01-22T05:39:46.779816+0000","last_undegraded":"2024-01-22T05:39:46.779816+0000","last_fullsized":"2024-01-22T05:39:46.779816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.544833+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:42.544833+0000","last_peered":"2024-01-22T05:39:42.544833+0000","last_clean":"2024-01-22T05:39:42.544833+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:42.544833+0000","last_undegraded":"2024-01-22T05:39:42.544833+0000","last_fullsized":"2024-01-22T05:39:42.544833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300135+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302016+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459971+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:43.459971+0000","last_peered":"2024-01-22T05:39:43.459971+0000","last_clean":"2024-01-22T05:39:43.459971+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:43.459971+0000","last_undegraded":"2024-01-22T05:39:43.459971+0000","last_fullsized":"2024-01-22T05:39:43.459971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73099999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.56499999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82999999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.503}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.91800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.376}]},{"osd":1,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.58499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.622}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.498},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:39:52.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-01-22T05:39:52.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2024-01-22T05:39:52.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.279902+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-01-22T05:39:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2024-01-22T05:39:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277466+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-01-22T05:39:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.301970+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2024-01-22T05:39:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277927+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.281423+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300753+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.283558+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.302838+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2024-01-22T05:39:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.279265+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.282748+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.283646+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-01-22T05:39:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.278501+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.301690+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2024-01-22T05:39:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.281326+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.279475+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.301077+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.278328+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300797+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-01-22T05:39:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.278853+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.281403+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277953+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.279330+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.280572+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277461+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.283061+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-01-22T05:39:52.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-01-22T05:39:52.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.278773+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.280141+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-01-22T05:39:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277389+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277998+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300883+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-01-22T05:39:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300622+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300167+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.302449+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.280609+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300621+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300843+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-01-22T05:39:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.280129+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:39:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-01-22T05:39:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-01-22T05:39:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.280090+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:39:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-01-22T05:39:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-01-22T05:39:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.280972+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-22T05:39:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-01-22T05:39:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-01-22T05:39:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.281494+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277942+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300075+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-01-22T05:39:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277461+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-01-22T05:39:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-01-22T05:39:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.281658+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277442+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277937+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-01-22T05:39:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300106+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.277560+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300880+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-01-22T05:39:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.283883+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300171+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-01-22T05:39:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300136+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.300135+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-22T05:39:46.271276+0000', 'last_change': '2024-01-22T05:39:46.271276+0000', 'last_active': '2024-01-22T05:39:46.271276+0000', 'last_peered': '2024-01-22T05:39:46.271276+0000', 'last_clean': '2024-01-22T05:39:46.271276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:46.271276+0000', 'last_undegraded': '2024-01-22T05:39:46.271276+0000', 'last_fullsized': '2024-01-22T05:39:46.271276+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:46.271276+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-01-22T05:39:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-22T05:39:45.264354+0000', 'last_change': '2024-01-22T05:39:45.302016+0000', 'last_active': '2024-01-22T05:39:45.264354+0000', 'last_peered': '2024-01-22T05:39:45.264354+0000', 'last_clean': '2024-01-22T05:39:45.264354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-22T05:39:45.264354+0000', 'last_undegraded': '2024-01-22T05:39:45.264354+0000', 'last_fullsized': '2024-01-22T05:39:45.264354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'last_clean_scrub_stamp': '2024-01-22T05:39:45.264354+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-22T05:39:52.322 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-22T05:39:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.513+0000 7fb14c800700 1 Processor -- start 2024-01-22T05:39:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.513+0000 7fb14c800700 1 -- start start 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.514+0000 7fb14c800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb144154060 0x7fb144154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.514+0000 7fb14c800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440c64b0 0x7fb1440c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.514+0000 7fb14c800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440c1530 con 0x7fb1440aa3f0 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.514+0000 7fb14c800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440cbb60 con 0x7fb144154060 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.514+0000 7fb14c800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440cb880 con 0x7fb1440c64b0 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.514+0000 7fb149e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb144154060 0x7fb144154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.514+0000 7fb149400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb1440aa3f0 0x7fb1440c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46208/0 (socket says 172.21.15.100:46208) 2024-01-22T05:39:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb149400700 1 -- 172.21.15.100:0/2307877402 learned_addr learned my addr 172.21.15.100:0/2307877402 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb14a800700 1 --2- 172.21.15.100:0/2307877402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440c64b0 0x7fb1440c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb149e00700 1 -- 172.21.15.100:0/2307877402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440c64b0 msgr2=0x7fb1440c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb149e00700 1 --2- 172.21.15.100:0/2307877402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440c64b0 0x7fb1440c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb149e00700 1 -- 172.21.15.100:0/2307877402 >> v1:172.21.15.100:6789/0 conn(0x7fb1440aa3f0 legacy=0x7fb1440c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb149e00700 1 -- 172.21.15.100:0/2307877402 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440c17d0 con 0x7fb144154060 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb14a800700 1 --2- 172.21.15.100:0/2307877402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440c64b0 0x7fb1440c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb149e00700 1 --2- 172.21.15.100:0/2307877402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb144154440 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fb134009760 tx=0x7fb134009060).ready entity=mon.0 client_cookie=b1d31010683dd9dd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb148a00700 1 -- 172.21.15.100:0/2307877402 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400b580 con 0x7fb144154060 2024-01-22T05:39:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb148a00700 1 -- 172.21.15.100:0/2307877402 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400b6e0 con 0x7fb144154060 2024-01-22T05:39:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.515+0000 7fb148a00700 1 -- 172.21.15.100:0/2307877402 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400ba60 con 0x7fb144154060 2024-01-22T05:39:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 -- 172.21.15.100:0/2307877402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 msgr2=0x7fb144154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 --2- 172.21.15.100:0/2307877402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb144154440 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fb134009760 tx=0x7fb134009060).stop 2024-01-22T05:39:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 -- 172.21.15.100:0/2307877402 shutdown_connections 2024-01-22T05:39:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 --2- 172.21.15.100:0/2307877402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb144154440 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 --2- 172.21.15.100:0/2307877402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440c64b0 0x7fb1440c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 -- 172.21.15.100:0/2307877402 >> 172.21.15.100:0/2307877402 conn(0x7fb14405e9d0 msgr2=0x7fb1440cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:52.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 -- 172.21.15.100:0/2307877402 shutdown_connections 2024-01-22T05:39:52.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.516+0000 7fb14c800700 1 -- 172.21.15.100:0/2307877402 wait complete. 2024-01-22T05:39:52.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.518+0000 7fb14c800700 1 Processor -- start 2024-01-22T05:39:52.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.518+0000 7fb14c800700 1 -- start start 2024-01-22T05:39:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.519+0000 7fb14c800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440aa3f0 0x7fb144152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.519+0000 7fb14c800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1440c64b0 0x7fb1440add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14c800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb14414fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14c800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440ae210 con 0x7fb144154060 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14c800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440ae490 con 0x7fb1440c64b0 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14c800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440ae770 con 0x7fb1440aa3f0 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb14414fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb14414fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53390/0 (socket says 172.21.15.100:53390) 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 -- 172.21.15.100:0/3416144818 learned_addr learned my addr 172.21.15.100:0/3416144818 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb149e00700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440aa3f0 0x7fb144152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb149400700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1440c64b0 0x7fb1440add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 -- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440aa3f0 msgr2=0x7fb144152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440aa3f0 0x7fb144152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 -- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1440c64b0 msgr2=0x7fb1440add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1440c64b0 0x7fb1440add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 -- 172.21.15.100:0/3416144818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340092a0 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb149400700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1440c64b0 0x7fb1440add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.520+0000 7fb14a800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb14414fd40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fb13c00a380 tx=0x7fb13c0078f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.521+0000 7fb141600700 1 -- 172.21.15.100:0/3416144818 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c016470 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.521+0000 7fb141600700 1 -- 172.21.15.100:0/3416144818 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c0165d0 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.521+0000 7fb141600700 1 -- 172.21.15.100:0/3416144818 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c016950 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.521+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440aea50 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.521+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1440ab7e0 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.522+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14405fdb0 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.523+0000 7fb141600700 1 -- 172.21.15.100:0/3416144818 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb13c013070 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.524+0000 7fb141600700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb11c05f120 0x7fb11c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.524+0000 7fb141600700 1 -- 172.21.15.100:0/3416144818 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb13c07aca0 con 0x7fb144154060 2024-01-22T05:39:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.524+0000 7fb149e00700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb11c05f120 0x7fb11c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.524+0000 7fb149e00700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb11c05f120 0x7fb11c0615e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb13400b340 tx=0x7fb134017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.528+0000 7fb141600700 1 -- 172.21.15.100:0/3416144818 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb13c04beb0 con 0x7fb144154060 2024-01-22T05:39:52.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.763+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb14406abb0 con 0x7fb144154060 2024-01-22T05:39:52.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.764+0000 7fb141600700 1 -- 172.21.15.100:0/3416144818 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1529 (secure 0 0 0) 0x7fb13c04f4d0 con 0x7fb144154060 2024-01-22T05:39:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:52.764 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":133,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1705901870,"num_in_osds":8,"osd_in_since":1705901862,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":59},{"state_name":"creating+peering","count":54},{"state_name":"active+clean","count":24}],"num_pgs":137,"num_pools":4,"num_objects":2,"data_bytes":70,"bytes_used":2438451200,"bytes_avail":770655662080,"bytes_total":773094113280,"unknown_pgs_ratio":0.43065693974494934,"inactive_pgs_ratio":0.39416059851646423},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5394}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-01-22T05:39:29.148943+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb11c05f120 msgr2=0x7fb11c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb11c05f120 0x7fb11c0615e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb13400b340 tx=0x7fb134017000).stop 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 msgr2=0x7fb14414fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb14414fd40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fb13c00a380 tx=0x7fb13c0078f0).stop 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 shutdown_connections 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb11c05f120 0x7fb11c0615e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb144154060 0x7fb14414fd40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1440aa3f0 0x7fb144152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 --2- 172.21.15.100:0/3416144818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1440c64b0 0x7fb1440add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 >> 172.21.15.100:0/3416144818 conn(0x7fb14405e9d0 msgr2=0x7fb144150850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 shutdown_connections 2024-01-22T05:39:52.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.766+0000 7fb14c800700 1 -- 172.21.15.100:0/3416144818 wait complete. 2024-01-22T05:39:52.784 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-22T05:39:52.784 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:39:52.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.968+0000 7fc300800700 1 Processor -- start 2024-01-22T05:39:52.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.968+0000 7fc300800700 1 -- start start 2024-01-22T05:39:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.969+0000 7fc300800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 0x7fc2f80c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.969+0000 7fc300800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80c5d20 con 0x7fc2f80a7c90 2024-01-22T05:39:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.969+0000 7fc300800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80c16c0 con 0x7fc2f80640f0 2024-01-22T05:39:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.969+0000 7fc300800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c57a0 con 0x7fc2f8153fb0 2024-01-22T05:39:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fd400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc2f80a7c90 0x7fc2f80639e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39558/0 (socket says 172.21.15.100:39558) 2024-01-22T05:39:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fd400700 1 -- 172.21.15.100:0/2434456604 learned_addr learned my addr 172.21.15.100:0/2434456604 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936258949 0 0) 0x7fc2f80c5d20 con 0x7fc2f80a7c90 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fde00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 0x7fc2f80c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d80033f0 con 0x7fc2f80a7c90 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262293665 0 0) 0x7fc2d80033f0 con 0x7fc2f80a7c90 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 msgr2=0x7fc2f80c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 0x7fc2f80c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 >> v1:172.21.15.169:6789/0 conn(0x7fc2f80640f0 legacy=0x7fc2f815dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80c19a0 con 0x7fc2f80a7c90 2024-01-22T05:39:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fc2e0001470 con 0x7fc2f80a7c90 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 >> v1:172.21.15.100:6789/0 conn(0x7fc2f80a7c90 legacy=0x7fc2f80639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.970+0000 7fc2fca00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2d8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fca00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 0x7fc2d8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fca00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2d8004b80 0x7fc2d8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c57a0 con 0x7fc2d8003910 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d800b990 con 0x7fc2d8004b80 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d800bb20 con 0x7fc2f8153fb0 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fde00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2d8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fd400700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 0x7fc2d8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fe800700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2d8004b80 0x7fc2d8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fde00700 1 -- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 msgr2=0x7fc2d8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fde00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f8153fb0 0x7fc2d8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fde00700 1 -- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2d8004b80 msgr2=0x7fc2d8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fde00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2d8004b80 0x7fc2d8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fde00700 1 -- 172.21.15.100:0/2434456604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80033f0 con 0x7fc2d8003910 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.971+0000 7fc2fde00700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2d8003d30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fc2e8009a80 tx=0x7fc2e8009060).ready entity=mon.0 client_cookie=a1e148151303c51 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8009430 con 0x7fc2d8003910 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800e640 con 0x7fc2d8003910 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc2fca00700 1 -- 172.21.15.100:0/2434456604 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800e9c0 con 0x7fc2d8003910 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc300800700 1 -- 172.21.15.100:0/2434456604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 msgr2=0x7fc2d8003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc300800700 1 --2- 172.21.15.100:0/2434456604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2d8003d30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fc2e8009a80 tx=0x7fc2e8009060).stop 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc2fe800700 1 -- 172.21.15.100:0/2434456604 reap_dead start 2024-01-22T05:39:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc300800700 1 -- 172.21.15.100:0/2434456604 shutdown_connections 2024-01-22T05:39:52.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc300800700 1 -- 172.21.15.100:0/2434456604 >> 172.21.15.100:0/2434456604 conn(0x7fc2f80c78a0 msgr2=0x7fc2f80c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:52.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc300800700 1 -- 172.21.15.100:0/2434456604 shutdown_connections 2024-01-22T05:39:52.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.972+0000 7fc300800700 1 -- 172.21.15.100:0/2434456604 wait complete. 2024-01-22T05:39:52.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.974+0000 7fc300800700 1 Processor -- start 2024-01-22T05:39:52.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.975+0000 7fc300800700 1 -- start start 2024-01-22T05:39:52.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc300800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2f814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc300800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f80af4c0 0x7fc2f80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc300800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f80afe30 0x7fc2f80add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc300800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c3430 con 0x7fc2d8003910 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc300800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c2870 con 0x7fc2f80af4c0 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc300800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c2b00 con 0x7fc2f80afe30 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc2fde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2f814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc2fde00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2f814eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49846/0 (socket says 172.21.15.100:49846) 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc2fde00700 1 -- 172.21.15.100:0/791198375 learned_addr learned my addr 172.21.15.100:0/791198375 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc2fe800700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f80afe30 0x7fc2f80add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc2fd400700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f80af4c0 0x7fc2f80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc2fde00700 1 -- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f80afe30 msgr2=0x7fc2f80add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.976+0000 7fc2fde00700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f80afe30 0x7fc2f80add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc2fde00700 1 -- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f80af4c0 msgr2=0x7fc2f80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc2fde00700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f80af4c0 0x7fc2f80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc2fde00700 1 -- 172.21.15.100:0/791198375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80c2de0 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc2fde00700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2f814eb50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc2d8005640 tx=0x7fc2e801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc2f5600700 1 -- 172.21.15.100:0/791198375 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800ed30 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc2f5600700 1 -- 172.21.15.100:0/791198375 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800ee90 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f80c30c0 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc2f5600700 1 -- 172.21.15.100:0/791198375 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8026440 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.977+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f814f040 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.978+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f80c3710 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.979+0000 7fc2f5600700 1 -- 172.21.15.100:0/791198375 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc2e802f440 con 0x7fc2d8003910 2024-01-22T05:39:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.979+0000 7fc2f5600700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc2d005f150 0x7fc2d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:52.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.980+0000 7fc2f5600700 1 -- 172.21.15.100:0/791198375 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc2e807bef0 con 0x7fc2d8003910 2024-01-22T05:39:52.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.980+0000 7fc2fd400700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc2d005f150 0x7fc2d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:52.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.980+0000 7fc2fd400700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc2d005f150 0x7fc2d0061610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc2e0000e10 tx=0x7fc2e0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:52.984+0000 7fc2f5600700 1 -- 172.21.15.100:0/791198375 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc2e804d160 con 0x7fc2d8003910 2024-01-22T05:39:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.148+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2f80c38c0 con 0x7fc2d005f150 2024-01-22T05:39:53.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.158+0000 7fc2f5600700 1 -- 172.21.15.100:0/791198375 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353482 (secure 0 0 0) 0x7fc2e0000bc0 con 0x7fc2d005f150 2024-01-22T05:39:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc2d005f150 msgr2=0x7fc2d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc2d005f150 0x7fc2d0061610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc2e0000e10 tx=0x7fc2e0009040).stop 2024-01-22T05:39:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 msgr2=0x7fc2f814eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2f814eb50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc2d8005640 tx=0x7fc2e801a000).stop 2024-01-22T05:39:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 shutdown_connections 2024-01-22T05:39:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc2d005f150 0x7fc2d0061610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc2f80afe30 0x7fc2f80add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8003910 0x7fc2f814eb50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 --2- 172.21.15.100:0/791198375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f80af4c0 0x7fc2f80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 >> 172.21.15.100:0/791198375 conn(0x7fc2f80c78a0 msgr2=0x7fc2f80a80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.162+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 shutdown_connections 2024-01-22T05:39:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:53.163+0000 7fc300800700 1 -- 172.21.15.100:0/791198375 wait complete. 2024-01-22T05:39:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:39:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-01-22T05:39:51.153264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381300,"kb_used_data":4532,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593420,"statfs":{"total":773094113280,"available":770655662080,"internally_reserved":0,"allocated":4640768,"data_stored":2012320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8960,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.063540"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279902+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277466+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747364+0000","last_change":"2024-01-22T05:39:46.309910+0000","last_active":"2024-01-22T05:39:46.747364+0000","last_peered":"2024-01-22T05:39:46.747364+0000","last_clean":"2024-01-22T05:39:46.747364+0000","last_became_active":"2024-01-22T05:39:46.308571+0000","last_became_peered":"2024-01-22T05:39:46.308571+0000","last_unstale":"2024-01-22T05:39:46.747364+0000","last_undegraded":"2024-01-22T05:39:46.747364+0000","last_fullsized":"2024-01-22T05:39:46.747364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301970+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277927+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281423+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300753+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283558+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747599+0000","last_change":"2024-01-22T05:39:46.310167+0000","last_active":"2024-01-22T05:39:46.747599+0000","last_peered":"2024-01-22T05:39:46.747599+0000","last_clean":"2024-01-22T05:39:46.747599+0000","last_became_active":"2024-01-22T05:39:46.308743+0000","last_became_peered":"2024-01-22T05:39:46.308743+0000","last_unstale":"2024-01-22T05:39:46.747599+0000","last_undegraded":"2024-01-22T05:39:46.747599+0000","last_fullsized":"2024-01-22T05:39:46.747599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302838+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279265+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.768775+0000","last_change":"2024-01-22T05:39:46.763814+0000","last_active":"2024-01-22T05:39:46.768775+0000","last_peered":"2024-01-22T05:39:46.768775+0000","last_clean":"2024-01-22T05:39:46.768775+0000","last_became_active":"2024-01-22T05:39:46.763536+0000","last_became_peered":"2024-01-22T05:39:46.763536+0000","last_unstale":"2024-01-22T05:39:46.768775+0000","last_undegraded":"2024-01-22T05:39:46.768775+0000","last_fullsized":"2024-01-22T05:39:46.768775+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.282748+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283646+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278501+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301690+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281326+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279475+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.301077+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773120+0000","last_change":"2024-01-22T05:39:46.768342+0000","last_active":"2024-01-22T05:39:46.773120+0000","last_peered":"2024-01-22T05:39:46.773120+0000","last_clean":"2024-01-22T05:39:46.773120+0000","last_became_active":"2024-01-22T05:39:46.768063+0000","last_became_peered":"2024-01-22T05:39:46.768063+0000","last_unstale":"2024-01-22T05:39:46.773120+0000","last_undegraded":"2024-01-22T05:39:46.773120+0000","last_fullsized":"2024-01-22T05:39:46.773120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775994+0000","last_change":"2024-01-22T05:39:46.304812+0000","last_active":"2024-01-22T05:39:46.775994+0000","last_peered":"2024-01-22T05:39:46.775994+0000","last_clean":"2024-01-22T05:39:46.775994+0000","last_became_active":"2024-01-22T05:39:46.304410+0000","last_became_peered":"2024-01-22T05:39:46.304410+0000","last_unstale":"2024-01-22T05:39:46.775994+0000","last_undegraded":"2024-01-22T05:39:46.775994+0000","last_fullsized":"2024-01-22T05:39:46.775994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278328+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.765647+0000","last_change":"2024-01-22T05:39:46.762645+0000","last_active":"2024-01-22T05:39:46.765647+0000","last_peered":"2024-01-22T05:39:46.765647+0000","last_clean":"2024-01-22T05:39:46.765647+0000","last_became_active":"2024-01-22T05:39:46.762233+0000","last_became_peered":"2024-01-22T05:39:46.762233+0000","last_unstale":"2024-01-22T05:39:46.765647+0000","last_undegraded":"2024-01-22T05:39:46.765647+0000","last_fullsized":"2024-01-22T05:39:46.765647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300797+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746539+0000","last_change":"2024-01-22T05:39:46.304785+0000","last_active":"2024-01-22T05:39:46.746539+0000","last_peered":"2024-01-22T05:39:46.746539+0000","last_clean":"2024-01-22T05:39:46.746539+0000","last_became_active":"2024-01-22T05:39:46.304460+0000","last_became_peered":"2024-01-22T05:39:46.304460+0000","last_unstale":"2024-01-22T05:39:46.746539+0000","last_undegraded":"2024-01-22T05:39:46.746539+0000","last_fullsized":"2024-01-22T05:39:46.746539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745821+0000","last_change":"2024-01-22T05:39:46.309461+0000","last_active":"2024-01-22T05:39:46.745821+0000","last_peered":"2024-01-22T05:39:46.745821+0000","last_clean":"2024-01-22T05:39:46.745821+0000","last_became_active":"2024-01-22T05:39:46.308091+0000","last_became_peered":"2024-01-22T05:39:46.308091+0000","last_unstale":"2024-01-22T05:39:46.745821+0000","last_undegraded":"2024-01-22T05:39:46.745821+0000","last_fullsized":"2024-01-22T05:39:46.745821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746747+0000","last_change":"2024-01-22T05:39:46.294516+0000","last_active":"2024-01-22T05:39:46.746747+0000","last_peered":"2024-01-22T05:39:46.746747+0000","last_clean":"2024-01-22T05:39:46.746747+0000","last_became_active":"2024-01-22T05:39:46.294176+0000","last_became_peered":"2024-01-22T05:39:46.294176+0000","last_unstale":"2024-01-22T05:39:46.746747+0000","last_undegraded":"2024-01-22T05:39:46.746747+0000","last_fullsized":"2024-01-22T05:39:46.746747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278853+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747046+0000","last_change":"2024-01-22T05:39:46.300671+0000","last_active":"2024-01-22T05:39:46.747046+0000","last_peered":"2024-01-22T05:39:46.747046+0000","last_clean":"2024-01-22T05:39:46.747046+0000","last_became_active":"2024-01-22T05:39:46.300342+0000","last_became_peered":"2024-01-22T05:39:46.300342+0000","last_unstale":"2024-01-22T05:39:46.747046+0000","last_undegraded":"2024-01-22T05:39:46.747046+0000","last_fullsized":"2024-01-22T05:39:46.747046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281403+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277953+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.279330+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280572+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763977+0000","last_change":"2024-01-22T05:39:46.758220+0000","last_active":"2024-01-22T05:39:46.763977+0000","last_peered":"2024-01-22T05:39:46.763977+0000","last_clean":"2024-01-22T05:39:46.763977+0000","last_became_active":"2024-01-22T05:39:46.756667+0000","last_became_peered":"2024-01-22T05:39:46.756667+0000","last_unstale":"2024-01-22T05:39:46.763977+0000","last_undegraded":"2024-01-22T05:39:46.763977+0000","last_fullsized":"2024-01-22T05:39:46.763977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745951+0000","last_change":"2024-01-22T05:39:46.304938+0000","last_active":"2024-01-22T05:39:46.745951+0000","last_peered":"2024-01-22T05:39:46.745951+0000","last_clean":"2024-01-22T05:39:46.745951+0000","last_became_active":"2024-01-22T05:39:46.304555+0000","last_became_peered":"2024-01-22T05:39:46.304555+0000","last_unstale":"2024-01-22T05:39:46.745951+0000","last_undegraded":"2024-01-22T05:39:46.745951+0000","last_fullsized":"2024-01-22T05:39:46.745951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.774199+0000","last_change":"2024-01-22T05:39:46.292886+0000","last_active":"2024-01-22T05:39:46.774199+0000","last_peered":"2024-01-22T05:39:46.774199+0000","last_clean":"2024-01-22T05:39:46.774199+0000","last_became_active":"2024-01-22T05:39:46.292155+0000","last_became_peered":"2024-01-22T05:39:46.292155+0000","last_unstale":"2024-01-22T05:39:46.774199+0000","last_undegraded":"2024-01-22T05:39:46.774199+0000","last_fullsized":"2024-01-22T05:39:46.774199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283061+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.278773+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280141+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277389+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763322+0000","last_change":"2024-01-22T05:39:46.759089+0000","last_active":"2024-01-22T05:39:46.763322+0000","last_peered":"2024-01-22T05:39:46.763322+0000","last_clean":"2024-01-22T05:39:46.763322+0000","last_became_active":"2024-01-22T05:39:46.758756+0000","last_became_peered":"2024-01-22T05:39:46.758756+0000","last_unstale":"2024-01-22T05:39:46.763322+0000","last_undegraded":"2024-01-22T05:39:46.763322+0000","last_fullsized":"2024-01-22T05:39:46.763322+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277998+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300622+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300167+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302449+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280609+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300621+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300843+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280129+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280090+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.280972+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281494+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277942+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300075+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277461+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.281658+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277442+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277937+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300106+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.277560+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459487+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:43.459487+0000","last_peered":"2024-01-22T05:39:43.459487+0000","last_clean":"2024-01-22T05:39:43.459487+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:43.459487+0000","last_undegraded":"2024-01-22T05:39:43.459487+0000","last_fullsized":"2024-01-22T05:39:43.459487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300880+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747088+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:39:46.747088+0000","last_peered":"2024-01-22T05:39:46.747088+0000","last_clean":"2024-01-22T05:39:46.747088+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:39:46.747088+0000","last_undegraded":"2024-01-22T05:39:46.747088+0000","last_fullsized":"2024-01-22T05:39:46.747088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.283883+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459488+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:43.459488+0000","last_peered":"2024-01-22T05:39:43.459488+0000","last_clean":"2024-01-22T05:39:43.459488+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:43.459488+0000","last_undegraded":"2024-01-22T05:39:43.459488+0000","last_fullsized":"2024-01-22T05:39:43.459488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300171+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300136+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.438439+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:42.438439+0000","last_peered":"2024-01-22T05:39:42.438439+0000","last_clean":"2024-01-22T05:39:42.438439+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:42.438439+0000","last_undegraded":"2024-01-22T05:39:42.438439+0000","last_fullsized":"2024-01-22T05:39:42.438439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459369+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:43.459369+0000","last_peered":"2024-01-22T05:39:43.459369+0000","last_clean":"2024-01-22T05:39:43.459369+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:43.459369+0000","last_undegraded":"2024-01-22T05:39:43.459369+0000","last_fullsized":"2024-01-22T05:39:43.459369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779816+0000","last_change":"2024-01-22T05:39:46.303506+0000","last_active":"2024-01-22T05:39:46.779816+0000","last_peered":"2024-01-22T05:39:46.779816+0000","last_clean":"2024-01-22T05:39:46.779816+0000","last_became_active":"2024-01-22T05:39:46.303207+0000","last_became_peered":"2024-01-22T05:39:46.303207+0000","last_unstale":"2024-01-22T05:39:46.779816+0000","last_undegraded":"2024-01-22T05:39:46.779816+0000","last_fullsized":"2024-01-22T05:39:46.779816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:42.544833+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:42.544833+0000","last_peered":"2024-01-22T05:39:42.544833+0000","last_clean":"2024-01-22T05:39:42.544833+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:42.544833+0000","last_undegraded":"2024-01-22T05:39:42.544833+0000","last_fullsized":"2024-01-22T05:39:42.544833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.300135+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459363+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:43.459363+0000","last_peered":"2024-01-22T05:39:43.459363+0000","last_clean":"2024-01-22T05:39:43.459363+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:43.459363+0000","last_undegraded":"2024-01-22T05:39:43.459363+0000","last_fullsized":"2024-01-22T05:39:43.459363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T05:39:46.271276+0000","last_change":"2024-01-22T05:39:46.271276+0000","last_active":"2024-01-22T05:39:46.271276+0000","last_peered":"2024-01-22T05:39:46.271276+0000","last_clean":"2024-01-22T05:39:46.271276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:46.271276+0000","last_undegraded":"2024-01-22T05:39:46.271276+0000","last_fullsized":"2024-01-22T05:39:46.271276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-22T05:39:45.264354+0000","last_change":"2024-01-22T05:39:45.302016+0000","last_active":"2024-01-22T05:39:45.264354+0000","last_peered":"2024-01-22T05:39:45.264354+0000","last_clean":"2024-01-22T05:39:45.264354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T05:39:45.264354+0000","last_undegraded":"2024-01-22T05:39:45.264354+0000","last_fullsized":"2024-01-22T05:39:45.264354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-01-22T05:39:43.459971+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:43.459971+0000","last_peered":"2024-01-22T05:39:43.459971+0000","last_clean":"2024-01-22T05:39:43.459971+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:43.459971+0000","last_undegraded":"2024-01-22T05:39:43.459971+0000","last_fullsized":"2024-01-22T05:39:43.459971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73099999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.56499999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82999999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.503}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.91800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":565248,"data_stored":244291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.376}]},{"osd":1,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.58499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":577536,"data_stored":250512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.622}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.498},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:39:56.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:39:56.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.381+0000 7fb7c4600700 1 Processor -- start 2024-01-22T05:39:56.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.381+0000 7fb7c4600700 1 -- start start 2024-01-22T05:39:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.382+0000 7fb7c4600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb7bc0668e0 0x7fb7bc0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.382+0000 7fb7c4600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb7bc064950 0x7fb7bc0c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.382+0000 7fb7c4600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc1546c0 con 0x7fb7bc064dd0 2024-01-22T05:39:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.382+0000 7fb7c4600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0bc180 con 0x7fb7bc0668e0 2024-01-22T05:39:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.382+0000 7fb7c4600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0bc460 con 0x7fb7bc064950 2024-01-22T05:39:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.382+0000 7fb7c1c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb7bc0668e0 0x7fb7bc0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.382+0000 7fb7c2600700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb7bc064dd0 0x7fb7bc0bd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39564/0 (socket says 172.21.15.100:39564) 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7c2600700 1 -- 172.21.15.100:0/4092307660 learned_addr learned my addr 172.21.15.100:0/4092307660 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7c1200700 1 --2- 172.21.15.100:0/4092307660 >> v2:172.21.15.169:3300/0 conn(0x7fb7bc064950 0x7fb7bc0c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7c1c00700 1 -- 172.21.15.100:0/4092307660 >> v2:172.21.15.169:3300/0 conn(0x7fb7bc064950 msgr2=0x7fb7bc0c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7c1c00700 1 --2- 172.21.15.100:0/4092307660 >> v2:172.21.15.169:3300/0 conn(0x7fb7bc064950 0x7fb7bc0c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7c1c00700 1 -- 172.21.15.100:0/4092307660 >> v1:172.21.15.100:6789/0 conn(0x7fb7bc064dd0 legacy=0x7fb7bc0bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7c1c00700 1 -- 172.21.15.100:0/4092307660 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0bc740 con 0x7fb7bc0668e0 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7c1c00700 1 --2- 172.21.15.100:0/4092307660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0c4200 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fb7bc067ab0 tx=0x7fb7ac009060).ready entity=mon.0 client_cookie=dd2e4a7d1f833425 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7bbe00700 1 -- 172.21.15.100:0/4092307660 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00b580 con 0x7fb7bc0668e0 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7bbe00700 1 -- 172.21.15.100:0/4092307660 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac00b6e0 con 0x7fb7bc0668e0 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.383+0000 7fb7bbe00700 1 -- 172.21.15.100:0/4092307660 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00ba60 con 0x7fb7bc0668e0 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 -- 172.21.15.100:0/4092307660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 msgr2=0x7fb7bc0c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 --2- 172.21.15.100:0/4092307660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0c4200 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fb7bc067ab0 tx=0x7fb7ac009060).stop 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 -- 172.21.15.100:0/4092307660 shutdown_connections 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 --2- 172.21.15.100:0/4092307660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0c4200 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 --2- 172.21.15.100:0/4092307660 >> v2:172.21.15.169:3300/0 conn(0x7fb7bc064950 0x7fb7bc0c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 -- 172.21.15.100:0/4092307660 >> 172.21.15.100:0/4092307660 conn(0x7fb7bc0c78d0 msgr2=0x7fb7bc0c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:56.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 -- 172.21.15.100:0/4092307660 shutdown_connections 2024-01-22T05:39:56.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.384+0000 7fb7c4600700 1 -- 172.21.15.100:0/4092307660 wait complete. 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.386+0000 7fb7c4600700 1 Processor -- start 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.386+0000 7fb7c4600700 1 -- start start 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.386+0000 7fb7c4600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7bc064950 0x7fb7bc151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c4600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7bc064dd0 0x7fb7bc0935c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c4600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c4600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0a66c0 con 0x7fb7bc0668e0 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c4600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0a69a0 con 0x7fb7bc064950 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c4600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0944a0 con 0x7fb7bc064dd0 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49866/0 (socket says 172.21.15.100:49866) 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 -- 172.21.15.100:0/3530127997 learned_addr learned my addr 172.21.15.100:0/3530127997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c1c00700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7bc064950 0x7fb7bc151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c1200700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7bc064dd0 0x7fb7bc0935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 -- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7bc064dd0 msgr2=0x7fb7bc0935c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7bc064dd0 0x7fb7bc0935c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 -- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7bc064950 msgr2=0x7fb7bc151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7bc064950 0x7fb7bc151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 -- 172.21.15.100:0/3530127997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0092a0 con 0x7fb7bc0668e0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.387+0000 7fb7c2600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0a6e30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb7b400c7c0 tx=0x7fb7b40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.388+0000 7fb7b8c00700 1 -- 172.21.15.100:0/3530127997 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4005d30 con 0x7fb7bc0668e0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.388+0000 7fb7b8c00700 1 -- 172.21.15.100:0/3530127997 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b4005e90 con 0x7fb7bc0668e0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.388+0000 7fb7b8c00700 1 -- 172.21.15.100:0/3530127997 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4007320 con 0x7fb7bc0668e0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.388+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc094780 con 0x7fb7bc0668e0 2024-01-22T05:39:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.388+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc093ab0 con 0x7fb7bc0668e0 2024-01-22T05:39:56.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.389+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc05fdb0 con 0x7fb7bc0668e0 2024-01-22T05:39:56.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.390+0000 7fb7b8c00700 1 -- 172.21.15.100:0/3530127997 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb7b40076d0 con 0x7fb7bc0668e0 2024-01-22T05:39:56.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.390+0000 7fb7b8c00700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb79405f150 0x7fb794061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.390+0000 7fb7b8c00700 1 -- 172.21.15.100:0/3530127997 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb7b407a1c0 con 0x7fb7bc0668e0 2024-01-22T05:39:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.391+0000 7fb7c1c00700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb79405f150 0x7fb794061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.391+0000 7fb7c1c00700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb79405f150 0x7fb794061610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fb7ac009fd0 tx=0x7fb7ac017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:56.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.395+0000 7fb7b8c00700 1 -- 172.21.15.100:0/3530127997 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb7b404b490 con 0x7fb7bc0668e0 2024-01-22T05:39:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.559+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7bc0a6ae0 con 0x7fb79405f150 2024-01-22T05:39:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.570+0000 7fb7b8c00700 1 -- 172.21.15.100:0/3530127997 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360931 (secure 0 0 0) 0x7fb7bc0a6ae0 con 0x7fb79405f150 2024-01-22T05:39:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:56.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb79405f150 msgr2=0x7fb794061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb79405f150 0x7fb794061610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fb7ac009fd0 tx=0x7fb7ac017000).stop 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 msgr2=0x7fb7bc0a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0a6e30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb7b400c7c0 tx=0x7fb7b40015e0).stop 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 shutdown_connections 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb79405f150 0x7fb794061610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7bc064950 0x7fb7bc151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7bc0668e0 0x7fb7bc0a6e30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 --2- 172.21.15.100:0/3530127997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7bc064dd0 0x7fb7bc0935c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.574+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 >> 172.21.15.100:0/3530127997 conn(0x7fb7bc0c78d0 msgr2=0x7fb7bc0c2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.575+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 shutdown_connections 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.575+0000 7fb7c4600700 1 -- 172.21.15.100:0/3530127997 wait complete. 2024-01-22T05:39:56.578 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:39:56.592 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-01-22T05:39:55.158486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381632,"kb_used_data":4864,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593088,"statfs":{"total":773094113280,"available":770655322112,"internally_reserved":0,"allocated":4980736,"data_stored":2173204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7757,"num_objects":-3,"num_object_clones":0,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-12,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.067805"},"pg_stats":[{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.780690+0000","last_change":"2024-01-22T05:39:46.768327+0000","last_active":"2024-01-22T05:39:46.780690+0000","last_peered":"2024-01-22T05:39:46.780690+0000","last_clean":"2024-01-22T05:39:46.780690+0000","last_became_active":"2024-01-22T05:39:46.766332+0000","last_became_peered":"2024-01-22T05:39:46.766332+0000","last_unstale":"2024-01-22T05:39:46.780690+0000","last_undegraded":"2024-01-22T05:39:46.780690+0000","last_fullsized":"2024-01-22T05:39:46.780690+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"51'3","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.782131+0000","last_change":"2024-01-22T05:39:46.302890+0000","last_active":"2024-01-22T05:39:46.782131+0000","last_peered":"2024-01-22T05:39:46.782131+0000","last_clean":"2024-01-22T05:39:46.782131+0000","last_became_active":"2024-01-22T05:39:46.302256+0000","last_became_peered":"2024-01-22T05:39:46.302256+0000","last_unstale":"2024-01-22T05:39:46.782131+0000","last_undegraded":"2024-01-22T05:39:46.782131+0000","last_fullsized":"2024-01-22T05:39:46.782131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.782197+0000","last_change":"2024-01-22T05:39:46.775004+0000","last_active":"2024-01-22T05:39:46.782197+0000","last_peered":"2024-01-22T05:39:46.782197+0000","last_clean":"2024-01-22T05:39:46.782197+0000","last_became_active":"2024-01-22T05:39:46.774731+0000","last_became_peered":"2024-01-22T05:39:46.774731+0000","last_unstale":"2024-01-22T05:39:46.782197+0000","last_undegraded":"2024-01-22T05:39:46.782197+0000","last_fullsized":"2024-01-22T05:39:46.782197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.748808+0000","last_change":"2024-01-22T05:39:46.310814+0000","last_active":"2024-01-22T05:39:46.748808+0000","last_peered":"2024-01-22T05:39:46.748808+0000","last_clean":"2024-01-22T05:39:46.748808+0000","last_became_active":"2024-01-22T05:39:46.310498+0000","last_became_peered":"2024-01-22T05:39:46.310498+0000","last_unstale":"2024-01-22T05:39:46.748808+0000","last_undegraded":"2024-01-22T05:39:46.748808+0000","last_fullsized":"2024-01-22T05:39:46.748808+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.784157+0000","last_change":"2024-01-22T05:39:46.780604+0000","last_active":"2024-01-22T05:39:46.784157+0000","last_peered":"2024-01-22T05:39:46.784157+0000","last_clean":"2024-01-22T05:39:46.784157+0000","last_became_active":"2024-01-22T05:39:46.780296+0000","last_became_peered":"2024-01-22T05:39:46.780296+0000","last_unstale":"2024-01-22T05:39:46.784157+0000","last_undegraded":"2024-01-22T05:39:46.784157+0000","last_fullsized":"2024-01-22T05:39:46.784157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747364+0000","last_change":"2024-01-22T05:39:46.309910+0000","last_active":"2024-01-22T05:39:46.747364+0000","last_peered":"2024-01-22T05:39:46.747364+0000","last_clean":"2024-01-22T05:39:46.747364+0000","last_became_active":"2024-01-22T05:39:46.308571+0000","last_became_peered":"2024-01-22T05:39:46.308571+0000","last_unstale":"2024-01-22T05:39:46.747364+0000","last_undegraded":"2024-01-22T05:39:46.747364+0000","last_fullsized":"2024-01-22T05:39:46.747364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.759077+0000","last_change":"2024-01-22T05:39:46.757390+0000","last_active":"2024-01-22T05:39:46.759077+0000","last_peered":"2024-01-22T05:39:46.759077+0000","last_clean":"2024-01-22T05:39:46.759077+0000","last_became_active":"2024-01-22T05:39:46.757082+0000","last_became_peered":"2024-01-22T05:39:46.757082+0000","last_unstale":"2024-01-22T05:39:46.759077+0000","last_undegraded":"2024-01-22T05:39:46.759077+0000","last_fullsized":"2024-01-22T05:39:46.759077+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.781136+0000","last_change":"2024-01-22T05:39:46.302421+0000","last_active":"2024-01-22T05:39:46.781136+0000","last_peered":"2024-01-22T05:39:46.781136+0000","last_clean":"2024-01-22T05:39:46.781136+0000","last_became_active":"2024-01-22T05:39:46.302136+0000","last_became_peered":"2024-01-22T05:39:46.302136+0000","last_unstale":"2024-01-22T05:39:46.781136+0000","last_undegraded":"2024-01-22T05:39:46.781136+0000","last_fullsized":"2024-01-22T05:39:46.781136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.777707+0000","last_change":"2024-01-22T05:39:46.765468+0000","last_active":"2024-01-22T05:39:46.777707+0000","last_peered":"2024-01-22T05:39:46.777707+0000","last_clean":"2024-01-22T05:39:46.777707+0000","last_became_active":"2024-01-22T05:39:46.762497+0000","last_became_peered":"2024-01-22T05:39:46.762497+0000","last_unstale":"2024-01-22T05:39:46.777707+0000","last_undegraded":"2024-01-22T05:39:46.777707+0000","last_fullsized":"2024-01-22T05:39:46.777707+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.780844+0000","last_change":"2024-01-22T05:39:46.305969+0000","last_active":"2024-01-22T05:39:46.780844+0000","last_peered":"2024-01-22T05:39:46.780844+0000","last_clean":"2024-01-22T05:39:46.780844+0000","last_became_active":"2024-01-22T05:39:46.305696+0000","last_became_peered":"2024-01-22T05:39:46.305696+0000","last_unstale":"2024-01-22T05:39:46.780844+0000","last_undegraded":"2024-01-22T05:39:46.780844+0000","last_fullsized":"2024-01-22T05:39:46.780844+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779722+0000","last_change":"2024-01-22T05:39:46.771640+0000","last_active":"2024-01-22T05:39:46.779722+0000","last_peered":"2024-01-22T05:39:46.779722+0000","last_clean":"2024-01-22T05:39:46.779722+0000","last_became_active":"2024-01-22T05:39:46.771280+0000","last_became_peered":"2024-01-22T05:39:46.771280+0000","last_unstale":"2024-01-22T05:39:46.779722+0000","last_undegraded":"2024-01-22T05:39:46.779722+0000","last_fullsized":"2024-01-22T05:39:46.779722+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.786210+0000","last_change":"2024-01-22T05:39:46.301319+0000","last_active":"2024-01-22T05:39:46.786210+0000","last_peered":"2024-01-22T05:39:46.786210+0000","last_clean":"2024-01-22T05:39:46.786210+0000","last_became_active":"2024-01-22T05:39:46.301020+0000","last_became_peered":"2024-01-22T05:39:46.301020+0000","last_unstale":"2024-01-22T05:39:46.786210+0000","last_undegraded":"2024-01-22T05:39:46.786210+0000","last_fullsized":"2024-01-22T05:39:46.786210+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.778455+0000","last_change":"2024-01-22T05:39:46.767051+0000","last_active":"2024-01-22T05:39:46.778455+0000","last_peered":"2024-01-22T05:39:46.778455+0000","last_clean":"2024-01-22T05:39:46.778455+0000","last_became_active":"2024-01-22T05:39:46.766689+0000","last_became_peered":"2024-01-22T05:39:46.766689+0000","last_unstale":"2024-01-22T05:39:46.778455+0000","last_undegraded":"2024-01-22T05:39:46.778455+0000","last_fullsized":"2024-01-22T05:39:46.778455+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.752831+0000","last_change":"2024-01-22T05:39:46.301544+0000","last_active":"2024-01-22T05:39:46.752831+0000","last_peered":"2024-01-22T05:39:46.752831+0000","last_clean":"2024-01-22T05:39:46.752831+0000","last_became_active":"2024-01-22T05:39:46.300543+0000","last_became_peered":"2024-01-22T05:39:46.300543+0000","last_unstale":"2024-01-22T05:39:46.752831+0000","last_undegraded":"2024-01-22T05:39:46.752831+0000","last_fullsized":"2024-01-22T05:39:46.752831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.767346+0000","last_change":"2024-01-22T05:39:46.760136+0000","last_active":"2024-01-22T05:39:46.767346+0000","last_peered":"2024-01-22T05:39:46.767346+0000","last_clean":"2024-01-22T05:39:46.767346+0000","last_became_active":"2024-01-22T05:39:46.759885+0000","last_became_peered":"2024-01-22T05:39:46.759885+0000","last_unstale":"2024-01-22T05:39:46.767346+0000","last_undegraded":"2024-01-22T05:39:46.767346+0000","last_fullsized":"2024-01-22T05:39:46.767346+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.752016+0000","last_change":"2024-01-22T05:39:46.311462+0000","last_active":"2024-01-22T05:39:46.752016+0000","last_peered":"2024-01-22T05:39:46.752016+0000","last_clean":"2024-01-22T05:39:46.752016+0000","last_became_active":"2024-01-22T05:39:46.311161+0000","last_became_peered":"2024-01-22T05:39:46.311161+0000","last_unstale":"2024-01-22T05:39:46.752016+0000","last_undegraded":"2024-01-22T05:39:46.752016+0000","last_fullsized":"2024-01-22T05:39:46.752016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.777097+0000","last_change":"2024-01-22T05:39:46.764832+0000","last_active":"2024-01-22T05:39:46.777097+0000","last_peered":"2024-01-22T05:39:46.777097+0000","last_clean":"2024-01-22T05:39:46.777097+0000","last_became_active":"2024-01-22T05:39:46.764550+0000","last_became_peered":"2024-01-22T05:39:46.764550+0000","last_unstale":"2024-01-22T05:39:46.777097+0000","last_undegraded":"2024-01-22T05:39:46.777097+0000","last_fullsized":"2024-01-22T05:39:46.777097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747599+0000","last_change":"2024-01-22T05:39:46.310167+0000","last_active":"2024-01-22T05:39:46.747599+0000","last_peered":"2024-01-22T05:39:46.747599+0000","last_clean":"2024-01-22T05:39:46.747599+0000","last_became_active":"2024-01-22T05:39:46.308743+0000","last_became_peered":"2024-01-22T05:39:46.308743+0000","last_unstale":"2024-01-22T05:39:46.747599+0000","last_undegraded":"2024-01-22T05:39:46.747599+0000","last_fullsized":"2024-01-22T05:39:46.747599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779217+0000","last_change":"2024-01-22T05:39:46.778254+0000","last_active":"2024-01-22T05:39:46.779217+0000","last_peered":"2024-01-22T05:39:46.779217+0000","last_clean":"2024-01-22T05:39:46.779217+0000","last_became_active":"2024-01-22T05:39:46.777982+0000","last_became_peered":"2024-01-22T05:39:46.777982+0000","last_unstale":"2024-01-22T05:39:46.779217+0000","last_undegraded":"2024-01-22T05:39:46.779217+0000","last_fullsized":"2024-01-22T05:39:46.779217+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751758+0000","last_change":"2024-01-22T05:39:46.316403+0000","last_active":"2024-01-22T05:39:46.751758+0000","last_peered":"2024-01-22T05:39:46.751758+0000","last_clean":"2024-01-22T05:39:46.751758+0000","last_became_active":"2024-01-22T05:39:46.316099+0000","last_became_peered":"2024-01-22T05:39:46.316099+0000","last_unstale":"2024-01-22T05:39:46.751758+0000","last_undegraded":"2024-01-22T05:39:46.751758+0000","last_fullsized":"2024-01-22T05:39:46.751758+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.776482+0000","last_change":"2024-01-22T05:39:46.775342+0000","last_active":"2024-01-22T05:39:46.776482+0000","last_peered":"2024-01-22T05:39:46.776482+0000","last_clean":"2024-01-22T05:39:46.776482+0000","last_became_active":"2024-01-22T05:39:46.774434+0000","last_became_peered":"2024-01-22T05:39:46.774434+0000","last_unstale":"2024-01-22T05:39:46.776482+0000","last_undegraded":"2024-01-22T05:39:46.776482+0000","last_fullsized":"2024-01-22T05:39:46.776482+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751078+0000","last_change":"2024-01-22T05:39:46.302889+0000","last_active":"2024-01-22T05:39:46.751078+0000","last_peered":"2024-01-22T05:39:46.751078+0000","last_clean":"2024-01-22T05:39:46.751078+0000","last_became_active":"2024-01-22T05:39:46.302602+0000","last_became_peered":"2024-01-22T05:39:46.302602+0000","last_unstale":"2024-01-22T05:39:46.751078+0000","last_undegraded":"2024-01-22T05:39:46.751078+0000","last_fullsized":"2024-01-22T05:39:46.751078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.768775+0000","last_change":"2024-01-22T05:39:46.763814+0000","last_active":"2024-01-22T05:39:46.768775+0000","last_peered":"2024-01-22T05:39:46.768775+0000","last_clean":"2024-01-22T05:39:46.768775+0000","last_became_active":"2024-01-22T05:39:46.763536+0000","last_became_peered":"2024-01-22T05:39:46.763536+0000","last_unstale":"2024-01-22T05:39:46.768775+0000","last_undegraded":"2024-01-22T05:39:46.768775+0000","last_fullsized":"2024-01-22T05:39:46.768775+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.34","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.790596+0000","last_change":"2024-01-22T05:39:46.302677+0000","last_active":"2024-01-22T05:39:46.790596+0000","last_peered":"2024-01-22T05:39:46.790596+0000","last_clean":"2024-01-22T05:39:46.790596+0000","last_became_active":"2024-01-22T05:39:46.301995+0000","last_became_peered":"2024-01-22T05:39:46.301995+0000","last_unstale":"2024-01-22T05:39:46.790596+0000","last_undegraded":"2024-01-22T05:39:46.790596+0000","last_fullsized":"2024-01-22T05:39:46.790596+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.776649+0000","last_change":"2024-01-22T05:39:46.762839+0000","last_active":"2024-01-22T05:39:46.776649+0000","last_peered":"2024-01-22T05:39:46.776649+0000","last_clean":"2024-01-22T05:39:46.776649+0000","last_became_active":"2024-01-22T05:39:46.762507+0000","last_became_peered":"2024-01-22T05:39:46.762507+0000","last_unstale":"2024-01-22T05:39:46.776649+0000","last_undegraded":"2024-01-22T05:39:46.776649+0000","last_fullsized":"2024-01-22T05:39:46.776649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.787289+0000","last_change":"2024-01-22T05:39:46.302205+0000","last_active":"2024-01-22T05:39:46.787289+0000","last_peered":"2024-01-22T05:39:46.787289+0000","last_clean":"2024-01-22T05:39:46.787289+0000","last_became_active":"2024-01-22T05:39:46.301912+0000","last_became_peered":"2024-01-22T05:39:46.301912+0000","last_unstale":"2024-01-22T05:39:46.787289+0000","last_undegraded":"2024-01-22T05:39:46.787289+0000","last_fullsized":"2024-01-22T05:39:46.787289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.785981+0000","last_change":"2024-01-22T05:39:46.774378+0000","last_active":"2024-01-22T05:39:46.785981+0000","last_peered":"2024-01-22T05:39:46.785981+0000","last_clean":"2024-01-22T05:39:46.785981+0000","last_became_active":"2024-01-22T05:39:46.773441+0000","last_became_peered":"2024-01-22T05:39:46.773441+0000","last_unstale":"2024-01-22T05:39:46.785981+0000","last_undegraded":"2024-01-22T05:39:46.785981+0000","last_fullsized":"2024-01-22T05:39:46.785981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751211+0000","last_change":"2024-01-22T05:39:46.308047+0000","last_active":"2024-01-22T05:39:46.751211+0000","last_peered":"2024-01-22T05:39:46.751211+0000","last_clean":"2024-01-22T05:39:46.751211+0000","last_became_active":"2024-01-22T05:39:46.307742+0000","last_became_peered":"2024-01-22T05:39:46.307742+0000","last_unstale":"2024-01-22T05:39:46.751211+0000","last_undegraded":"2024-01-22T05:39:46.751211+0000","last_fullsized":"2024-01-22T05:39:46.751211+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779479+0000","last_change":"2024-01-22T05:39:46.771021+0000","last_active":"2024-01-22T05:39:46.779479+0000","last_peered":"2024-01-22T05:39:46.779479+0000","last_clean":"2024-01-22T05:39:46.779479+0000","last_became_active":"2024-01-22T05:39:46.770721+0000","last_became_peered":"2024-01-22T05:39:46.770721+0000","last_unstale":"2024-01-22T05:39:46.779479+0000","last_undegraded":"2024-01-22T05:39:46.779479+0000","last_fullsized":"2024-01-22T05:39:46.779479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.750618+0000","last_change":"2024-01-22T05:39:46.310215+0000","last_active":"2024-01-22T05:39:46.750618+0000","last_peered":"2024-01-22T05:39:46.750618+0000","last_clean":"2024-01-22T05:39:46.750618+0000","last_became_active":"2024-01-22T05:39:46.309948+0000","last_became_peered":"2024-01-22T05:39:46.309948+0000","last_unstale":"2024-01-22T05:39:46.750618+0000","last_undegraded":"2024-01-22T05:39:46.750618+0000","last_fullsized":"2024-01-22T05:39:46.750618+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.770978+0000","last_change":"2024-01-22T05:39:46.765184+0000","last_active":"2024-01-22T05:39:46.770978+0000","last_peered":"2024-01-22T05:39:46.770978+0000","last_clean":"2024-01-22T05:39:46.770978+0000","last_became_active":"2024-01-22T05:39:46.764889+0000","last_became_peered":"2024-01-22T05:39:46.764889+0000","last_unstale":"2024-01-22T05:39:46.770978+0000","last_undegraded":"2024-01-22T05:39:46.770978+0000","last_fullsized":"2024-01-22T05:39:46.770978+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.787283+0000","last_change":"2024-01-22T05:39:46.303354+0000","last_active":"2024-01-22T05:39:46.787283+0000","last_peered":"2024-01-22T05:39:46.787283+0000","last_clean":"2024-01-22T05:39:46.787283+0000","last_became_active":"2024-01-22T05:39:46.301451+0000","last_became_peered":"2024-01-22T05:39:46.301451+0000","last_unstale":"2024-01-22T05:39:46.787283+0000","last_undegraded":"2024-01-22T05:39:46.787283+0000","last_fullsized":"2024-01-22T05:39:46.787283+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.776849+0000","last_change":"2024-01-22T05:39:46.768047+0000","last_active":"2024-01-22T05:39:46.776849+0000","last_peered":"2024-01-22T05:39:46.776849+0000","last_clean":"2024-01-22T05:39:46.776849+0000","last_became_active":"2024-01-22T05:39:46.767600+0000","last_became_peered":"2024-01-22T05:39:46.767600+0000","last_unstale":"2024-01-22T05:39:46.776849+0000","last_undegraded":"2024-01-22T05:39:46.776849+0000","last_fullsized":"2024-01-22T05:39:46.776849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.755187+0000","last_change":"2024-01-22T05:39:46.302535+0000","last_active":"2024-01-22T05:39:46.755187+0000","last_peered":"2024-01-22T05:39:46.755187+0000","last_clean":"2024-01-22T05:39:46.755187+0000","last_became_active":"2024-01-22T05:39:46.301905+0000","last_became_peered":"2024-01-22T05:39:46.301905+0000","last_unstale":"2024-01-22T05:39:46.755187+0000","last_undegraded":"2024-01-22T05:39:46.755187+0000","last_fullsized":"2024-01-22T05:39:46.755187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779436+0000","last_change":"2024-01-22T05:39:46.770634+0000","last_active":"2024-01-22T05:39:46.779436+0000","last_peered":"2024-01-22T05:39:46.779436+0000","last_clean":"2024-01-22T05:39:46.779436+0000","last_became_active":"2024-01-22T05:39:46.770159+0000","last_became_peered":"2024-01-22T05:39:46.770159+0000","last_unstale":"2024-01-22T05:39:46.779436+0000","last_undegraded":"2024-01-22T05:39:46.779436+0000","last_fullsized":"2024-01-22T05:39:46.779436+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751164+0000","last_change":"2024-01-22T05:39:46.303502+0000","last_active":"2024-01-22T05:39:46.751164+0000","last_peered":"2024-01-22T05:39:46.751164+0000","last_clean":"2024-01-22T05:39:46.751164+0000","last_became_active":"2024-01-22T05:39:46.302301+0000","last_became_peered":"2024-01-22T05:39:46.302301+0000","last_unstale":"2024-01-22T05:39:46.751164+0000","last_undegraded":"2024-01-22T05:39:46.751164+0000","last_fullsized":"2024-01-22T05:39:46.751164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773120+0000","last_change":"2024-01-22T05:39:46.768342+0000","last_active":"2024-01-22T05:39:46.773120+0000","last_peered":"2024-01-22T05:39:46.773120+0000","last_clean":"2024-01-22T05:39:46.773120+0000","last_became_active":"2024-01-22T05:39:46.768063+0000","last_became_peered":"2024-01-22T05:39:46.768063+0000","last_unstale":"2024-01-22T05:39:46.773120+0000","last_undegraded":"2024-01-22T05:39:46.773120+0000","last_fullsized":"2024-01-22T05:39:46.773120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775994+0000","last_change":"2024-01-22T05:39:46.304812+0000","last_active":"2024-01-22T05:39:46.775994+0000","last_peered":"2024-01-22T05:39:46.775994+0000","last_clean":"2024-01-22T05:39:46.775994+0000","last_became_active":"2024-01-22T05:39:46.304410+0000","last_became_peered":"2024-01-22T05:39:46.304410+0000","last_unstale":"2024-01-22T05:39:46.775994+0000","last_undegraded":"2024-01-22T05:39:46.775994+0000","last_fullsized":"2024-01-22T05:39:46.775994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.774780+0000","last_change":"2024-01-22T05:39:46.767050+0000","last_active":"2024-01-22T05:39:46.774780+0000","last_peered":"2024-01-22T05:39:46.774780+0000","last_clean":"2024-01-22T05:39:46.774780+0000","last_became_active":"2024-01-22T05:39:46.766735+0000","last_became_peered":"2024-01-22T05:39:46.766735+0000","last_unstale":"2024-01-22T05:39:46.774780+0000","last_undegraded":"2024-01-22T05:39:46.774780+0000","last_fullsized":"2024-01-22T05:39:46.774780+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.749954+0000","last_change":"2024-01-22T05:39:46.308246+0000","last_active":"2024-01-22T05:39:46.749954+0000","last_peered":"2024-01-22T05:39:46.749954+0000","last_clean":"2024-01-22T05:39:46.749954+0000","last_became_active":"2024-01-22T05:39:46.307400+0000","last_became_peered":"2024-01-22T05:39:46.307400+0000","last_unstale":"2024-01-22T05:39:46.749954+0000","last_undegraded":"2024-01-22T05:39:46.749954+0000","last_fullsized":"2024-01-22T05:39:46.749954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.765647+0000","last_change":"2024-01-22T05:39:46.762645+0000","last_active":"2024-01-22T05:39:46.765647+0000","last_peered":"2024-01-22T05:39:46.765647+0000","last_clean":"2024-01-22T05:39:46.765647+0000","last_became_active":"2024-01-22T05:39:46.762233+0000","last_became_peered":"2024-01-22T05:39:46.762233+0000","last_unstale":"2024-01-22T05:39:46.765647+0000","last_undegraded":"2024-01-22T05:39:46.765647+0000","last_fullsized":"2024-01-22T05:39:46.765647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.777460+0000","last_change":"2024-01-22T05:39:46.314229+0000","last_active":"2024-01-22T05:39:46.777460+0000","last_peered":"2024-01-22T05:39:46.777460+0000","last_clean":"2024-01-22T05:39:46.777460+0000","last_became_active":"2024-01-22T05:39:46.313218+0000","last_became_peered":"2024-01-22T05:39:46.313218+0000","last_unstale":"2024-01-22T05:39:46.777460+0000","last_undegraded":"2024-01-22T05:39:46.777460+0000","last_fullsized":"2024-01-22T05:39:46.777460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.780918+0000","last_change":"2024-01-22T05:39:46.777992+0000","last_active":"2024-01-22T05:39:46.780918+0000","last_peered":"2024-01-22T05:39:46.780918+0000","last_clean":"2024-01-22T05:39:46.780918+0000","last_became_active":"2024-01-22T05:39:46.777653+0000","last_became_peered":"2024-01-22T05:39:46.777653+0000","last_unstale":"2024-01-22T05:39:46.780918+0000","last_undegraded":"2024-01-22T05:39:46.780918+0000","last_fullsized":"2024-01-22T05:39:46.780918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746539+0000","last_change":"2024-01-22T05:39:46.304785+0000","last_active":"2024-01-22T05:39:46.746539+0000","last_peered":"2024-01-22T05:39:46.746539+0000","last_clean":"2024-01-22T05:39:46.746539+0000","last_became_active":"2024-01-22T05:39:46.304460+0000","last_became_peered":"2024-01-22T05:39:46.304460+0000","last_unstale":"2024-01-22T05:39:46.746539+0000","last_undegraded":"2024-01-22T05:39:46.746539+0000","last_fullsized":"2024-01-22T05:39:46.746539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.784516+0000","last_change":"2024-01-22T05:39:46.780768+0000","last_active":"2024-01-22T05:39:46.784516+0000","last_peered":"2024-01-22T05:39:46.784516+0000","last_clean":"2024-01-22T05:39:46.784516+0000","last_became_active":"2024-01-22T05:39:46.777648+0000","last_became_peered":"2024-01-22T05:39:46.777648+0000","last_unstale":"2024-01-22T05:39:46.784516+0000","last_undegraded":"2024-01-22T05:39:46.784516+0000","last_fullsized":"2024-01-22T05:39:46.784516+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745821+0000","last_change":"2024-01-22T05:39:46.309461+0000","last_active":"2024-01-22T05:39:46.745821+0000","last_peered":"2024-01-22T05:39:46.745821+0000","last_clean":"2024-01-22T05:39:46.745821+0000","last_became_active":"2024-01-22T05:39:46.308091+0000","last_became_peered":"2024-01-22T05:39:46.308091+0000","last_unstale":"2024-01-22T05:39:46.745821+0000","last_undegraded":"2024-01-22T05:39:46.745821+0000","last_fullsized":"2024-01-22T05:39:46.745821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775952+0000","last_change":"2024-01-22T05:39:46.771898+0000","last_active":"2024-01-22T05:39:46.775952+0000","last_peered":"2024-01-22T05:39:46.775952+0000","last_clean":"2024-01-22T05:39:46.775952+0000","last_became_active":"2024-01-22T05:39:46.771322+0000","last_became_peered":"2024-01-22T05:39:46.771322+0000","last_unstale":"2024-01-22T05:39:46.775952+0000","last_undegraded":"2024-01-22T05:39:46.775952+0000","last_fullsized":"2024-01-22T05:39:46.775952+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.746747+0000","last_change":"2024-01-22T05:39:46.294516+0000","last_active":"2024-01-22T05:39:46.746747+0000","last_peered":"2024-01-22T05:39:46.746747+0000","last_clean":"2024-01-22T05:39:46.746747+0000","last_became_active":"2024-01-22T05:39:46.294176+0000","last_became_peered":"2024-01-22T05:39:46.294176+0000","last_unstale":"2024-01-22T05:39:46.746747+0000","last_undegraded":"2024-01-22T05:39:46.746747+0000","last_fullsized":"2024-01-22T05:39:46.746747+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775517+0000","last_change":"2024-01-22T05:39:46.770809+0000","last_active":"2024-01-22T05:39:46.775517+0000","last_peered":"2024-01-22T05:39:46.775517+0000","last_clean":"2024-01-22T05:39:46.775517+0000","last_became_active":"2024-01-22T05:39:46.770205+0000","last_became_peered":"2024-01-22T05:39:46.770205+0000","last_unstale":"2024-01-22T05:39:46.775517+0000","last_undegraded":"2024-01-22T05:39:46.775517+0000","last_fullsized":"2024-01-22T05:39:46.775517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.754964+0000","last_change":"2024-01-22T05:39:46.313496+0000","last_active":"2024-01-22T05:39:46.754964+0000","last_peered":"2024-01-22T05:39:46.754964+0000","last_clean":"2024-01-22T05:39:46.754964+0000","last_became_active":"2024-01-22T05:39:46.313078+0000","last_became_peered":"2024-01-22T05:39:46.313078+0000","last_unstale":"2024-01-22T05:39:46.754964+0000","last_undegraded":"2024-01-22T05:39:46.754964+0000","last_fullsized":"2024-01-22T05:39:46.754964+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.784269+0000","last_change":"2024-01-22T05:39:46.781236+0000","last_active":"2024-01-22T05:39:46.784269+0000","last_peered":"2024-01-22T05:39:46.784269+0000","last_clean":"2024-01-22T05:39:46.784269+0000","last_became_active":"2024-01-22T05:39:46.780949+0000","last_became_peered":"2024-01-22T05:39:46.780949+0000","last_unstale":"2024-01-22T05:39:46.784269+0000","last_undegraded":"2024-01-22T05:39:46.784269+0000","last_fullsized":"2024-01-22T05:39:46.784269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747046+0000","last_change":"2024-01-22T05:39:46.300671+0000","last_active":"2024-01-22T05:39:46.747046+0000","last_peered":"2024-01-22T05:39:46.747046+0000","last_clean":"2024-01-22T05:39:46.747046+0000","last_became_active":"2024-01-22T05:39:46.300342+0000","last_became_peered":"2024-01-22T05:39:46.300342+0000","last_unstale":"2024-01-22T05:39:46.747046+0000","last_undegraded":"2024-01-22T05:39:46.747046+0000","last_fullsized":"2024-01-22T05:39:46.747046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.780978+0000","last_change":"2024-01-22T05:39:46.771972+0000","last_active":"2024-01-22T05:39:46.780978+0000","last_peered":"2024-01-22T05:39:46.780978+0000","last_clean":"2024-01-22T05:39:46.780978+0000","last_became_active":"2024-01-22T05:39:46.771651+0000","last_became_peered":"2024-01-22T05:39:46.771651+0000","last_unstale":"2024-01-22T05:39:46.780978+0000","last_undegraded":"2024-01-22T05:39:46.780978+0000","last_fullsized":"2024-01-22T05:39:46.780978+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.755868+0000","last_change":"2024-01-22T05:39:46.314726+0000","last_active":"2024-01-22T05:39:46.755868+0000","last_peered":"2024-01-22T05:39:46.755868+0000","last_clean":"2024-01-22T05:39:46.755868+0000","last_became_active":"2024-01-22T05:39:46.314242+0000","last_became_peered":"2024-01-22T05:39:46.314242+0000","last_unstale":"2024-01-22T05:39:46.755868+0000","last_undegraded":"2024-01-22T05:39:46.755868+0000","last_fullsized":"2024-01-22T05:39:46.755868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.782070+0000","last_change":"2024-01-22T05:39:46.774695+0000","last_active":"2024-01-22T05:39:46.782070+0000","last_peered":"2024-01-22T05:39:46.782070+0000","last_clean":"2024-01-22T05:39:46.782070+0000","last_became_active":"2024-01-22T05:39:46.774272+0000","last_became_peered":"2024-01-22T05:39:46.774272+0000","last_unstale":"2024-01-22T05:39:46.782070+0000","last_undegraded":"2024-01-22T05:39:46.782070+0000","last_fullsized":"2024-01-22T05:39:46.782070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.750035+0000","last_change":"2024-01-22T05:39:46.312256+0000","last_active":"2024-01-22T05:39:46.750035+0000","last_peered":"2024-01-22T05:39:46.750035+0000","last_clean":"2024-01-22T05:39:46.750035+0000","last_became_active":"2024-01-22T05:39:46.311952+0000","last_became_peered":"2024-01-22T05:39:46.311952+0000","last_unstale":"2024-01-22T05:39:46.750035+0000","last_undegraded":"2024-01-22T05:39:46.750035+0000","last_fullsized":"2024-01-22T05:39:46.750035+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.774569+0000","last_change":"2024-01-22T05:39:46.768830+0000","last_active":"2024-01-22T05:39:46.774569+0000","last_peered":"2024-01-22T05:39:46.774569+0000","last_clean":"2024-01-22T05:39:46.774569+0000","last_became_active":"2024-01-22T05:39:46.768499+0000","last_became_peered":"2024-01-22T05:39:46.768499+0000","last_unstale":"2024-01-22T05:39:46.774569+0000","last_undegraded":"2024-01-22T05:39:46.774569+0000","last_fullsized":"2024-01-22T05:39:46.774569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.750802+0000","last_change":"2024-01-22T05:39:46.307245+0000","last_active":"2024-01-22T05:39:46.750802+0000","last_peered":"2024-01-22T05:39:46.750802+0000","last_clean":"2024-01-22T05:39:46.750802+0000","last_became_active":"2024-01-22T05:39:46.306885+0000","last_became_peered":"2024-01-22T05:39:46.306885+0000","last_unstale":"2024-01-22T05:39:46.750802+0000","last_undegraded":"2024-01-22T05:39:46.750802+0000","last_fullsized":"2024-01-22T05:39:46.750802+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779002+0000","last_change":"2024-01-22T05:39:46.767002+0000","last_active":"2024-01-22T05:39:46.779002+0000","last_peered":"2024-01-22T05:39:46.779002+0000","last_clean":"2024-01-22T05:39:46.779002+0000","last_became_active":"2024-01-22T05:39:46.766682+0000","last_became_peered":"2024-01-22T05:39:46.766682+0000","last_unstale":"2024-01-22T05:39:46.779002+0000","last_undegraded":"2024-01-22T05:39:46.779002+0000","last_fullsized":"2024-01-22T05:39:46.779002+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.757503+0000","last_change":"2024-01-22T05:39:46.296734+0000","last_active":"2024-01-22T05:39:46.757503+0000","last_peered":"2024-01-22T05:39:46.757503+0000","last_clean":"2024-01-22T05:39:46.757503+0000","last_became_active":"2024-01-22T05:39:46.296423+0000","last_became_peered":"2024-01-22T05:39:46.296423+0000","last_unstale":"2024-01-22T05:39:46.757503+0000","last_undegraded":"2024-01-22T05:39:46.757503+0000","last_fullsized":"2024-01-22T05:39:46.757503+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763977+0000","last_change":"2024-01-22T05:39:46.758220+0000","last_active":"2024-01-22T05:39:46.763977+0000","last_peered":"2024-01-22T05:39:46.763977+0000","last_clean":"2024-01-22T05:39:46.763977+0000","last_became_active":"2024-01-22T05:39:46.756667+0000","last_became_peered":"2024-01-22T05:39:46.756667+0000","last_unstale":"2024-01-22T05:39:46.763977+0000","last_undegraded":"2024-01-22T05:39:46.763977+0000","last_fullsized":"2024-01-22T05:39:46.763977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.745951+0000","last_change":"2024-01-22T05:39:46.304938+0000","last_active":"2024-01-22T05:39:46.745951+0000","last_peered":"2024-01-22T05:39:46.745951+0000","last_clean":"2024-01-22T05:39:46.745951+0000","last_became_active":"2024-01-22T05:39:46.304555+0000","last_became_peered":"2024-01-22T05:39:46.304555+0000","last_unstale":"2024-01-22T05:39:46.745951+0000","last_undegraded":"2024-01-22T05:39:46.745951+0000","last_fullsized":"2024-01-22T05:39:46.745951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.770208+0000","last_change":"2024-01-22T05:39:46.764469+0000","last_active":"2024-01-22T05:39:46.770208+0000","last_peered":"2024-01-22T05:39:46.770208+0000","last_clean":"2024-01-22T05:39:46.770208+0000","last_became_active":"2024-01-22T05:39:46.762694+0000","last_became_peered":"2024-01-22T05:39:46.762694+0000","last_unstale":"2024-01-22T05:39:46.770208+0000","last_undegraded":"2024-01-22T05:39:46.770208+0000","last_fullsized":"2024-01-22T05:39:46.770208+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.748242+0000","last_change":"2024-01-22T05:39:46.312199+0000","last_active":"2024-01-22T05:39:46.748242+0000","last_peered":"2024-01-22T05:39:46.748242+0000","last_clean":"2024-01-22T05:39:46.748242+0000","last_became_active":"2024-01-22T05:39:46.311336+0000","last_became_peered":"2024-01-22T05:39:46.311336+0000","last_unstale":"2024-01-22T05:39:46.748242+0000","last_undegraded":"2024-01-22T05:39:46.748242+0000","last_fullsized":"2024-01-22T05:39:46.748242+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.781805+0000","last_change":"2024-01-22T05:39:46.776221+0000","last_active":"2024-01-22T05:39:46.781805+0000","last_peered":"2024-01-22T05:39:46.781805+0000","last_clean":"2024-01-22T05:39:46.781805+0000","last_became_active":"2024-01-22T05:39:46.775645+0000","last_became_peered":"2024-01-22T05:39:46.775645+0000","last_unstale":"2024-01-22T05:39:46.781805+0000","last_undegraded":"2024-01-22T05:39:46.781805+0000","last_fullsized":"2024-01-22T05:39:46.781805+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.774199+0000","last_change":"2024-01-22T05:39:46.292886+0000","last_active":"2024-01-22T05:39:46.774199+0000","last_peered":"2024-01-22T05:39:46.774199+0000","last_clean":"2024-01-22T05:39:46.774199+0000","last_became_active":"2024-01-22T05:39:46.292155+0000","last_became_peered":"2024-01-22T05:39:46.292155+0000","last_unstale":"2024-01-22T05:39:46.774199+0000","last_undegraded":"2024-01-22T05:39:46.774199+0000","last_fullsized":"2024-01-22T05:39:46.774199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779645+0000","last_change":"2024-01-22T05:39:46.771196+0000","last_active":"2024-01-22T05:39:46.779645+0000","last_peered":"2024-01-22T05:39:46.779645+0000","last_clean":"2024-01-22T05:39:46.779645+0000","last_became_active":"2024-01-22T05:39:46.770878+0000","last_became_peered":"2024-01-22T05:39:46.770878+0000","last_unstale":"2024-01-22T05:39:46.779645+0000","last_undegraded":"2024-01-22T05:39:46.779645+0000","last_fullsized":"2024-01-22T05:39:46.779645+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.786246+0000","last_change":"2024-01-22T05:39:46.300588+0000","last_active":"2024-01-22T05:39:46.786246+0000","last_peered":"2024-01-22T05:39:46.786246+0000","last_clean":"2024-01-22T05:39:46.786246+0000","last_became_active":"2024-01-22T05:39:46.300269+0000","last_became_peered":"2024-01-22T05:39:46.300269+0000","last_unstale":"2024-01-22T05:39:46.786246+0000","last_undegraded":"2024-01-22T05:39:46.786246+0000","last_fullsized":"2024-01-22T05:39:46.786246+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.783793+0000","last_change":"2024-01-22T05:39:46.780446+0000","last_active":"2024-01-22T05:39:46.783793+0000","last_peered":"2024-01-22T05:39:46.783793+0000","last_clean":"2024-01-22T05:39:46.783793+0000","last_became_active":"2024-01-22T05:39:46.780118+0000","last_became_peered":"2024-01-22T05:39:46.780118+0000","last_unstale":"2024-01-22T05:39:46.783793+0000","last_undegraded":"2024-01-22T05:39:46.783793+0000","last_fullsized":"2024-01-22T05:39:46.783793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.782999+0000","last_change":"2024-01-22T05:39:46.306615+0000","last_active":"2024-01-22T05:39:46.782999+0000","last_peered":"2024-01-22T05:39:46.782999+0000","last_clean":"2024-01-22T05:39:46.782999+0000","last_became_active":"2024-01-22T05:39:46.306272+0000","last_became_peered":"2024-01-22T05:39:46.306272+0000","last_unstale":"2024-01-22T05:39:46.782999+0000","last_undegraded":"2024-01-22T05:39:46.782999+0000","last_fullsized":"2024-01-22T05:39:46.782999+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.782449+0000","last_change":"2024-01-22T05:39:46.773251+0000","last_active":"2024-01-22T05:39:46.782449+0000","last_peered":"2024-01-22T05:39:46.782449+0000","last_clean":"2024-01-22T05:39:46.782449+0000","last_became_active":"2024-01-22T05:39:46.772881+0000","last_became_peered":"2024-01-22T05:39:46.772881+0000","last_unstale":"2024-01-22T05:39:46.782449+0000","last_undegraded":"2024-01-22T05:39:46.782449+0000","last_fullsized":"2024-01-22T05:39:46.782449+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.756522+0000","last_change":"2024-01-22T05:39:46.310683+0000","last_active":"2024-01-22T05:39:46.756522+0000","last_peered":"2024-01-22T05:39:46.756522+0000","last_clean":"2024-01-22T05:39:46.756522+0000","last_became_active":"2024-01-22T05:39:46.308976+0000","last_became_peered":"2024-01-22T05:39:46.308976+0000","last_unstale":"2024-01-22T05:39:46.756522+0000","last_undegraded":"2024-01-22T05:39:46.756522+0000","last_fullsized":"2024-01-22T05:39:46.756522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.778499+0000","last_change":"2024-01-22T05:39:46.766375+0000","last_active":"2024-01-22T05:39:46.778499+0000","last_peered":"2024-01-22T05:39:46.778499+0000","last_clean":"2024-01-22T05:39:46.778499+0000","last_became_active":"2024-01-22T05:39:46.766101+0000","last_became_peered":"2024-01-22T05:39:46.766101+0000","last_unstale":"2024-01-22T05:39:46.778499+0000","last_undegraded":"2024-01-22T05:39:46.778499+0000","last_fullsized":"2024-01-22T05:39:46.778499+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.748806+0000","last_change":"2024-01-22T05:39:46.300400+0000","last_active":"2024-01-22T05:39:46.748806+0000","last_peered":"2024-01-22T05:39:46.748806+0000","last_clean":"2024-01-22T05:39:46.748806+0000","last_became_active":"2024-01-22T05:39:46.300184+0000","last_became_peered":"2024-01-22T05:39:46.300184+0000","last_unstale":"2024-01-22T05:39:46.748806+0000","last_undegraded":"2024-01-22T05:39:46.748806+0000","last_fullsized":"2024-01-22T05:39:46.748806+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.763322+0000","last_change":"2024-01-22T05:39:46.759089+0000","last_active":"2024-01-22T05:39:46.763322+0000","last_peered":"2024-01-22T05:39:46.763322+0000","last_clean":"2024-01-22T05:39:46.763322+0000","last_became_active":"2024-01-22T05:39:46.758756+0000","last_became_peered":"2024-01-22T05:39:46.758756+0000","last_unstale":"2024-01-22T05:39:46.763322+0000","last_undegraded":"2024-01-22T05:39:46.763322+0000","last_fullsized":"2024-01-22T05:39:46.763322+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751313+0000","last_change":"2024-01-22T05:39:46.313771+0000","last_active":"2024-01-22T05:39:46.751313+0000","last_peered":"2024-01-22T05:39:46.751313+0000","last_clean":"2024-01-22T05:39:46.751313+0000","last_became_active":"2024-01-22T05:39:46.313433+0000","last_became_peered":"2024-01-22T05:39:46.313433+0000","last_unstale":"2024-01-22T05:39:46.751313+0000","last_undegraded":"2024-01-22T05:39:46.751313+0000","last_fullsized":"2024-01-22T05:39:46.751313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773290+0000","last_change":"2024-01-22T05:39:46.759594+0000","last_active":"2024-01-22T05:39:46.773290+0000","last_peered":"2024-01-22T05:39:46.773290+0000","last_clean":"2024-01-22T05:39:46.773290+0000","last_became_active":"2024-01-22T05:39:46.759350+0000","last_became_peered":"2024-01-22T05:39:46.759350+0000","last_unstale":"2024-01-22T05:39:46.773290+0000","last_undegraded":"2024-01-22T05:39:46.773290+0000","last_fullsized":"2024-01-22T05:39:46.773290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.750711+0000","last_change":"2024-01-22T05:39:46.303386+0000","last_active":"2024-01-22T05:39:46.750711+0000","last_peered":"2024-01-22T05:39:46.750711+0000","last_clean":"2024-01-22T05:39:46.750711+0000","last_became_active":"2024-01-22T05:39:46.303092+0000","last_became_peered":"2024-01-22T05:39:46.303092+0000","last_unstale":"2024-01-22T05:39:46.750711+0000","last_undegraded":"2024-01-22T05:39:46.750711+0000","last_fullsized":"2024-01-22T05:39:46.750711+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.780880+0000","last_change":"2024-01-22T05:39:46.772094+0000","last_active":"2024-01-22T05:39:46.780880+0000","last_peered":"2024-01-22T05:39:46.780880+0000","last_clean":"2024-01-22T05:39:46.780880+0000","last_became_active":"2024-01-22T05:39:46.771741+0000","last_became_peered":"2024-01-22T05:39:46.771741+0000","last_unstale":"2024-01-22T05:39:46.780880+0000","last_undegraded":"2024-01-22T05:39:46.780880+0000","last_fullsized":"2024-01-22T05:39:46.780880+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.754761+0000","last_change":"2024-01-22T05:39:46.303223+0000","last_active":"2024-01-22T05:39:46.754761+0000","last_peered":"2024-01-22T05:39:46.754761+0000","last_clean":"2024-01-22T05:39:46.754761+0000","last_became_active":"2024-01-22T05:39:46.302927+0000","last_became_peered":"2024-01-22T05:39:46.302927+0000","last_unstale":"2024-01-22T05:39:46.754761+0000","last_undegraded":"2024-01-22T05:39:46.754761+0000","last_fullsized":"2024-01-22T05:39:46.754761+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.775535+0000","last_change":"2024-01-22T05:39:46.770979+0000","last_active":"2024-01-22T05:39:46.775535+0000","last_peered":"2024-01-22T05:39:46.775535+0000","last_clean":"2024-01-22T05:39:46.775535+0000","last_became_active":"2024-01-22T05:39:46.770559+0000","last_became_peered":"2024-01-22T05:39:46.770559+0000","last_unstale":"2024-01-22T05:39:46.775535+0000","last_undegraded":"2024-01-22T05:39:46.775535+0000","last_fullsized":"2024-01-22T05:39:46.775535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751604+0000","last_change":"2024-01-22T05:39:46.293322+0000","last_active":"2024-01-22T05:39:46.751604+0000","last_peered":"2024-01-22T05:39:46.751604+0000","last_clean":"2024-01-22T05:39:46.751604+0000","last_became_active":"2024-01-22T05:39:46.292922+0000","last_became_peered":"2024-01-22T05:39:46.292922+0000","last_unstale":"2024-01-22T05:39:46.751604+0000","last_undegraded":"2024-01-22T05:39:46.751604+0000","last_fullsized":"2024-01-22T05:39:46.751604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.777593+0000","last_change":"2024-01-22T05:39:46.772389+0000","last_active":"2024-01-22T05:39:46.777593+0000","last_peered":"2024-01-22T05:39:46.777593+0000","last_clean":"2024-01-22T05:39:46.777593+0000","last_became_active":"2024-01-22T05:39:46.771933+0000","last_became_peered":"2024-01-22T05:39:46.771933+0000","last_unstale":"2024-01-22T05:39:46.777593+0000","last_undegraded":"2024-01-22T05:39:46.777593+0000","last_fullsized":"2024-01-22T05:39:46.777593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751649+0000","last_change":"2024-01-22T05:39:46.291862+0000","last_active":"2024-01-22T05:39:46.751649+0000","last_peered":"2024-01-22T05:39:46.751649+0000","last_clean":"2024-01-22T05:39:46.751649+0000","last_became_active":"2024-01-22T05:39:46.291479+0000","last_became_peered":"2024-01-22T05:39:46.291479+0000","last_unstale":"2024-01-22T05:39:46.751649+0000","last_undegraded":"2024-01-22T05:39:46.751649+0000","last_fullsized":"2024-01-22T05:39:46.751649+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.781002+0000","last_change":"2024-01-22T05:39:46.774756+0000","last_active":"2024-01-22T05:39:46.781002+0000","last_peered":"2024-01-22T05:39:46.781002+0000","last_clean":"2024-01-22T05:39:46.781002+0000","last_became_active":"2024-01-22T05:39:46.774474+0000","last_became_peered":"2024-01-22T05:39:46.774474+0000","last_unstale":"2024-01-22T05:39:46.781002+0000","last_undegraded":"2024-01-22T05:39:46.781002+0000","last_fullsized":"2024-01-22T05:39:46.781002+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779671+0000","last_change":"2024-01-22T05:39:46.307510+0000","last_active":"2024-01-22T05:39:46.779671+0000","last_peered":"2024-01-22T05:39:46.779671+0000","last_clean":"2024-01-22T05:39:46.779671+0000","last_became_active":"2024-01-22T05:39:46.306386+0000","last_became_peered":"2024-01-22T05:39:46.306386+0000","last_unstale":"2024-01-22T05:39:46.779671+0000","last_undegraded":"2024-01-22T05:39:46.779671+0000","last_fullsized":"2024-01-22T05:39:46.779671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.768767+0000","last_change":"2024-01-22T05:39:46.764170+0000","last_active":"2024-01-22T05:39:46.768767+0000","last_peered":"2024-01-22T05:39:46.768767+0000","last_clean":"2024-01-22T05:39:46.768767+0000","last_became_active":"2024-01-22T05:39:46.763910+0000","last_became_peered":"2024-01-22T05:39:46.763910+0000","last_unstale":"2024-01-22T05:39:46.768767+0000","last_undegraded":"2024-01-22T05:39:46.768767+0000","last_fullsized":"2024-01-22T05:39:46.768767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779807+0000","last_change":"2024-01-22T05:39:46.311146+0000","last_active":"2024-01-22T05:39:46.779807+0000","last_peered":"2024-01-22T05:39:46.779807+0000","last_clean":"2024-01-22T05:39:46.779807+0000","last_became_active":"2024-01-22T05:39:46.310876+0000","last_became_peered":"2024-01-22T05:39:46.310876+0000","last_unstale":"2024-01-22T05:39:46.779807+0000","last_undegraded":"2024-01-22T05:39:46.779807+0000","last_fullsized":"2024-01-22T05:39:46.779807+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.772827+0000","last_change":"2024-01-22T05:39:46.768068+0000","last_active":"2024-01-22T05:39:46.772827+0000","last_peered":"2024-01-22T05:39:46.772827+0000","last_clean":"2024-01-22T05:39:46.772827+0000","last_became_active":"2024-01-22T05:39:46.767717+0000","last_became_peered":"2024-01-22T05:39:46.767717+0000","last_unstale":"2024-01-22T05:39:46.772827+0000","last_undegraded":"2024-01-22T05:39:46.772827+0000","last_fullsized":"2024-01-22T05:39:46.772827+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779082+0000","last_change":"2024-01-22T05:39:46.305531+0000","last_active":"2024-01-22T05:39:46.779082+0000","last_peered":"2024-01-22T05:39:46.779082+0000","last_clean":"2024-01-22T05:39:46.779082+0000","last_became_active":"2024-01-22T05:39:46.305158+0000","last_became_peered":"2024-01-22T05:39:46.305158+0000","last_unstale":"2024-01-22T05:39:46.779082+0000","last_undegraded":"2024-01-22T05:39:46.779082+0000","last_fullsized":"2024-01-22T05:39:46.779082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.772920+0000","last_change":"2024-01-22T05:39:46.759497+0000","last_active":"2024-01-22T05:39:46.772920+0000","last_peered":"2024-01-22T05:39:46.772920+0000","last_clean":"2024-01-22T05:39:46.772920+0000","last_became_active":"2024-01-22T05:39:46.759171+0000","last_became_peered":"2024-01-22T05:39:46.759171+0000","last_unstale":"2024-01-22T05:39:46.772920+0000","last_undegraded":"2024-01-22T05:39:46.772920+0000","last_fullsized":"2024-01-22T05:39:46.772920+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.757377+0000","last_change":"2024-01-22T05:39:46.301184+0000","last_active":"2024-01-22T05:39:46.757377+0000","last_peered":"2024-01-22T05:39:46.757377+0000","last_clean":"2024-01-22T05:39:46.757377+0000","last_became_active":"2024-01-22T05:39:46.300914+0000","last_became_peered":"2024-01-22T05:39:46.300914+0000","last_unstale":"2024-01-22T05:39:46.757377+0000","last_undegraded":"2024-01-22T05:39:46.757377+0000","last_fullsized":"2024-01-22T05:39:46.757377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.781667+0000","last_change":"2024-01-22T05:39:46.776385+0000","last_active":"2024-01-22T05:39:46.781667+0000","last_peered":"2024-01-22T05:39:46.781667+0000","last_clean":"2024-01-22T05:39:46.781667+0000","last_became_active":"2024-01-22T05:39:46.774606+0000","last_became_peered":"2024-01-22T05:39:46.774606+0000","last_unstale":"2024-01-22T05:39:46.781667+0000","last_undegraded":"2024-01-22T05:39:46.781667+0000","last_fullsized":"2024-01-22T05:39:46.781667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.758808+0000","last_change":"2024-01-22T05:39:46.301863+0000","last_active":"2024-01-22T05:39:46.758808+0000","last_peered":"2024-01-22T05:39:46.758808+0000","last_clean":"2024-01-22T05:39:46.758808+0000","last_became_active":"2024-01-22T05:39:46.301583+0000","last_became_peered":"2024-01-22T05:39:46.301583+0000","last_unstale":"2024-01-22T05:39:46.758808+0000","last_undegraded":"2024-01-22T05:39:46.758808+0000","last_fullsized":"2024-01-22T05:39:46.758808+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.770439+0000","last_change":"2024-01-22T05:39:46.767452+0000","last_active":"2024-01-22T05:39:46.770439+0000","last_peered":"2024-01-22T05:39:46.770439+0000","last_clean":"2024-01-22T05:39:46.770439+0000","last_became_active":"2024-01-22T05:39:46.767168+0000","last_became_peered":"2024-01-22T05:39:46.767168+0000","last_unstale":"2024-01-22T05:39:46.770439+0000","last_undegraded":"2024-01-22T05:39:46.770439+0000","last_fullsized":"2024-01-22T05:39:46.770439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.780727+0000","last_change":"2024-01-22T05:39:46.305476+0000","last_active":"2024-01-22T05:39:46.780727+0000","last_peered":"2024-01-22T05:39:46.780727+0000","last_clean":"2024-01-22T05:39:46.780727+0000","last_became_active":"2024-01-22T05:39:46.301500+0000","last_became_peered":"2024-01-22T05:39:46.301500+0000","last_unstale":"2024-01-22T05:39:46.780727+0000","last_undegraded":"2024-01-22T05:39:46.780727+0000","last_fullsized":"2024-01-22T05:39:46.780727+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.776827+0000","last_change":"2024-01-22T05:39:46.767852+0000","last_active":"2024-01-22T05:39:46.776827+0000","last_peered":"2024-01-22T05:39:46.776827+0000","last_clean":"2024-01-22T05:39:46.776827+0000","last_became_active":"2024-01-22T05:39:46.767580+0000","last_became_peered":"2024-01-22T05:39:46.767580+0000","last_unstale":"2024-01-22T05:39:46.776827+0000","last_undegraded":"2024-01-22T05:39:46.776827+0000","last_fullsized":"2024-01-22T05:39:46.776827+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.784217+0000","last_change":"2024-01-22T05:39:46.315304+0000","last_active":"2024-01-22T05:39:46.784217+0000","last_peered":"2024-01-22T05:39:46.784217+0000","last_clean":"2024-01-22T05:39:46.784217+0000","last_became_active":"2024-01-22T05:39:46.314887+0000","last_became_peered":"2024-01-22T05:39:46.314887+0000","last_unstale":"2024-01-22T05:39:46.784217+0000","last_undegraded":"2024-01-22T05:39:46.784217+0000","last_fullsized":"2024-01-22T05:39:46.784217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.776645+0000","last_change":"2024-01-22T05:39:46.761576+0000","last_active":"2024-01-22T05:39:46.776645+0000","last_peered":"2024-01-22T05:39:46.776645+0000","last_clean":"2024-01-22T05:39:46.776645+0000","last_became_active":"2024-01-22T05:39:46.760260+0000","last_became_peered":"2024-01-22T05:39:46.760260+0000","last_unstale":"2024-01-22T05:39:46.776645+0000","last_undegraded":"2024-01-22T05:39:46.776645+0000","last_fullsized":"2024-01-22T05:39:46.776645+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.750953+0000","last_change":"2024-01-22T05:39:46.313991+0000","last_active":"2024-01-22T05:39:46.750953+0000","last_peered":"2024-01-22T05:39:46.750953+0000","last_clean":"2024-01-22T05:39:46.750953+0000","last_became_active":"2024-01-22T05:39:46.313492+0000","last_became_peered":"2024-01-22T05:39:46.313492+0000","last_unstale":"2024-01-22T05:39:46.750953+0000","last_undegraded":"2024-01-22T05:39:46.750953+0000","last_fullsized":"2024-01-22T05:39:46.750953+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.781011+0000","last_change":"2024-01-22T05:39:46.769843+0000","last_active":"2024-01-22T05:39:46.781011+0000","last_peered":"2024-01-22T05:39:46.781011+0000","last_clean":"2024-01-22T05:39:46.781011+0000","last_became_active":"2024-01-22T05:39:46.769483+0000","last_became_peered":"2024-01-22T05:39:46.769483+0000","last_unstale":"2024-01-22T05:39:46.781011+0000","last_undegraded":"2024-01-22T05:39:46.781011+0000","last_fullsized":"2024-01-22T05:39:46.781011+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.750977+0000","last_change":"2024-01-22T05:39:46.308662+0000","last_active":"2024-01-22T05:39:46.750977+0000","last_peered":"2024-01-22T05:39:46.750977+0000","last_clean":"2024-01-22T05:39:46.750977+0000","last_became_active":"2024-01-22T05:39:46.308334+0000","last_became_peered":"2024-01-22T05:39:46.308334+0000","last_unstale":"2024-01-22T05:39:46.750977+0000","last_undegraded":"2024-01-22T05:39:46.750977+0000","last_fullsized":"2024-01-22T05:39:46.750977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779309+0000","last_change":"2024-01-22T05:39:46.770944+0000","last_active":"2024-01-22T05:39:46.779309+0000","last_peered":"2024-01-22T05:39:46.779309+0000","last_clean":"2024-01-22T05:39:46.779309+0000","last_became_active":"2024-01-22T05:39:46.768618+0000","last_became_peered":"2024-01-22T05:39:46.768618+0000","last_unstale":"2024-01-22T05:39:46.779309+0000","last_undegraded":"2024-01-22T05:39:46.779309+0000","last_fullsized":"2024-01-22T05:39:46.779309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751229+0000","last_change":"2024-01-22T05:39:46.308223+0000","last_active":"2024-01-22T05:39:46.751229+0000","last_peered":"2024-01-22T05:39:46.751229+0000","last_clean":"2024-01-22T05:39:46.751229+0000","last_became_active":"2024-01-22T05:39:46.307047+0000","last_became_peered":"2024-01-22T05:39:46.307047+0000","last_unstale":"2024-01-22T05:39:46.751229+0000","last_undegraded":"2024-01-22T05:39:46.751229+0000","last_fullsized":"2024-01-22T05:39:46.751229+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.777730+0000","last_change":"2024-01-22T05:39:46.765521+0000","last_active":"2024-01-22T05:39:46.777730+0000","last_peered":"2024-01-22T05:39:46.777730+0000","last_clean":"2024-01-22T05:39:46.777730+0000","last_became_active":"2024-01-22T05:39:46.760686+0000","last_became_peered":"2024-01-22T05:39:46.760686+0000","last_unstale":"2024-01-22T05:39:46.777730+0000","last_undegraded":"2024-01-22T05:39:46.777730+0000","last_fullsized":"2024-01-22T05:39:46.777730+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.753463+0000","last_change":"2024-01-22T05:39:46.313998+0000","last_active":"2024-01-22T05:39:46.753463+0000","last_peered":"2024-01-22T05:39:46.753463+0000","last_clean":"2024-01-22T05:39:46.753463+0000","last_became_active":"2024-01-22T05:39:46.313738+0000","last_became_peered":"2024-01-22T05:39:46.313738+0000","last_unstale":"2024-01-22T05:39:46.753463+0000","last_undegraded":"2024-01-22T05:39:46.753463+0000","last_fullsized":"2024-01-22T05:39:46.753463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.765988+0000","last_change":"2024-01-22T05:39:46.762178+0000","last_active":"2024-01-22T05:39:46.765988+0000","last_peered":"2024-01-22T05:39:46.765988+0000","last_clean":"2024-01-22T05:39:46.765988+0000","last_became_active":"2024-01-22T05:39:46.761950+0000","last_became_peered":"2024-01-22T05:39:46.761950+0000","last_unstale":"2024-01-22T05:39:46.765988+0000","last_undegraded":"2024-01-22T05:39:46.765988+0000","last_fullsized":"2024-01-22T05:39:46.765988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.748178+0000","last_change":"2024-01-22T05:39:46.311701+0000","last_active":"2024-01-22T05:39:46.748178+0000","last_peered":"2024-01-22T05:39:46.748178+0000","last_clean":"2024-01-22T05:39:46.748178+0000","last_became_active":"2024-01-22T05:39:46.311408+0000","last_became_peered":"2024-01-22T05:39:46.311408+0000","last_unstale":"2024-01-22T05:39:46.748178+0000","last_undegraded":"2024-01-22T05:39:46.748178+0000","last_fullsized":"2024-01-22T05:39:46.748178+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.778478+0000","last_change":"2024-01-22T05:39:46.767216+0000","last_active":"2024-01-22T05:39:46.778478+0000","last_peered":"2024-01-22T05:39:46.778478+0000","last_clean":"2024-01-22T05:39:46.778478+0000","last_became_active":"2024-01-22T05:39:46.766912+0000","last_became_peered":"2024-01-22T05:39:46.766912+0000","last_unstale":"2024-01-22T05:39:46.778478+0000","last_undegraded":"2024-01-22T05:39:46.778478+0000","last_fullsized":"2024-01-22T05:39:46.778478+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.750252+0000","last_change":"2024-01-22T05:39:46.299690+0000","last_active":"2024-01-22T05:39:46.750252+0000","last_peered":"2024-01-22T05:39:46.750252+0000","last_clean":"2024-01-22T05:39:46.750252+0000","last_became_active":"2024-01-22T05:39:46.299349+0000","last_became_peered":"2024-01-22T05:39:46.299349+0000","last_unstale":"2024-01-22T05:39:46.750252+0000","last_undegraded":"2024-01-22T05:39:46.750252+0000","last_fullsized":"2024-01-22T05:39:46.750252+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.770180+0000","last_change":"2024-01-22T05:39:46.762746+0000","last_active":"2024-01-22T05:39:46.770180+0000","last_peered":"2024-01-22T05:39:46.770180+0000","last_clean":"2024-01-22T05:39:46.770180+0000","last_became_active":"2024-01-22T05:39:46.762199+0000","last_became_peered":"2024-01-22T05:39:46.762199+0000","last_unstale":"2024-01-22T05:39:46.770180+0000","last_undegraded":"2024-01-22T05:39:46.770180+0000","last_fullsized":"2024-01-22T05:39:46.770180+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.752110+0000","last_change":"2024-01-22T05:39:46.307886+0000","last_active":"2024-01-22T05:39:46.752110+0000","last_peered":"2024-01-22T05:39:46.752110+0000","last_clean":"2024-01-22T05:39:46.752110+0000","last_became_active":"2024-01-22T05:39:46.307591+0000","last_became_peered":"2024-01-22T05:39:46.307591+0000","last_unstale":"2024-01-22T05:39:46.752110+0000","last_undegraded":"2024-01-22T05:39:46.752110+0000","last_fullsized":"2024-01-22T05:39:46.752110+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.787638+0000","last_change":"2024-01-22T05:39:46.781859+0000","last_active":"2024-01-22T05:39:46.787638+0000","last_peered":"2024-01-22T05:39:46.787638+0000","last_clean":"2024-01-22T05:39:46.787638+0000","last_became_active":"2024-01-22T05:39:46.781299+0000","last_became_peered":"2024-01-22T05:39:46.781299+0000","last_unstale":"2024-01-22T05:39:46.787638+0000","last_undegraded":"2024-01-22T05:39:46.787638+0000","last_fullsized":"2024-01-22T05:39:46.787638+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751377+0000","last_change":"2024-01-22T05:39:46.302633+0000","last_active":"2024-01-22T05:39:46.751377+0000","last_peered":"2024-01-22T05:39:46.751377+0000","last_clean":"2024-01-22T05:39:46.751377+0000","last_became_active":"2024-01-22T05:39:46.302244+0000","last_became_peered":"2024-01-22T05:39:46.302244+0000","last_unstale":"2024-01-22T05:39:46.751377+0000","last_undegraded":"2024-01-22T05:39:46.751377+0000","last_fullsized":"2024-01-22T05:39:46.751377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.756222+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:46.756222+0000","last_peered":"2024-01-22T05:39:46.756222+0000","last_clean":"2024-01-22T05:39:46.756222+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:46.756222+0000","last_undegraded":"2024-01-22T05:39:46.756222+0000","last_fullsized":"2024-01-22T05:39:46.756222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.787003+0000","last_change":"2024-01-22T05:39:46.782706+0000","last_active":"2024-01-22T05:39:46.787003+0000","last_peered":"2024-01-22T05:39:46.787003+0000","last_clean":"2024-01-22T05:39:46.787003+0000","last_became_active":"2024-01-22T05:39:46.782497+0000","last_became_peered":"2024-01-22T05:39:46.782497+0000","last_unstale":"2024-01-22T05:39:46.787003+0000","last_undegraded":"2024-01-22T05:39:46.787003+0000","last_fullsized":"2024-01-22T05:39:46.787003+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.754579+0000","last_change":"2024-01-22T05:39:46.315989+0000","last_active":"2024-01-22T05:39:46.754579+0000","last_peered":"2024-01-22T05:39:46.754579+0000","last_clean":"2024-01-22T05:39:46.754579+0000","last_became_active":"2024-01-22T05:39:46.315176+0000","last_became_peered":"2024-01-22T05:39:46.315176+0000","last_unstale":"2024-01-22T05:39:46.754579+0000","last_undegraded":"2024-01-22T05:39:46.754579+0000","last_fullsized":"2024-01-22T05:39:46.754579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.747088+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:39:46.747088+0000","last_peered":"2024-01-22T05:39:46.747088+0000","last_clean":"2024-01-22T05:39:46.747088+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:39:46.747088+0000","last_undegraded":"2024-01-22T05:39:46.747088+0000","last_fullsized":"2024-01-22T05:39:46.747088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.776676+0000","last_change":"2024-01-22T05:39:46.762870+0000","last_active":"2024-01-22T05:39:46.776676+0000","last_peered":"2024-01-22T05:39:46.776676+0000","last_clean":"2024-01-22T05:39:46.776676+0000","last_became_active":"2024-01-22T05:39:46.761960+0000","last_became_peered":"2024-01-22T05:39:46.761960+0000","last_unstale":"2024-01-22T05:39:46.776676+0000","last_undegraded":"2024-01-22T05:39:46.776676+0000","last_fullsized":"2024-01-22T05:39:46.776676+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.784081+0000","last_change":"2024-01-22T05:39:46.315679+0000","last_active":"2024-01-22T05:39:46.784081+0000","last_peered":"2024-01-22T05:39:46.784081+0000","last_clean":"2024-01-22T05:39:46.784081+0000","last_became_active":"2024-01-22T05:39:46.315361+0000","last_became_peered":"2024-01-22T05:39:46.315361+0000","last_unstale":"2024-01-22T05:39:46.784081+0000","last_undegraded":"2024-01-22T05:39:46.784081+0000","last_fullsized":"2024-01-22T05:39:46.784081+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.758380+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:46.758380+0000","last_peered":"2024-01-22T05:39:46.758380+0000","last_clean":"2024-01-22T05:39:46.758380+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:46.758380+0000","last_undegraded":"2024-01-22T05:39:46.758380+0000","last_fullsized":"2024-01-22T05:39:46.758380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773669+0000","last_change":"2024-01-22T05:39:46.761625+0000","last_active":"2024-01-22T05:39:46.773669+0000","last_peered":"2024-01-22T05:39:46.773669+0000","last_clean":"2024-01-22T05:39:46.773669+0000","last_became_active":"2024-01-22T05:39:46.760989+0000","last_became_peered":"2024-01-22T05:39:46.760989+0000","last_unstale":"2024-01-22T05:39:46.773669+0000","last_undegraded":"2024-01-22T05:39:46.773669+0000","last_fullsized":"2024-01-22T05:39:46.773669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.755904+0000","last_change":"2024-01-22T05:39:46.300513+0000","last_active":"2024-01-22T05:39:46.755904+0000","last_peered":"2024-01-22T05:39:46.755904+0000","last_clean":"2024-01-22T05:39:46.755904+0000","last_became_active":"2024-01-22T05:39:46.299999+0000","last_became_peered":"2024-01-22T05:39:46.299999+0000","last_unstale":"2024-01-22T05:39:46.755904+0000","last_undegraded":"2024-01-22T05:39:46.755904+0000","last_fullsized":"2024-01-22T05:39:46.755904+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.756645+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:46.756645+0000","last_peered":"2024-01-22T05:39:46.756645+0000","last_clean":"2024-01-22T05:39:46.756645+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:46.756645+0000","last_undegraded":"2024-01-22T05:39:46.756645+0000","last_fullsized":"2024-01-22T05:39:46.756645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.781132+0000","last_change":"2024-01-22T05:39:46.776689+0000","last_active":"2024-01-22T05:39:46.781132+0000","last_peered":"2024-01-22T05:39:46.781132+0000","last_clean":"2024-01-22T05:39:46.781132+0000","last_became_active":"2024-01-22T05:39:46.772234+0000","last_became_peered":"2024-01-22T05:39:46.772234+0000","last_unstale":"2024-01-22T05:39:46.781132+0000","last_undegraded":"2024-01-22T05:39:46.781132+0000","last_fullsized":"2024-01-22T05:39:46.781132+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.759887+0000","last_change":"2024-01-22T05:39:46.315050+0000","last_active":"2024-01-22T05:39:46.759887+0000","last_peered":"2024-01-22T05:39:46.759887+0000","last_clean":"2024-01-22T05:39:46.759887+0000","last_became_active":"2024-01-22T05:39:46.313961+0000","last_became_peered":"2024-01-22T05:39:46.313961+0000","last_unstale":"2024-01-22T05:39:46.759887+0000","last_undegraded":"2024-01-22T05:39:46.759887+0000","last_fullsized":"2024-01-22T05:39:46.759887+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751389+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:46.751389+0000","last_peered":"2024-01-22T05:39:46.751389+0000","last_clean":"2024-01-22T05:39:46.751389+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:46.751389+0000","last_undegraded":"2024-01-22T05:39:46.751389+0000","last_fullsized":"2024-01-22T05:39:46.751389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.756180+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:46.756180+0000","last_peered":"2024-01-22T05:39:46.756180+0000","last_clean":"2024-01-22T05:39:46.756180+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:46.756180+0000","last_undegraded":"2024-01-22T05:39:46.756180+0000","last_fullsized":"2024-01-22T05:39:46.756180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773709+0000","last_change":"2024-01-22T05:39:46.771373+0000","last_active":"2024-01-22T05:39:46.773709+0000","last_peered":"2024-01-22T05:39:46.773709+0000","last_clean":"2024-01-22T05:39:46.773709+0000","last_became_active":"2024-01-22T05:39:46.771100+0000","last_became_peered":"2024-01-22T05:39:46.771100+0000","last_unstale":"2024-01-22T05:39:46.773709+0000","last_undegraded":"2024-01-22T05:39:46.773709+0000","last_fullsized":"2024-01-22T05:39:46.773709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.779816+0000","last_change":"2024-01-22T05:39:46.303506+0000","last_active":"2024-01-22T05:39:46.779816+0000","last_peered":"2024-01-22T05:39:46.779816+0000","last_clean":"2024-01-22T05:39:46.779816+0000","last_became_active":"2024-01-22T05:39:46.303207+0000","last_became_peered":"2024-01-22T05:39:46.303207+0000","last_unstale":"2024-01-22T05:39:46.779816+0000","last_undegraded":"2024-01-22T05:39:46.779816+0000","last_fullsized":"2024-01-22T05:39:46.779816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.752416+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:46.752416+0000","last_peered":"2024-01-22T05:39:46.752416+0000","last_clean":"2024-01-22T05:39:46.752416+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:46.752416+0000","last_undegraded":"2024-01-22T05:39:46.752416+0000","last_fullsized":"2024-01-22T05:39:46.752416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.773702+0000","last_change":"2024-01-22T05:39:46.761644+0000","last_active":"2024-01-22T05:39:46.773702+0000","last_peered":"2024-01-22T05:39:46.773702+0000","last_clean":"2024-01-22T05:39:46.773702+0000","last_became_active":"2024-01-22T05:39:46.761201+0000","last_became_peered":"2024-01-22T05:39:46.761201+0000","last_unstale":"2024-01-22T05:39:46.773702+0000","last_undegraded":"2024-01-22T05:39:46.773702+0000","last_fullsized":"2024-01-22T05:39:46.773702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.751313+0000","last_change":"2024-01-22T05:39:46.303592+0000","last_active":"2024-01-22T05:39:46.751313+0000","last_peered":"2024-01-22T05:39:46.751313+0000","last_clean":"2024-01-22T05:39:46.751313+0000","last_became_active":"2024-01-22T05:39:46.302241+0000","last_became_peered":"2024-01-22T05:39:46.302241+0000","last_unstale":"2024-01-22T05:39:46.751313+0000","last_undegraded":"2024-01-22T05:39:46.751313+0000","last_fullsized":"2024-01-22T05:39:46.751313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.757456+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:46.757456+0000","last_peered":"2024-01-22T05:39:46.757456+0000","last_clean":"2024-01-22T05:39:46.757456+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:46.757456+0000","last_undegraded":"2024-01-22T05:39:46.757456+0000","last_fullsized":"2024-01-22T05:39:46.757456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.777569+0000","last_change":"2024-01-22T05:39:46.772198+0000","last_active":"2024-01-22T05:39:46.777569+0000","last_peered":"2024-01-22T05:39:46.777569+0000","last_clean":"2024-01-22T05:39:46.777569+0000","last_became_active":"2024-01-22T05:39:46.771600+0000","last_became_peered":"2024-01-22T05:39:46.771600+0000","last_unstale":"2024-01-22T05:39:46.777569+0000","last_undegraded":"2024-01-22T05:39:46.777569+0000","last_fullsized":"2024-01-22T05:39:46.777569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:46.271276+0000","last_clean_scrub_stamp":"2024-01-22T05:39:46.271276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.777234+0000","last_change":"2024-01-22T05:39:46.304374+0000","last_active":"2024-01-22T05:39:46.777234+0000","last_peered":"2024-01-22T05:39:46.777234+0000","last_clean":"2024-01-22T05:39:46.777234+0000","last_became_active":"2024-01-22T05:39:46.304087+0000","last_became_peered":"2024-01-22T05:39:46.304087+0000","last_unstale":"2024-01-22T05:39:46.777234+0000","last_undegraded":"2024-01-22T05:39:46.777234+0000","last_fullsized":"2024-01-22T05:39:46.777234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:39:45.264354+0000","last_clean_scrub_stamp":"2024-01-22T05:39:45.264354+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-22T05:39:46.754676+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:46.754676+0000","last_peered":"2024-01-22T05:39:46.754676+0000","last_clean":"2024-01-22T05:39:46.754676+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:46.754676+0000","last_undegraded":"2024-01-22T05:39:46.754676+0000","last_fullsized":"2024-01-22T05:39:46.754676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48699999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.624},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.69999999999999996}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.746},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71499999999999997}]},{"osd":6,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.68000000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.70099999999999996}]},{"osd":1,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.83099999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.748},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.79100000000000004}]},{"osd":4,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.56699999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.59499999999999997}]},{"osd":7,"last update":"Mon Jan 22 05:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.81899999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.38900000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54900000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.66900000000000004}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.68999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.89100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":272520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.38},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.81100000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.877},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.80400000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.64800000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.49199999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.432}]},{"osd":4,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.751}]},{"osd":6,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73699999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.5},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72499999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.60299999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78500000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.876},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.623}]},{"osd":6,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:39:56.598 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T05:39:56.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T05:39:56.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.823+0000 7fb48e200700 1 Processor -- start 2024-01-22T05:39:56.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.823+0000 7fb48e200700 1 -- start start 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.824+0000 7fb48e200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb4880a9f60 0x7fb4880aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.824+0000 7fb48e200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880c74b0 con 0x7fb48805e900 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.824+0000 7fb48e200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb488158660 con 0x7fb4880c1940 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.824+0000 7fb48e200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb488158940 con 0x7fb4880a9f60 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb487e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb48805e900 0x7fb488098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39572/0 (socket says 172.21.15.100:39572) 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb487e00700 1 -- 172.21.15.100:0/1226576092 learned_addr learned my addr 172.21.15.100:0/1226576092 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb487400700 1 --2- 172.21.15.100:0/1226576092 >> v2:172.21.15.169:3300/0 conn(0x7fb4880a9f60 0x7fb4880aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243993693 0 0) 0x7fb4880c74b0 con 0x7fb48805e900 2024-01-22T05:39:56.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4680033f0 con 0x7fb48805e900 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307654048 0 0) 0x7fb488158660 con 0x7fb4880c1940 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4880c74b0 con 0x7fb4880c1940 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460242941 0 0) 0x7fb4680033f0 con 0x7fb48805e900 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 >> v2:172.21.15.169:3300/0 conn(0x7fb4880a9f60 msgr2=0x7fb4880aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 --2- 172.21.15.100:0/1226576092 >> v2:172.21.15.169:3300/0 conn(0x7fb4880a9f60 0x7fb4880aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 >> v1:172.21.15.169:6789/0 conn(0x7fb4880c1940 legacy=0x7fb48805e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880c7140 con 0x7fb48805e900 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fb4800017f0 con 0x7fb48805e900 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 >> v1:172.21.15.100:6789/0 conn(0x7fb48805e900 legacy=0x7fb488098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb468003a70 0x7fb468003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.825+0000 7fb486000700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb468004690 0x7fb468004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486000700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468005000 0x7fb46800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb488158940 con 0x7fb468004690 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46800be80 con 0x7fb468003a70 2024-01-22T05:39:56.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46800c040 con 0x7fb468005000 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb487400700 1 --2- 172.21.15.100:0/1226576092 >> v2:172.21.15.169:3300/0 conn(0x7fb4880a9f60 0x7fb4880aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486a00700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb468004690 0x7fb468004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb487e00700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468005000 0x7fb46800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb487400700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb468003a70 0x7fb468003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486a00700 1 -- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468005000 msgr2=0x7fb46800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486a00700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468005000 0x7fb46800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486a00700 1 -- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb468003a70 msgr2=0x7fb468003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486a00700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb468003a70 0x7fb468003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486a00700 1 -- 172.21.15.100:0/1226576092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4680033f0 con 0x7fb468004690 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb487e00700 1 -- 172.21.15.100:0/1226576092 reap_dead start 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.826+0000 7fb486a00700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb468004690 0x7fb468004b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fb470001050 tx=0x7fb470007b90).ready entity=mon.0 client_cookie=deac76d19eab439a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470007ea0 con 0x7fb468004690 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470012400 con 0x7fb468004690 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb486000700 1 -- 172.21.15.100:0/1226576092 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470012780 con 0x7fb468004690 2024-01-22T05:39:56.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb48e200700 1 -- 172.21.15.100:0/1226576092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb468004690 msgr2=0x7fb468004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb48e200700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb468004690 0x7fb468004b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fb470001050 tx=0x7fb470007b90).stop 2024-01-22T05:39:56.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb48e200700 1 -- 172.21.15.100:0/1226576092 shutdown_connections 2024-01-22T05:39:56.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb48e200700 1 --2- 172.21.15.100:0/1226576092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb468004690 0x7fb468004b10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb48e200700 1 -- 172.21.15.100:0/1226576092 >> 172.21.15.100:0/1226576092 conn(0x7fb4880cada0 msgr2=0x7fb4880cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:56.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb48e200700 1 -- 172.21.15.100:0/1226576092 shutdown_connections 2024-01-22T05:39:56.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.827+0000 7fb48e200700 1 -- 172.21.15.100:0/1226576092 wait complete. 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.829+0000 7fb48e200700 1 Processor -- start 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.829+0000 7fb48e200700 1 -- start start 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb48e200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468004690 0x7fb4880a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb48e200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4880a8200 0x7fb4880c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb48e200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4880c4010 0x7fb488152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb48e200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881545e0 con 0x7fb4880a8200 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb48e200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880c4450 con 0x7fb4880c4010 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb48e200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880c46e0 con 0x7fb468004690 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4880a8200 0x7fb4880c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4880a8200 0x7fb4880c3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49884/0 (socket says 172.21.15.100:49884) 2024-01-22T05:39:56.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 -- 172.21.15.100:0/1987643771 learned_addr learned my addr 172.21.15.100:0/1987643771 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb487400700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468004690 0x7fb4880a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb487e00700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4880c4010 0x7fb488152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 -- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468004690 msgr2=0x7fb4880a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468004690 0x7fb4880a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 -- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4880c4010 msgr2=0x7fb488152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4880c4010 0x7fb488152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.831+0000 7fb486a00700 1 -- 172.21.15.100:0/1987643771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880c49c0 con 0x7fb4880a8200 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.832+0000 7fb486a00700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4880a8200 0x7fb4880c3b20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb470001e50 tx=0x7fb470017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.832+0000 7fb47ea00700 1 -- 172.21.15.100:0/1987643771 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470007ea0 con 0x7fb4880a8200 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.832+0000 7fb47ea00700 1 -- 172.21.15.100:0/1987643771 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700119d0 con 0x7fb4880a8200 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.832+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4881547f0 con 0x7fb4880a8200 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.832+0000 7fb47ea00700 1 -- 172.21.15.100:0/1987643771 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470011d70 con 0x7fb4880a8200 2024-01-22T05:39:56.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.832+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4880a8920 con 0x7fb4880a8200 2024-01-22T05:39:56.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.833+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb488154e40 con 0x7fb4880a8200 2024-01-22T05:39:56.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.834+0000 7fb47ea00700 1 -- 172.21.15.100:0/1987643771 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb470019070 con 0x7fb4880a8200 2024-01-22T05:39:56.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.835+0000 7fb47ea00700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb46005f150 0x7fb460061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:56.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.835+0000 7fb47ea00700 1 -- 172.21.15.100:0/1987643771 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb47007a7f0 con 0x7fb4880a8200 2024-01-22T05:39:56.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.835+0000 7fb487400700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb46005f150 0x7fb460061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:56.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.835+0000 7fb487400700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb46005f150 0x7fb460061610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb488061d20 tx=0x7fb478009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:56.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:56.838+0000 7fb47ea00700 1 -- 172.21.15.100:0/1987643771 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb47004ba50 con 0x7fb4880a8200 2024-01-22T05:39:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.077+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb4880c4b50 con 0x7fb4880a8200 2024-01-22T05:39:57.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.081+0000 7fb47ea00700 1 -- 172.21.15.100:0/1987643771 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb470021070 con 0x7fb4880a8200 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb46005f150 msgr2=0x7fb460061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb46005f150 0x7fb460061610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb488061d20 tx=0x7fb478009060).stop 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4880a8200 msgr2=0x7fb4880c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4880a8200 0x7fb4880c3b20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb470001e50 tx=0x7fb470017000).stop 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 shutdown_connections 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb46005f150 0x7fb460061610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4880c4010 0x7fb488152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb468004690 0x7fb4880a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 --2- 172.21.15.100:0/1987643771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4880a8200 0x7fb4880c3b20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 >> 172.21.15.100:0/1987643771 conn(0x7fb4880cada0 msgr2=0x7fb4880cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.083+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 shutdown_connections 2024-01-22T05:39:57.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.084+0000 7fb48e200700 1 -- 172.21.15.100:0/1987643771 wait complete. 2024-01-22T05:39:57.085 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:39:57.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:39:57.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:39:57.279 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:39:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.285+0000 7f939ea00700 1 Processor -- start 2024-01-22T05:39:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.285+0000 7f939ea00700 1 -- start start 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ea00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f939814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ea00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f93980a7d90 0x7f93980a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ea00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f93980c3e20 0x7f93980c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ea00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980c47a0 con 0x7f93980c3e20 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ea00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980c5480 con 0x7f93980a7d90 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ea00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c5720 con 0x7f939814f880 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ca00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f93980c3e20 0x7f93980c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f9397e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f939814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ca00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f93980c3e20 0x7f93980c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49896/0 (socket says 172.21.15.100:49896) 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f939ca00700 1 -- 172.21.15.100:0/838363113 learned_addr learned my addr 172.21.15.100:0/838363113 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.286+0000 7f9397400700 1 --2- 172.21.15.100:0/838363113 >> v2:172.21.15.169:3300/0 conn(0x7f93980a7d90 0x7f93980a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f939ca00700 1 -- 172.21.15.100:0/838363113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 msgr2=0x7f939814fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f939ca00700 1 --2- 172.21.15.100:0/838363113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f939814fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f939ca00700 1 -- 172.21.15.100:0/838363113 >> v2:172.21.15.169:3300/0 conn(0x7f93980a7d90 msgr2=0x7f93980a81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f939ca00700 1 --2- 172.21.15.100:0/838363113 >> v2:172.21.15.169:3300/0 conn(0x7f93980a7d90 0x7f93980a81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f939ca00700 1 -- 172.21.15.100:0/838363113 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980c5a00 con 0x7f93980c3e20 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f939ca00700 1 --2- 172.21.15.100:0/838363113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980c3e20 0x7f93980c42b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f93980696a0 tx=0x7f9390009840).ready entity=mon.0 client_cookie=a4b94b9bef436540 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f9396a00700 1 -- 172.21.15.100:0/838363113 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000e070 con 0x7f93980c3e20 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f9396a00700 1 -- 172.21.15.100:0/838363113 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000b970 con 0x7f93980c3e20 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.287+0000 7f9396a00700 1 -- 172.21.15.100:0/838363113 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000bcf0 con 0x7f93980c3e20 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 -- 172.21.15.100:0/838363113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980c3e20 msgr2=0x7f93980c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 --2- 172.21.15.100:0/838363113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980c3e20 0x7f93980c42b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f93980696a0 tx=0x7f9390009840).stop 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 -- 172.21.15.100:0/838363113 shutdown_connections 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 --2- 172.21.15.100:0/838363113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980c3e20 0x7f93980c42b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 --2- 172.21.15.100:0/838363113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f939814fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 --2- 172.21.15.100:0/838363113 >> v2:172.21.15.169:3300/0 conn(0x7f93980a7d90 0x7f93980a81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 -- 172.21.15.100:0/838363113 >> 172.21.15.100:0/838363113 conn(0x7f9398091a00 msgr2=0x7f9398091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 -- 172.21.15.100:0/838363113 shutdown_connections 2024-01-22T05:39:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.288+0000 7f939ea00700 1 -- 172.21.15.100:0/838363113 wait complete. 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.290+0000 7f939ea00700 1 Processor -- start 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.290+0000 7f939ea00700 1 -- start start 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f939ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980a7d90 0x7f9398167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f939ea00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93980c3e20 0x7f9398140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f939ea00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f93980ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f939ea00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9398153ad0 con 0x7f93980a7d90 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f939ea00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c6a20 con 0x7f93980c3e20 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f939ea00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93981682e0 con 0x7f939814f880 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980a7d90 0x7f9398167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980a7d90 0x7f9398167ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49912/0 (socket says 172.21.15.100:49912) 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 -- 172.21.15.100:0/4159125806 learned_addr learned my addr 172.21.15.100:0/4159125806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:57.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f939ca00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f93980ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397400700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93980c3e20 0x7f9398140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 -- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 msgr2=0x7f93980ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f93980ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 -- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93980c3e20 msgr2=0x7f9398140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93980c3e20 0x7f9398140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397e00700 1 -- 172.21.15.100:0/4159125806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390009ae0 con 0x7f93980a7d90 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.291+0000 7f9397400700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93980c3e20 0x7f9398140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.292+0000 7f9397e00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980a7d90 0x7f9398167ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f938800e8d0 tx=0x7f9388006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.292+0000 7f938f400700 1 -- 172.21.15.100:0/4159125806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388012600 con 0x7f93980a7d90 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.292+0000 7f938f400700 1 -- 172.21.15.100:0/4159125806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388012760 con 0x7f93980a7d90 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.292+0000 7f938f400700 1 -- 172.21.15.100:0/4159125806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388012ae0 con 0x7f93980a7d90 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.292+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93981685c0 con 0x7f93980a7d90 2024-01-22T05:39:57.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.292+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9398153d20 con 0x7f93980a7d90 2024-01-22T05:39:57.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.293+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9398154090 con 0x7f93980a7d90 2024-01-22T05:39:57.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.294+0000 7f938f400700 1 -- 172.21.15.100:0/4159125806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f938801b400 con 0x7f93980a7d90 2024-01-22T05:39:57.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.295+0000 7f938f400700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f937005f150 0x7f9370061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:57.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.295+0000 7f938f400700 1 -- 172.21.15.100:0/4159125806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f938807a4e0 con 0x7f93980a7d90 2024-01-22T05:39:57.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.295+0000 7f9397400700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f937005f150 0x7f9370061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:57.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.296+0000 7f9397400700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f937005f150 0x7f9370061610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f939815ae50 tx=0x7f9380008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:57.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.299+0000 7f938f400700 1 -- 172.21.15.100:0/4159125806 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f938804b750 con 0x7f93980a7d90 2024-01-22T05:39:57.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.514+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f939805fdb0 con 0x7f93980a7d90 2024-01-22T05:39:57.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.514+0000 7f938f400700 1 -- 172.21.15.100:0/4159125806 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f9388016020 con 0x7f93980a7d90 2024-01-22T05:39:57.515 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:39:57.515 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4035127106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4035127106},{"type":"v1","addr":"172.21.15.169:6833","nonce":4035127106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2883555784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2883555784},{"type":"v1","addr":"172.21.15.169:6835","nonce":2883555784}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2387513263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2387513263},{"type":"v1","addr":"172.21.15.100:6836","nonce":2387513263}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:39:46.740767+0000","modified":"2024-01-22T05:39:50.173071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/2256257950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2256257950},{"type":"v1","addr":"172.21.15.100:6837","nonce":2256257950}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:39:57.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f937005f150 msgr2=0x7f9370061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:57.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f937005f150 0x7f9370061610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f939815ae50 tx=0x7f9380008040).stop 2024-01-22T05:39:57.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980a7d90 msgr2=0x7f9398167ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:57.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980a7d90 0x7f9398167ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f938800e8d0 tx=0x7f9388006f40).stop 2024-01-22T05:39:57.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 shutdown_connections 2024-01-22T05:39:57.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f937005f150 0x7f9370061610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f939814f880 0x7f93980ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93980a7d90 0x7f9398167ab0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 --2- 172.21.15.100:0/4159125806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93980c3e20 0x7f9398140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:57.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 >> 172.21.15.100:0/4159125806 conn(0x7f9398091a00 msgr2=0x7f9398150150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:57.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 shutdown_connections 2024-01-22T05:39:57.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:57.517+0000 7f939ea00700 1 -- 172.21.15.100:0/4159125806 wait complete. 2024-01-22T05:39:57.520 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-01-22T05:39:57.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T05:39:46.740767+0000', 'modified': '2024-01-22T05:39:50.173071+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5394}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5394': {'gid': 5394, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6837/2256257950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 2256257950}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 2256257950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-22T05:39:57.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T05:39:57.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T05:39:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.125+0000 7f8f89600700 1 Processor -- start 2024-01-22T05:39:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.125+0000 7f8f89600700 1 -- start start 2024-01-22T05:39:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.126+0000 7f8f89600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8f84150ae0 0x7f8f84150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.126+0000 7f8f89600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f840c25c0 0x7f8f840c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.126+0000 7f8f89600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f840660a0 con 0x7f8f841521d0 2024-01-22T05:39:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.126+0000 7f8f89600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f84065bd0 con 0x7f8f84150ae0 2024-01-22T05:39:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.126+0000 7f8f89600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84151d40 con 0x7f8f840c25c0 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8f84150ae0 0x7f8f84150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8f841521d0 0x7f8f840654c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39588/0 (socket says 172.21.15.100:39588) 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82000700 1 -- 172.21.15.100:0/3641445779 learned_addr learned my addr 172.21.15.100:0/3641445779 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f83400700 1 --2- 172.21.15.100:0/3641445779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f840c25c0 0x7f8f840c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82a00700 1 -- 172.21.15.100:0/3641445779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f840c25c0 msgr2=0x7f8f840c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82a00700 1 --2- 172.21.15.100:0/3641445779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f840c25c0 0x7f8f840c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82a00700 1 -- 172.21.15.100:0/3641445779 >> v1:172.21.15.100:6789/0 conn(0x7f8f841521d0 legacy=0x7f8f840654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82a00700 1 -- 172.21.15.100:0/3641445779 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84065dc0 con 0x7f8f84150ae0 2024-01-22T05:39:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.127+0000 7f8f82a00700 1 --2- 172.21.15.100:0/3641445779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f84150ec0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f8f74009760 tx=0x7f8f74009060).ready entity=mon.0 client_cookie=4b53d18c2a768a55 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f81600700 1 -- 172.21.15.100:0/3641445779 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400b580 con 0x7f8f84150ae0 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f81600700 1 -- 172.21.15.100:0/3641445779 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7400b6e0 con 0x7f8f84150ae0 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f81600700 1 -- 172.21.15.100:0/3641445779 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400ba60 con 0x7f8f84150ae0 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 -- 172.21.15.100:0/3641445779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 msgr2=0x7f8f84150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 --2- 172.21.15.100:0/3641445779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f84150ec0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f8f74009760 tx=0x7f8f74009060).stop 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 -- 172.21.15.100:0/3641445779 shutdown_connections 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 --2- 172.21.15.100:0/3641445779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f84150ec0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 --2- 172.21.15.100:0/3641445779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f840c25c0 0x7f8f840c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 -- 172.21.15.100:0/3641445779 >> 172.21.15.100:0/3641445779 conn(0x7f8f840630c0 msgr2=0x7f8f840c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 -- 172.21.15.100:0/3641445779 shutdown_connections 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.128+0000 7f8f89600700 1 -- 172.21.15.100:0/3641445779 wait complete. 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.130+0000 7f8f89600700 1 Processor -- start 2024-01-22T05:39:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.130+0000 7f8f89600700 1 -- start start 2024-01-22T05:39:58.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f89600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f840c25c0 0x7f8f840ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f89600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f8413e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f89600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f841521d0 0x7f8f8414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f89600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840c5c20 con 0x7f8f84150ae0 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f89600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840c5010 con 0x7f8f840c25c0 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f89600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840c52f0 con 0x7f8f841521d0 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f8413e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f8413e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49926/0 (socket says 172.21.15.100:49926) 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 -- 172.21.15.100:0/1686591179 learned_addr learned my addr 172.21.15.100:0/1686591179 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f83400700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f841521d0 0x7f8f8414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82a00700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f840c25c0 0x7f8f840ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 -- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f841521d0 msgr2=0x7f8f8414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f841521d0 0x7f8f8414d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 -- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f840c25c0 msgr2=0x7f8f840ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f840c25c0 0x7f8f840ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82000700 1 -- 172.21.15.100:0/1686591179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740092a0 con 0x7f8f84150ae0 2024-01-22T05:39:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.131+0000 7f8f82a00700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f840c25c0 0x7f8f840ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.132+0000 7f8f82000700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f8413e5a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f8f6c00c440 tx=0x7f8f6c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.132+0000 7f8f7a000700 1 -- 172.21.15.100:0/1686591179 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0072e0 con 0x7f8f84150ae0 2024-01-22T05:39:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.132+0000 7f8f7a000700 1 -- 172.21.15.100:0/1686591179 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c007440 con 0x7f8f84150ae0 2024-01-22T05:39:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.132+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f840c55d0 con 0x7f8f84150ae0 2024-01-22T05:39:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.132+0000 7f8f7a000700 1 -- 172.21.15.100:0/1686591179 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0057a0 con 0x7f8f84150ae0 2024-01-22T05:39:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.132+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8413ea90 con 0x7f8f84150ae0 2024-01-22T05:39:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.134+0000 7f8f7a000700 1 -- 172.21.15.100:0/1686591179 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8f6c005bd0 con 0x7f8f84150ae0 2024-01-22T05:39:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.135+0000 7f8f7a000700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f5c05f150 0x7f8f5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.135+0000 7f8f7a000700 1 -- 172.21.15.100:0/1686591179 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8f6c0799d0 con 0x7f8f84150ae0 2024-01-22T05:39:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.135+0000 7f8f82a00700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f5c05f150 0x7f8f5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.136+0000 7f8f82a00700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f5c05f150 0x7f8f5c061610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8f7400b340 tx=0x7f8f74017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.137+0000 7f8fa0a6cb80 1 Processor -- start 2024-01-22T05:39:58.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.137+0000 7f8fa0a6cb80 1 -- start start 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e54973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e54bdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e54b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e53ab2f0 con 0x5556e54719c0 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e53c07e0 con 0x5556e54bd740 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e53c0920 con 0x5556e54be010 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e54bdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e54bdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49940/0 (socket says 172.21.15.100:49940) 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.138+0000 7f8f82000700 1 -- 172.21.15.100:0/2746408666 learned_addr learned my addr 172.21.15.100:0/2746408666 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f83400700 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e54b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82a00700 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e54973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82000700 1 -- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 msgr2=0x5556e54b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82000700 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e54b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82000700 1 -- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 msgr2=0x5556e54973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82000700 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e54973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82000700 1 -- 172.21.15.100:0/2746408666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e53b9720 con 0x5556e54719c0 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82a00700 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e54973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f82000700 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e54bdb20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f8f6c04ad50 tx=0x7f8f6c00f000).ready entity=mon.0 client_cookie=428b470a819e3364 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f72000700 1 -- 172.21.15.100:0/2746408666 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c04e2c0 con 0x5556e54719c0 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f72000700 1 -- 172.21.15.100:0/2746408666 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c04e900 con 0x5556e54719c0 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.139+0000 7f8f72000700 1 -- 172.21.15.100:0/2746408666 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c04b070 con 0x5556e54719c0 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2746408666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 msgr2=0x5556e54bdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e54bdb20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f8f6c04ad50 tx=0x7f8f6c00f000).stop 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2746408666 shutdown_connections 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e54973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e54b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2746408666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e54bdb20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2746408666 >> 172.21.15.100:0/2746408666 conn(0x5556e52d8940 msgr2=0x5556e54b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2746408666 shutdown_connections 2024-01-22T05:39:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.140+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2746408666 wait complete. 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.141+0000 7f8fa0a6cb80 1 -- start start 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.141+0000 7f8fa0a6cb80 1 Processor -- start 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54719c0 0x5556e5496ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54be010 0x5556e54b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e53c0ba0 con 0x5556e54bd740 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e538be60 con 0x5556e54be010 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e549c340 con 0x5556e54719c0 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8fa0a6cb80 10 client.0 ll_register_callbacks cb 0x5556e5360ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54b7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49948/0 (socket says 172.21.15.100:49948) 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 -- 172.21.15.100:0/129472445 learned_addr learned my addr 172.21.15.100:0/129472445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f83400700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54be010 0x5556e54b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82a00700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54719c0 0x5556e5496ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 -- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54719c0 msgr2=0x5556e5496ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54719c0 0x5556e5496ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 -- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54be010 msgr2=0x5556e54b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54be010 0x5556e54b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f82000700 1 -- 172.21.15.100:0/129472445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8413ea90 con 0x5556e54bd740 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.143+0000 7f8f83400700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54be010 0x5556e54b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8f82000700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54b7770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f8f6c078080 tx=0x7f8f6c059000).ready entity=mon.0 client_cookie=ee2d2e8bf7e4deea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8f6aa00700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8f6aa00700 1 -- 172.21.15.100:0/129472445 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c04de50 con 0x5556e54bd740 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8f6aa00700 1 -- 172.21.15.100:0/129472445 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8f6c04dfb0 con 0x5556e54bd740 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5556e54631a0 con 0x5556e54bd740 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8f6aa00700 1 -- 172.21.15.100:0/129472445 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f6c064eb0 con 0x5556e54bd740 2024-01-22T05:39:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 10 client.5574 fetch_fsmap learned FSMap version 24 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5556e53b4ac0 con 0x5556e54bd740 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8f6aa00700 1 -- 172.21.15.100:0/129472445 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556e54631a0 con 0x5556e54bd740 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8f6aa00700 1 -- 172.21.15.100:0/129472445 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8f6c04eb90 con 0x5556e54bd740 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 10 client.5574 fetch_fsmap finished waiting for FSMap version 24 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 10 client.5574 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 20 client.5574 populate_metadata read hostname 'smithi100' 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b03b0 0x5556e54b0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 4 client.5574 mds_command: new command op to 5394 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.144+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 --> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5556e5228ef0 con 0x5556e54b03b0 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.145+0000 7f8f82a00700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b03b0 0x5556e54b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.145+0000 7f8f82a00700 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b03b0 0x5556e54b0790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=27acb58358cf2cdc server_cookie=d48ee58610c55541 in_seq=0 out_seq=0 2024-01-22T05:39:58.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.145+0000 7f8f6aa00700 10 client.5574 ms_handle_connect on v2:172.21.15.100:6835/2256257950 2024-01-22T05:39:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8f6aa00700 1 -- 172.21.15.100:0/129472445 <== mds.0 v2:172.21.15.100:6835/2256257950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5556e5228ef0 con 0x5556e54b03b0 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8f6aa00700 10 client.5574 handle_command_reply: tid=0 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 client.5574 shutdown 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 msgr2=0x5556e54b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54b7770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f8f6c078080 tx=0x7f8f6c059000).stop 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 shutdown_connections 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b03b0 0x5556e54b0790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54be010 0x5556e54b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54719c0 0x5556e5496ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/129472445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54b7770 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 >> 172.21.15.100:0/129472445 conn(0x5556e52d8940 msgr2=0x5556e54b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8f6aa00700 0 client.5574 ms_handle_reset on v2:172.21.15.100:6835/2256257950 2024-01-22T05:39:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 shutdown_connections 2024-01-22T05:39:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.146+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/129472445 wait complete. 2024-01-22T05:39:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.147+0000 7f8fa0a6cb80 20 client.5574 trim_cache size 0 max 16384 2024-01-22T05:39:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.163+0000 7f8fa0a6cb80 1 Processor -- start 2024-01-22T05:39:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.164+0000 7f8fa0a6cb80 1 -- start start 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.164+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54719c0 0x5556e54c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.164+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.164+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e54b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.164+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e549bee0 con 0x5556e54bd740 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.164+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e549c490 con 0x5556e54719c0 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.164+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e546e2b0 con 0x5556e54be010 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49950/0 (socket says 172.21.15.100:49950) 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 -- 172.21.15.100:0/1496226013 learned_addr learned my addr 172.21.15.100:0/1496226013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 -- 172.21.15.100:0/1496226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 msgr2=0x5556e54b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 --2- 172.21.15.100:0/1496226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e54b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 -- 172.21.15.100:0/1496226013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54719c0 msgr2=0x5556e54c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 --2- 172.21.15.100:0/1496226013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54719c0 0x5556e54c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 -- 172.21.15.100:0/1496226013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e53b4810 con 0x5556e54bd740 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f82000700 1 --2- 172.21.15.100:0/1496226013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54c6a50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f8f6c04b380 tx=0x7f8f6c062000).ready entity=mon.0 client_cookie=4283ec113bf03abd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f72a00700 1 -- 172.21.15.100:0/1496226013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c04caa0 con 0x5556e54bd740 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f72a00700 1 -- 172.21.15.100:0/1496226013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c04eb90 con 0x5556e54bd740 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.165+0000 7f8f72a00700 1 -- 172.21.15.100:0/1496226013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c04ab10 con 0x5556e54bd740 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/1496226013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 msgr2=0x5556e54c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/1496226013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54c6a50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f8f6c04b380 tx=0x7f8f6c062000).stop 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/1496226013 shutdown_connections 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/1496226013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54719c0 0x5556e54c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/1496226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e54b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/1496226013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54bd740 0x5556e54c6a50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/1496226013 >> 172.21.15.100:0/1496226013 conn(0x5556e52d8940 msgr2=0x5556e546b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/1496226013 shutdown_connections 2024-01-22T05:39:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.166+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/1496226013 wait complete. 2024-01-22T05:39:58.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.167+0000 7f8fa0a6cb80 1 -- start start 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.167+0000 7f8fa0a6cb80 1 Processor -- start 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e5512b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e5518a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8fa0a6cb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e5470340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e5519500 con 0x5556e54719c0 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e546feb0 con 0x5556e54bd740 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8fa0a6cb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e54bbbd0 con 0x5556e54be010 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8fa0a6cb80 10 client.0 ll_register_callbacks cb 0x5556e5360ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8f82a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e5512b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8f82a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e5512b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49966/0 (socket says 172.21.15.100:49966) 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8f82a00700 1 -- 172.21.15.100:0/2926244987 learned_addr learned my addr 172.21.15.100:0/2926244987 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8f82000700 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e5518a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8f83400700 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e5470340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8f82a00700 1 -- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 msgr2=0x5556e5470340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.168+0000 7f8f82a00700 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e5470340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f82a00700 1 -- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 msgr2=0x5556e5518a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f82a00700 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e5518a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f82a00700 1 -- 172.21.15.100:0/2926244987 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556e53b4ac0 con 0x5556e54719c0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f82a00700 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e5512b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f8f74003000 tx=0x7f8f74027040).ready entity=mon.0 client_cookie=c1c0c4fc26893c13 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f6aa00700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f6aa00700 1 -- 172.21.15.100:0/2926244987 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7402b040 con 0x5556e54719c0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f6aa00700 1 -- 172.21.15.100:0/2926244987 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8f7401bad0 con 0x5556e54719c0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f6c04e900 con 0x5556e54719c0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f6aa00700 1 -- 172.21.15.100:0/2926244987 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f7402f280 con 0x5556e54719c0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8fa0a6cb80 10 client.5580 fetch_fsmap learned FSMap version 24 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5556e522e1d0 con 0x5556e54719c0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f6aa00700 1 -- 172.21.15.100:0/2926244987 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c04e900 con 0x5556e54719c0 2024-01-22T05:39:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.169+0000 7f8f6aa00700 1 -- 172.21.15.100:0/2926244987 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8f7402e070 con 0x5556e54719c0 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8fa0a6cb80 10 client.5580 fetch_fsmap finished waiting for FSMap version 24 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8fa0a6cb80 10 client.5580 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8fa0a6cb80 20 client.5580 populate_metadata read hostname 'smithi100' 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b7120 0x5556e54b7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8fa0a6cb80 4 client.5580 mds_command: new command op to 5394 tid=0[{"prefix": "status"}] 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 --> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5556e525e040 con 0x5556e54b7120 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8f82000700 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b7120 0x5556e54b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8f6aa00700 10 client.5580 ms_handle_connect on v2:172.21.15.100:6835/2256257950 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8f82000700 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b7120 0x5556e54b7500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=584743947c2fe793 server_cookie=c653264ae0a48cf4 in_seq=0 out_seq=0 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8f6aa00700 1 -- 172.21.15.100:0/2926244987 <== mds.0 v2:172.21.15.100:6835/2256257950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5556e525e040 con 0x5556e54b7120 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8f6aa00700 10 client.5580 handle_command_reply: tid=0 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.170+0000 7f8fa0a6cb80 1 client.5580 shutdown 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 msgr2=0x5556e5512b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e5512b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f8f74003000 tx=0x7f8f74027040).stop 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 shutdown_connections 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:6835/2256257950,v1:172.21.15.100:6837/2256257950] conn(0x5556e54b7120 0x5556e54b7500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5556e54be010 0x5556e5470340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5556e54719c0 0x5556e5512b90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 --2- 172.21.15.100:0/2926244987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556e54bd740 0x5556e5518a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8f6aa00700 0 client.5580 ms_handle_reset on v2:172.21.15.100:6835/2256257950 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 >> 172.21.15.100:0/2926244987 conn(0x5556e52d8940 msgr2=0x5556e546c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 shutdown_connections 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 1 -- 172.21.15.100:0/2926244987 wait complete. 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8fa0a6cb80 20 client.5580 trim_cache size 0 max 16384 2024-01-22T05:39:58.175 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "2373e7ef-4ea1-4c09-a2b1-243cb5e8dade", 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5394, 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 11.427947775, 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 52, 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 52, 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 22.719285551999999 2024-01-22T05:39:58.176 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.171+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f5c05f150 msgr2=0x7f8f5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f5c05f150 0x7f8f5c061610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8f7400b340 tx=0x7f8f74017000).stop 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 msgr2=0x7f8f8413e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f8413e5a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f8f6c00c440 tx=0x7f8f6c007e20).stop 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 shutdown_connections 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8f5c05f150 0x7f8f5c061610 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f840c25c0 0x7f8f840ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f841521d0 0x7f8f8414d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 --2- 172.21.15.100:0/1686591179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f84150ae0 0x7f8f8413e5a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 >> 172.21.15.100:0/1686591179 conn(0x7f8f840630c0 msgr2=0x7f8f8414e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 shutdown_connections 2024-01-22T05:39:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.172+0000 7f8f89600700 1 -- 172.21.15.100:0/1686591179 wait complete. 2024-01-22T05:39:58.188 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:39:58.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.343+0000 7efc3ac00700 1 Processor -- start 2024-01-22T05:39:58.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.343+0000 7efc3ac00700 1 -- start start 2024-01-22T05:39:58.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.344+0000 7efc3ac00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc34137440 0x7efc340c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc3ac00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340c25f0 con 0x7efc340c6040 2024-01-22T05:39:58.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc3ac00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340c2a80 con 0x7efc34137820 2024-01-22T05:39:58.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc3ac00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc340c19e0 con 0x7efc34137440 2024-01-22T05:39:58.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc33e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc34137440 0x7efc340c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc38c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efc340c6040 0x7efc340bb880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39600/0 (socket says 172.21.15.100:39600) 2024-01-22T05:39:58.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc38c00700 1 -- 172.21.15.100:0/2328313767 learned_addr learned my addr 172.21.15.100:0/2328313767 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:39:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc33e00700 1 -- 172.21.15.100:0/2328313767 >> v1:172.21.15.169:6789/0 conn(0x7efc34137820 legacy=0x7efc340c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc33e00700 1 -- 172.21.15.100:0/2328313767 >> v1:172.21.15.100:6789/0 conn(0x7efc340c6040 legacy=0x7efc340bb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc33e00700 1 -- 172.21.15.100:0/2328313767 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc340c1cc0 con 0x7efc34137440 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc32a00700 1 -- 172.21.15.100:0/2328313767 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114013936 0 0) 0x7efc340c25f0 con 0x7efc340c6040 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.345+0000 7efc33e00700 1 --2- 172.21.15.100:0/2328313767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc340c0f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7efc24009760 tx=0x7efc24009060).ready entity=mon.0 client_cookie=5a667d0b139e2981 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc32a00700 1 -- 172.21.15.100:0/2328313767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400b580 con 0x7efc34137440 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc32a00700 1 -- 172.21.15.100:0/2328313767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2400b6e0 con 0x7efc34137440 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc32a00700 1 -- 172.21.15.100:0/2328313767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400ba60 con 0x7efc34137440 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc3ac00700 1 -- 172.21.15.100:0/2328313767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 msgr2=0x7efc340c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc3ac00700 1 --2- 172.21.15.100:0/2328313767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc340c0f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7efc24009760 tx=0x7efc24009060).stop 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc3ac00700 1 -- 172.21.15.100:0/2328313767 shutdown_connections 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc3ac00700 1 --2- 172.21.15.100:0/2328313767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc340c0f20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc3ac00700 1 -- 172.21.15.100:0/2328313767 >> 172.21.15.100:0/2328313767 conn(0x7efc34063280 msgr2=0x7efc340c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc3ac00700 1 -- 172.21.15.100:0/2328313767 shutdown_connections 2024-01-22T05:39:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.346+0000 7efc3ac00700 1 -- 172.21.15.100:0/2328313767 wait complete. 2024-01-22T05:39:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.348+0000 7efc3ac00700 1 Processor -- start 2024-01-22T05:39:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.348+0000 7efc3ac00700 1 -- start start 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc3ac00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc340c6040 0x7efc340a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc3ac00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc341356b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc3ac00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc34137820 0x7efc34162810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc3ac00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34163830 con 0x7efc34137440 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc3ac00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc340a7900 con 0x7efc340c6040 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc3ac00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34151be0 con 0x7efc34137820 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc33400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc341356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc33400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc341356b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49992/0 (socket says 172.21.15.100:49992) 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc33400700 1 -- 172.21.15.100:0/1757394446 learned_addr learned my addr 172.21.15.100:0/1757394446 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:39:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc38c00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc34137820 0x7efc34162810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.349+0000 7efc33e00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc340c6040 0x7efc340a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc33400700 1 -- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc34137820 msgr2=0x7efc34162810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc33400700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc34137820 0x7efc34162810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc33400700 1 -- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc340c6040 msgr2=0x7efc340a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc33400700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc340c6040 0x7efc340a7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc33400700 1 -- 172.21.15.100:0/1757394446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240092a0 con 0x7efc34137440 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc33400700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc341356b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7efc1c00c440 tx=0x7efc1c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc2b400700 1 -- 172.21.15.100:0/1757394446 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c007020 con 0x7efc34137440 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc2b400700 1 -- 172.21.15.100:0/1757394446 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c007180 con 0x7efc34137440 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc34163270 con 0x7efc34137440 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc2b400700 1 -- 172.21.15.100:0/1757394446 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c007520 con 0x7efc34137440 2024-01-22T05:39:58.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.350+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc34151870 con 0x7efc34137440 2024-01-22T05:39:58.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.351+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3405fd50 con 0x7efc34137440 2024-01-22T05:39:58.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.352+0000 7efc2b400700 1 -- 172.21.15.100:0/1757394446 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efc1c0068b0 con 0x7efc34137440 2024-01-22T05:39:58.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.353+0000 7efc2b400700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0c05f120 0x7efc0c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:39:58.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.353+0000 7efc2b400700 1 -- 172.21.15.100:0/1757394446 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efc1c079ac0 con 0x7efc34137440 2024-01-22T05:39:58.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.353+0000 7efc33e00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0c05f120 0x7efc0c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:39:58.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.353+0000 7efc33e00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0c05f120 0x7efc0c0615e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7efc24006e00 tx=0x7efc24017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:39:58.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.357+0000 7efc2b400700 1 -- 172.21.15.100:0/1757394446 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efc1c04ad90 con 0x7efc34137440 2024-01-22T05:39:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.567+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc340475e0 con 0x7efc34137440 2024-01-22T05:39:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.567+0000 7efc2b400700 1 -- 172.21.15.100:0/1757394446 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7efc1c079e60 con 0x7efc34137440 2024-01-22T05:39:58.568 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:39:58.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0c05f120 msgr2=0x7efc0c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0c05f120 0x7efc0c0615e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7efc24006e00 tx=0x7efc24017000).stop 2024-01-22T05:39:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 msgr2=0x7efc341356b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:39:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc341356b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7efc1c00c440 tx=0x7efc1c007dd0).stop 2024-01-22T05:39:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 shutdown_connections 2024-01-22T05:39:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7efc0c05f120 0x7efc0c0615e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc340c6040 0x7efc340a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc34137820 0x7efc34162810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 --2- 172.21.15.100:0/1757394446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc34137440 0x7efc341356b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:39:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 >> 172.21.15.100:0/1757394446 conn(0x7efc34063280 msgr2=0x7efc34069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:39:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 shutdown_connections 2024-01-22T05:39:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:39:58.570+0000 7efc3ac00700 1 -- 172.21.15.100:0/1757394446 wait complete. 2024-01-22T05:39:58.584 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:39:58.584 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:39:58.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:39:58.585 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:39:58.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:58.585 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:39:58.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:39:58.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:39:58.585 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:58.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:58.585 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:39:58.631 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:39:58.631 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:39:58.631 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:39:58.631 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:39:58.632 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:58.633 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:39:58.633 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:58.633 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:39:58.633 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40792sec preferred_lft 40792sec 2024-01-22T05:39:58.633 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:39:58.633 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:58.633 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:39:58.636 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff 2024-01-22T05:39:58.636 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:39:58.636 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:58.636 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f05d:9bff:feba:b90d/64 scope link 2024-01-22T05:39:58.636 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::1c0c:7cff:fe73:80ca/64 scope link 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether e6:39:c6:eb:cb:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::e439:c6ff:feeb:cbd7/64 scope link 2024-01-22T05:39:58.637 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:39:58.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:58.638 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:39:58.736 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:39:58.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:58.739 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:39:58.785 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:39:58.786 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:39:58.786 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:39:58.786 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:39:58.786 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:39:58.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:58.787 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:39:58.787 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:39:58.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:39:58.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:39:58.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:39:58.787 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:39:58.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:58.948 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:39:58.993 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:39:58.993 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:39:58.995 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:58.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:39:58.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-22T05:39:59.102 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-22T05:39:59.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:59.102 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:59.146 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:39:59.146 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:59.253 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:59.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:59.317 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:59.320 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:59.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:59.321 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:59.366 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:39:59.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:39:59.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:39:59.479 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:39:59.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:39:59.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-01-22T05:39:59.562+0000 7f54b03993c0 -1 init, newargv = 0x5609cadf1000 newargc=15 2024-01-22T05:39:59.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[87829]: starting ceph client 2024-01-22T05:39:59.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[87829]: starting fuse 2024-01-22T05:39:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:39:59.647 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:39:59.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:39:59.648 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:39:59.693 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:39:59.693 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:39:59.695 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:39:59.696 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:39:59.696 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-01-22T05:39:59.696 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:39:59.874 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.87829.asok 2024-01-22T05:40:00.052 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.87829.asok 2024-01-22T05:40:00.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:00.053 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.87829.asok status 2024-01-22T05:40:00.280 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:00.280 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:40:00.280 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:40:00.280 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "87829", 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5595, 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5595 2024-01-22T05:40:00.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3745784892 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3745784892 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5595 192.168.0.1:0/3745784892", 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/3745784892", 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:40:00.282 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 24, 2024-01-22T05:40:00.283 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 52, 2024-01-22T05:40:00.283 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:40:00.283 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:40:00.283 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:40:00.283 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:00.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:00.295 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:40:00.295 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:00.341 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:40:00.341 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:00.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:00.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:00.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:00.449 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-01-22T05:40:00.500 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-01-22T05:40:00.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.691+0000 7face9e00700 1 Processor -- start 2024-01-22T05:40:00.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.691+0000 7face9e00700 1 -- start start 2024-01-22T05:40:00.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.692+0000 7face9e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7face4157290 0x7face4092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:00.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.692+0000 7face9e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7face4092600 0x7face40c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:00.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.692+0000 7face9e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face4065000 con 0x7face4157670 2024-01-22T05:40:00.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.692+0000 7face9e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40c4250 con 0x7face4092600 2024-01-22T05:40:00.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.692+0000 7face9e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40643f0 con 0x7face4157290 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7face4092600 0x7face40c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face3400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7face4157670 0x7face4157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39608/0 (socket says 172.21.15.100:39608) 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7face4092600 0x7face40c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50006/0 (socket says 172.21.15.100:50006) 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face3400700 1 -- 172.21.15.100:0/4159240173 learned_addr learned my addr 172.21.15.100:0/4159240173 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2a00700 1 --2- 172.21.15.100:0/4159240173 >> v2:172.21.15.169:3300/0 conn(0x7face4157290 0x7face4092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2000700 1 -- 172.21.15.100:0/4159240173 >> v2:172.21.15.169:3300/0 conn(0x7face4157290 msgr2=0x7face4092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2000700 1 --2- 172.21.15.100:0/4159240173 >> v2:172.21.15.169:3300/0 conn(0x7face4157290 0x7face4092110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2000700 1 -- 172.21.15.100:0/4159240173 >> v1:172.21.15.100:6789/0 conn(0x7face4157670 legacy=0x7face4157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2000700 1 -- 172.21.15.100:0/4159240173 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40646d0 con 0x7face4092600 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face1600700 1 -- 172.21.15.100:0/4159240173 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692843038 0 0) 0x7face4065000 con 0x7face4157670 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2a00700 1 --2- 172.21.15.100:0/4159240173 >> v2:172.21.15.169:3300/0 conn(0x7face4157290 0x7face4092110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face2000700 1 --2- 172.21.15.100:0/4159240173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4092600 0x7face40c5470 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7face4069ee0 tx=0x7faccc009060).ready entity=mon.0 client_cookie=b65aa17616d4d659 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face1600700 1 -- 172.21.15.100:0/4159240173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00b580 con 0x7face4092600 2024-01-22T05:40:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face1600700 1 -- 172.21.15.100:0/4159240173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00b6e0 con 0x7face4092600 2024-01-22T05:40:00.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.693+0000 7face1600700 1 -- 172.21.15.100:0/4159240173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00ba60 con 0x7face4092600 2024-01-22T05:40:00.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 -- 172.21.15.100:0/4159240173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4092600 msgr2=0x7face40c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 --2- 172.21.15.100:0/4159240173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4092600 0x7face40c5470 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7face4069ee0 tx=0x7faccc009060).stop 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 -- 172.21.15.100:0/4159240173 shutdown_connections 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 --2- 172.21.15.100:0/4159240173 >> v2:172.21.15.169:3300/0 conn(0x7face4157290 0x7face4092110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 --2- 172.21.15.100:0/4159240173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4092600 0x7face40c5470 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 -- 172.21.15.100:0/4159240173 >> 172.21.15.100:0/4159240173 conn(0x7face405e9d0 msgr2=0x7face4091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 -- 172.21.15.100:0/4159240173 shutdown_connections 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.694+0000 7face9e00700 1 -- 172.21.15.100:0/4159240173 wait complete. 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.696+0000 7face9e00700 1 Processor -- start 2024-01-22T05:40:00.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.696+0000 7face9e00700 1 -- start start 2024-01-22T05:40:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face9e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7face4092600 0x7face4153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face9e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4157290 0x7face4157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face9e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7face4157670 0x7face4158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face9e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4158810 con 0x7face4157290 2024-01-22T05:40:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face9e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face40ad1b0 con 0x7face4157670 2024-01-22T05:40:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face9e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face4093fc0 con 0x7face4092600 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4157290 0x7face4157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4157290 0x7face4157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50016/0 (socket says 172.21.15.100:50016) 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 -- 172.21.15.100:0/3638980195 learned_addr learned my addr 172.21.15.100:0/3638980195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2a00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7face4092600 0x7face4153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face3400700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7face4157670 0x7face4158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 -- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7face4092600 msgr2=0x7face4153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7face4092600 0x7face4153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 -- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7face4157670 msgr2=0x7face4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7face4157670 0x7face4158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face2000700 1 -- 172.21.15.100:0/3638980195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0092a0 con 0x7face4157290 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.697+0000 7face3400700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7face4157670 0x7face4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.698+0000 7face2000700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4157290 0x7face4157e30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faccc009fd0 tx=0x7faccc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.698+0000 7facda000700 1 -- 172.21.15.100:0/3638980195 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc000bc0 con 0x7face4157290 2024-01-22T05:40:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.698+0000 7facda000700 1 -- 172.21.15.100:0/3638980195 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00b850 con 0x7face4157290 2024-01-22T05:40:00.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.698+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40ac910 con 0x7face4157290 2024-01-22T05:40:00.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.698+0000 7facda000700 1 -- 172.21.15.100:0/3638980195 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc000d20 con 0x7face4157290 2024-01-22T05:40:00.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.698+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40aced0 con 0x7face4157290 2024-01-22T05:40:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.699+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face4093d90 con 0x7face4157290 2024-01-22T05:40:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.700+0000 7facda000700 1 -- 172.21.15.100:0/3638980195 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faccc01b8b0 con 0x7face4157290 2024-01-22T05:40:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.700+0000 7facda000700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7facbc05f150 0x7facbc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.701+0000 7facda000700 1 -- 172.21.15.100:0/3638980195 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faccc07bcf0 con 0x7face4157290 2024-01-22T05:40:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.701+0000 7face2a00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7facbc05f150 0x7facbc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.701+0000 7face2a00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7facbc05f150 0x7facbc061610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7facd4006d80 tx=0x7facd4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.705+0000 7facda000700 1 -- 172.21.15.100:0/3638980195 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7face4093d90 con 0x7face4157290 2024-01-22T05:40:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.941+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7face4093d90 con 0x7face4157290 2024-01-22T05:40:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.945+0000 7facda000700 1 -- 172.21.15.100:0/3638980195 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 183+0+0 (secure 0 0 0) 0x7face4093d90 con 0x7face4157290 2024-01-22T05:40:00.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7facbc05f150 msgr2=0x7facbc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7facbc05f150 0x7facbc061610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7facd4006d80 tx=0x7facd4008040).stop 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4157290 msgr2=0x7face4157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4157290 0x7face4157e30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faccc009fd0 tx=0x7faccc017000).stop 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 shutdown_connections 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7facbc05f150 0x7facbc061610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7face4157670 0x7face4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7face4092600 0x7face4153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 --2- 172.21.15.100:0/3638980195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face4157290 0x7face4157e30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 >> 172.21.15.100:0/3638980195 conn(0x7face405e9d0 msgr2=0x7face4067160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.947+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 shutdown_connections 2024-01-22T05:40:00.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:00.948+0000 7face9e00700 1 -- 172.21.15.100:0/3638980195 wait complete. 2024-01-22T05:40:00.949 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:40:00.965 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:40:00.965 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:40:00.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:01.028 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[87829]: fuse finished with error 0 and tester_r 0 2024-01-22T05:40:01.032 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:40:07.134 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:40:07.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:07.134 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:40:07.185 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:40:07.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.344+0000 7f17ac400700 1 Processor -- start 2024-01-22T05:40:07.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.344+0000 7f17ac400700 1 -- start start 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.345+0000 7f17ac400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17a4137440 0x7f17a40c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.345+0000 7f17ac400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a40c6040 0x7f17a40c1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17ac400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40c25f0 con 0x7f17a4137820 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17ac400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a40c2a80 con 0x7f17a4137440 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17ac400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c19e0 con 0x7f17a40c6040 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17a4137440 0x7f17a40c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17a4137440 0x7f17a40c0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38544/0 (socket says 172.21.15.100:38544) 2024-01-22T05:40:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 -- 172.21.15.100:0/3252937639 learned_addr learned my addr 172.21.15.100:0/3252937639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17aa400700 1 --2- 172.21.15.100:0/3252937639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a40c6040 0x7f17a40c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 -- 172.21.15.100:0/3252937639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a40c6040 msgr2=0x7f17a40c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 --2- 172.21.15.100:0/3252937639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a40c6040 0x7f17a40c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 -- 172.21.15.100:0/3252937639 >> v1:172.21.15.169:6789/0 conn(0x7f17a4137820 legacy=0x7f17a40c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 -- 172.21.15.100:0/3252937639 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40c1cc0 con 0x7f17a4137440 2024-01-22T05:40:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17aa400700 1 --2- 172.21.15.100:0/3252937639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a40c6040 0x7f17a40c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.346+0000 7f17a9a00700 1 --2- 172.21.15.100:0/3252937639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a4137440 0x7f17a40c0f20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f1794006fd0 tx=0x7f17940090f0).ready entity=mon.0 client_cookie=abd7fb8db22adcdc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17a3e00700 1 -- 172.21.15.100:0/3252937639 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400b600 con 0x7f17a4137440 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17a3e00700 1 -- 172.21.15.100:0/3252937639 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400b760 con 0x7f17a4137440 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17a3e00700 1 -- 172.21.15.100:0/3252937639 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400bae0 con 0x7f17a4137440 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 -- 172.21.15.100:0/3252937639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a4137440 msgr2=0x7f17a40c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 --2- 172.21.15.100:0/3252937639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a4137440 0x7f17a40c0f20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f1794006fd0 tx=0x7f17940090f0).stop 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 -- 172.21.15.100:0/3252937639 shutdown_connections 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 --2- 172.21.15.100:0/3252937639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a4137440 0x7f17a40c0f20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 --2- 172.21.15.100:0/3252937639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a40c6040 0x7f17a40c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 -- 172.21.15.100:0/3252937639 >> 172.21.15.100:0/3252937639 conn(0x7f17a4063280 msgr2=0x7f17a40c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 -- 172.21.15.100:0/3252937639 shutdown_connections 2024-01-22T05:40:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.347+0000 7f17ac400700 1 -- 172.21.15.100:0/3252937639 wait complete. 2024-01-22T05:40:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.349+0000 7f17ac400700 1 Processor -- start 2024-01-22T05:40:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.349+0000 7f17ac400700 1 -- start start 2024-01-22T05:40:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17ac400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a40c6040 0x7f17a4162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17ac400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17a4137440 0x7f17a40a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17ac400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a4137820 0x7f17a4152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17ac400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40a04d0 con 0x7f17a40c6040 2024-01-22T05:40:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17ac400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4152670 con 0x7f17a4137440 2024-01-22T05:40:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17ac400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4162a70 con 0x7f17a4137820 2024-01-22T05:40:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17a9a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a40c6040 0x7f17a4162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17a9a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a40c6040 0x7f17a4162580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38550/0 (socket says 172.21.15.100:38550) 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.350+0000 7f17a9a00700 1 -- 172.21.15.100:0/3666314073 learned_addr learned my addr 172.21.15.100:0/3666314073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a9a00700 1 -- 172.21.15.100:0/3666314073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a4137820 msgr2=0x7f17a4152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a9a00700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a4137820 0x7f17a4152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a9a00700 1 -- 172.21.15.100:0/3666314073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17a4137440 msgr2=0x7f17a40a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a9a00700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17a4137440 0x7f17a40a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a9a00700 1 -- 172.21.15.100:0/3666314073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009370 con 0x7f17a40c6040 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a9a00700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a40c6040 0x7f17a4162580 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1794009f50 tx=0x7f1794017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a0c00700 1 -- 172.21.15.100:0/3666314073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400b8d0 con 0x7f17a40c6040 2024-01-22T05:40:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a0c00700 1 -- 172.21.15.100:0/3666314073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400ba30 con 0x7f17a40c6040 2024-01-22T05:40:07.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4151a60 con 0x7f17a40c6040 2024-01-22T05:40:07.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17a0c00700 1 -- 172.21.15.100:0/3666314073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794024680 con 0x7f17a40c6040 2024-01-22T05:40:07.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.351+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a41520a0 con 0x7f17a40c6040 2024-01-22T05:40:07.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.352+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a406a3e0 con 0x7f17a40c6040 2024-01-22T05:40:07.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.353+0000 7f17a0c00700 1 -- 172.21.15.100:0/3666314073 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1794021070 con 0x7f17a40c6040 2024-01-22T05:40:07.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.354+0000 7f17a0c00700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f177c05f180 0x7f177c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:07.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.354+0000 7f17a0c00700 1 -- 172.21.15.100:0/3666314073 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f179407bfe0 con 0x7f17a40c6040 2024-01-22T05:40:07.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.354+0000 7f17a9000700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f177c05f180 0x7f177c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:07.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.354+0000 7f17a9000700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f177c05f180 0x7f177c061640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f17a40a9630 tx=0x7f178c0079a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.358+0000 7f17a0c00700 1 -- 172.21.15.100:0/3666314073 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f179404d1f0 con 0x7f17a40c6040 2024-01-22T05:40:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.569+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f17a405fd50 con 0x7f17a40c6040 2024-01-22T05:40:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.569+0000 7f17a0c00700 1 -- 172.21.15.100:0/3666314073 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1794050810 con 0x7f17a40c6040 2024-01-22T05:40:07.570 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.571+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f177c05f180 msgr2=0x7f177c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.571+0000 7f17ac400700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f177c05f180 0x7f177c061640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f17a40a9630 tx=0x7f178c0079a0).stop 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.571+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a40c6040 msgr2=0x7f17a4162580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.571+0000 7f17ac400700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a40c6040 0x7f17a4162580 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1794009f50 tx=0x7f1794017000).stop 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 shutdown_connections 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f177c05f180 0x7f177c061640 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17a4137820 0x7f17a4152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a40c6040 0x7f17a4162580 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 --2- 172.21.15.100:0/3666314073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17a4137440 0x7f17a40a76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 >> 172.21.15.100:0/3666314073 conn(0x7f17a4063280 msgr2=0x7f17a40c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 shutdown_connections 2024-01-22T05:40:07.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:07.572+0000 7f17ac400700 1 -- 172.21.15.100:0/3666314073 wait complete. 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:40:07.587 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:40:07.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:07.588 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:40:07.633 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40783sec preferred_lft 40783sec 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:40:07.634 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f05d:9bff:feba:b90d/64 scope link 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::1c0c:7cff:fe73:80ca/64 scope link 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether e6:39:c6:eb:cb:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::e439:c6ff:feeb:cbd7/64 scope link 2024-01-22T05:40:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:07.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:07.636 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:40:07.736 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:40:07.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:07.739 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:40:07.786 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:40:07.787 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:40:07.787 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:40:07.787 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:40:07.787 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:40:07.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:07.788 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:40:07.788 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:40:07.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:40:07.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:40:07.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:40:07.788 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:40:07.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:07.949 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:40:07.993 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:40:07.993 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:40:07.993 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:40:07.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:07.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-22T05:40:08.101 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-22T05:40:08.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:08.101 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:08.145 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:40:08.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:40:08.253 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:40:08.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:40:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:40:08.319 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:40:08.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:08.320 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:40:08.367 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:40:08.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:08.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:40:08.478 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:40:08.478 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:40:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:40:08.545 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:40:08.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:08.545 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:40:08.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-01-22T05:40:08.564+0000 7f2bbc0b43c0 -1 init, newargv = 0x55ac7a711330 newargc=15 2024-01-22T05:40:08.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[88506]: starting ceph client 2024-01-22T05:40:08.571 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[88506]: starting fuse 2024-01-22T05:40:08.593 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:40:08.593 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:40:08.593 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:40:08.594 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:40:08.595 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:08.595 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-01-22T05:40:08.595 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:40:08.771 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.88506.asok 2024-01-22T05:40:08.949 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.88506.asok 2024-01-22T05:40:08.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:08.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.88506.asok status 2024-01-22T05:40:09.166 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:09.166 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "88506", 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5616, 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:40:09.167 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5616 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1022182887 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1022182887 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:09.168 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5616 192.168.0.1:0/1022182887", 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/1022182887", 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 24, 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 52, 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:40:09.169 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:09.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:09.177 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:40:09.177 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:09.221 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:40:09.221 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:09.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:09.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> import errno 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> try: 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> if False: 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> ret = os.read(fd, 1024) 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> else: 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> os.write(fd, b'"'"'content'"'"') 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> except OSError as e: 2024-01-22T05:40:09.328 DEBUG:teuthology.orchestra.run.smithi100:> if e.errno != errno.EPERM: 2024-01-22T05:40:09.329 DEBUG:teuthology.orchestra.run.smithi100:> raise 2024-01-22T05:40:09.329 DEBUG:teuthology.orchestra.run.smithi100:> else: 2024-01-22T05:40:09.329 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("client does not check permission of data pool") 2024-01-22T05:40:09.329 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:40:09.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-01-22T05:40:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.853+0000 7f628c600700 1 Processor -- start 2024-01-22T05:40:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.853+0000 7f628c600700 1 -- start start 2024-01-22T05:40:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.854+0000 7f628c600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f628405e900 0x7f62840aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.854+0000 7f628c600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840c1940 0x7f62840ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.854+0000 7f628c600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840c74b0 con 0x7f62840a9f60 2024-01-22T05:40:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.854+0000 7f628c600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840cab90 con 0x7f628405e900 2024-01-22T05:40:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.854+0000 7f628c600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6284158660 con 0x7f62840c1940 2024-01-22T05:40:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6289c00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f62840a9f60 0x7f628405e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50402/0 (socket says 172.21.15.100:50402) 2024-01-22T05:40:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6289200700 1 --2- 172.21.15.100:0/3159686175 >> v2:172.21.15.100:3300/0 conn(0x7f628405e900 0x7f62840aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6289c00700 1 -- 172.21.15.100:0/3159686175 learned_addr learned my addr 172.21.15.100:0/3159686175 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f628a600700 1 --2- 172.21.15.100:0/3159686175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840c1940 0x7f62840ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6289200700 1 -- 172.21.15.100:0/3159686175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840c1940 msgr2=0x7f62840ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6289200700 1 --2- 172.21.15.100:0/3159686175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840c1940 0x7f62840ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6289200700 1 -- 172.21.15.100:0/3159686175 >> v1:172.21.15.100:6789/0 conn(0x7f62840a9f60 legacy=0x7f628405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6289200700 1 -- 172.21.15.100:0/3159686175 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284158940 con 0x7f628405e900 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.855+0000 7f6283e00700 1 -- 172.21.15.100:0/3159686175 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532397645 0 0) 0x7f62840c74b0 con 0x7f62840a9f60 2024-01-22T05:40:09.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f6289200700 1 --2- 172.21.15.100:0/3159686175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f62840aa340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f626c009760 tx=0x7f626c009060).ready entity=mon.0 client_cookie=4beecf6d272e10fe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f6283e00700 1 -- 172.21.15.100:0/3159686175 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00f510 con 0x7f628405e900 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f6283e00700 1 -- 172.21.15.100:0/3159686175 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00f670 con 0x7f628405e900 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f6283e00700 1 -- 172.21.15.100:0/3159686175 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00f9f0 con 0x7f628405e900 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 -- 172.21.15.100:0/3159686175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 msgr2=0x7f62840aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 --2- 172.21.15.100:0/3159686175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f62840aa340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f626c009760 tx=0x7f626c009060).stop 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 -- 172.21.15.100:0/3159686175 shutdown_connections 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 --2- 172.21.15.100:0/3159686175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840c1940 0x7f62840ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 --2- 172.21.15.100:0/3159686175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f62840aa340 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 -- 172.21.15.100:0/3159686175 >> 172.21.15.100:0/3159686175 conn(0x7f62840cada0 msgr2=0x7f62840cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 -- 172.21.15.100:0/3159686175 shutdown_connections 2024-01-22T05:40:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.856+0000 7f628c600700 1 -- 172.21.15.100:0/3159686175 wait complete. 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.858+0000 7f628c600700 1 Processor -- start 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.858+0000 7f628c600700 1 -- start start 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f628c600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f6284152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f628c600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840a9f60 0x7f6284164be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f628c600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62840c1940 0x7f62840cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f628c600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840ab310 con 0x7f628405e900 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f628c600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840ac100 con 0x7f62840c1940 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f628c600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840ab4f0 con 0x7f62840a9f60 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f6289c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f6284152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f6289c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f6284152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38580/0 (socket says 172.21.15.100:38580) 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f6289c00700 1 -- 172.21.15.100:0/4213335665 learned_addr learned my addr 172.21.15.100:0/4213335665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f6289200700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840a9f60 0x7f6284164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:09.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f628a600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62840c1940 0x7f62840cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f6289c00700 1 -- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840a9f60 msgr2=0x7f6284164be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.859+0000 7f6289c00700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840a9f60 0x7f6284164be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f6289c00700 1 -- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62840c1940 msgr2=0x7f62840cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f6289c00700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62840c1940 0x7f62840cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f6289c00700 1 -- 172.21.15.100:0/4213335665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c0092a0 con 0x7f628405e900 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f628a600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62840c1940 0x7f62840cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f6289c00700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f6284152440 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f627400c4e0 tx=0x7f6274007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f6280c00700 1 -- 172.21.15.100:0/4213335665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62740072e0 con 0x7f628405e900 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f6280c00700 1 -- 172.21.15.100:0/4213335665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6274007440 con 0x7f628405e900 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f6280c00700 1 -- 172.21.15.100:0/4213335665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62740057a0 con 0x7f628405e900 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62840ab7d0 con 0x7f628405e900 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.860+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62840abd90 con 0x7f628405e900 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.861+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628405fdb0 con 0x7f628405e900 2024-01-22T05:40:09.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.862+0000 7f6280c00700 1 -- 172.21.15.100:0/4213335665 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6274005bd0 con 0x7f628405e900 2024-01-22T05:40:09.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.863+0000 7f6280c00700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f625c05f150 0x7f625c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:09.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.863+0000 7f6280c00700 1 -- 172.21.15.100:0/4213335665 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6274079b30 con 0x7f628405e900 2024-01-22T05:40:09.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.863+0000 7f6289200700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f625c05f150 0x7f625c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:09.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.863+0000 7f6289200700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f625c05f150 0x7f625c061610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f62840c4e60 tx=0x7f626c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:09.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:09.867+0000 7f6280c00700 1 -- 172.21.15.100:0/4213335665 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f627404ae00 con 0x7f628405e900 2024-01-22T05:40:10.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.103+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7f62840ca030 con 0x7f628405e900 2024-01-22T05:40:10.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.107+0000 7f6280c00700 1 -- 172.21.15.100:0/4213335665 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 183+0+0 (secure 0 0 0) 0x7f627404e420 con 0x7f628405e900 2024-01-22T05:40:10.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f625c05f150 msgr2=0x7f625c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:10.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f625c05f150 0x7f625c061610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f62840c4e60 tx=0x7f626c017000).stop 2024-01-22T05:40:10.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 msgr2=0x7f6284152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:10.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f6284152440 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f627400c4e0 tx=0x7f6274007c70).stop 2024-01-22T05:40:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 shutdown_connections 2024-01-22T05:40:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f625c05f150 0x7f625c061610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62840c1940 0x7f62840cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628405e900 0x7f6284152440 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 --2- 172.21.15.100:0/4213335665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62840a9f60 0x7f6284164be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 >> 172.21.15.100:0/4213335665 conn(0x7f62840cada0 msgr2=0x7f6284153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 shutdown_connections 2024-01-22T05:40:10.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:10.109+0000 7f628c600700 1 -- 172.21.15.100:0/4213335665 wait complete. 2024-01-22T05:40:10.112 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:40:10.128 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:40:10.128 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:40:10.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:10.192 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[88506]: fuse finished with error 0 and tester_r 0 2024-01-22T05:40:10.195 INFO:teuthology.orchestra.run:waiting for 900 2024-01-22T05:40:16.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:40:16.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:16.297 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:40:16.347 DEBUG:teuthology.orchestra.run.smithi100:> ceph fs ls 2024-01-22T05:40:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.505+0000 7f5c66600700 1 Processor -- start 2024-01-22T05:40:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.505+0000 7f5c66600700 1 -- start start 2024-01-22T05:40:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.506+0000 7f5c66600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 0x7f5c600c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.506+0000 7f5c66600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600656b0 con 0x7f5c600bed60 2024-01-22T05:40:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.506+0000 7f5c66600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600c80d0 con 0x7f5c60153f70 2024-01-22T05:40:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.506+0000 7f5c66600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600c7ec0 con 0x7f5c60154350 2024-01-22T05:40:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5ea00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5c600bed60 0x7f5c600a5ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58252/0 (socket says 172.21.15.100:58252) 2024-01-22T05:40:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5ea00700 1 -- 172.21.15.100:0/3805722639 learned_addr learned my addr 172.21.15.100:0/3805722639 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751941547 0 0) 0x7f5c600656b0 con 0x7f5c600bed60 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c400033f0 con 0x7f5c600bed60 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5fe00700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 0x7f5c600c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397972681 0 0) 0x7f5c400033f0 con 0x7f5c600bed60 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 msgr2=0x7f5c600c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 0x7f5c600c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 >> v1:172.21.15.169:6789/0 conn(0x7f5c60153f70 legacy=0x7f5c600be650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600c83b0 con 0x7f5c600bed60 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.507+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f5c48001470 con 0x7f5c600bed60 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 >> v1:172.21.15.100:6789/0 conn(0x7f5c600bed60 legacy=0x7f5c600a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5e000700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c40003910 0x7f5c40003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5e000700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40004690 0x7f5c40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5e000700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 0x7f5c40005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600c7ec0 con 0x7f5c40003910 2024-01-22T05:40:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4000b910 con 0x7f5c40004690 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4000bad0 con 0x7f5c60154350 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5f400700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c40003910 0x7f5c40003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5ea00700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40004690 0x7f5c40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5fe00700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 0x7f5c40005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5f400700 1 -- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 msgr2=0x7f5c40005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5f400700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60154350 0x7f5c40005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5f400700 1 -- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40004690 msgr2=0x7f5c40004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5f400700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40004690 0x7f5c40004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5f400700 1 -- 172.21.15.100:0/3805722639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400033f0 con 0x7f5c40003910 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.508+0000 7f5c5f400700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c40003910 0x7f5c40003d30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f5c50001730 tx=0x7f5c50007bb0).ready entity=mon.0 client_cookie=dadc8bb79f42fc2d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50007020 con 0x7f5c40003910 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50007180 con 0x7f5c40003910 2024-01-22T05:40:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c5e000700 1 -- 172.21.15.100:0/3805722639 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50007500 con 0x7f5c40003910 2024-01-22T05:40:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c66600700 1 -- 172.21.15.100:0/3805722639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c40003910 msgr2=0x7f5c40003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c66600700 1 --2- 172.21.15.100:0/3805722639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c40003910 0x7f5c40003d30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f5c50001730 tx=0x7f5c50007bb0).stop 2024-01-22T05:40:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c5fe00700 1 -- 172.21.15.100:0/3805722639 reap_dead start 2024-01-22T05:40:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c66600700 1 -- 172.21.15.100:0/3805722639 shutdown_connections 2024-01-22T05:40:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c66600700 1 -- 172.21.15.100:0/3805722639 >> 172.21.15.100:0/3805722639 conn(0x7f5c60092250 msgr2=0x7f5c60062f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c66600700 1 -- 172.21.15.100:0/3805722639 shutdown_connections 2024-01-22T05:40:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.509+0000 7f5c66600700 1 -- 172.21.15.100:0/3805722639 wait complete. 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.511+0000 7f5c66600700 1 Processor -- start 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.511+0000 7f5c66600700 1 -- start start 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c66600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40003910 0x7f5c60096810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c66600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6014fe40 0x7f5c601515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c66600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60151a90 0x7f5c60167130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c66600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60096380 con 0x7f5c6014fe40 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c66600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60151f10 con 0x7f5c40003910 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c66600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60167ea0 con 0x7f5c60151a90 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6014fe40 0x7f5c601515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6014fe40 0x7f5c601515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41704/0 (socket says 172.21.15.100:41704) 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 -- 172.21.15.100:0/3205006171 learned_addr learned my addr 172.21.15.100:0/3205006171 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5f400700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40003910 0x7f5c60096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5fe00700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60151a90 0x7f5c60167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 -- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60151a90 msgr2=0x7f5c60167130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60151a90 0x7f5c60167130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 -- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40003910 msgr2=0x7f5c60096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40003910 0x7f5c60096810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5ea00700 1 -- 172.21.15.100:0/3205006171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c60095a50 con 0x7f5c6014fe40 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.512+0000 7f5c5fe00700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60151a90 0x7f5c60167130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.513+0000 7f5c5ea00700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6014fe40 0x7f5c601515a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f5c48004790 tx=0x7f5c48001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.513+0000 7f5c56a00700 1 -- 172.21.15.100:0/3205006171 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4800f5b0 con 0x7f5c6014fe40 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.513+0000 7f5c56a00700 1 -- 172.21.15.100:0/3205006171 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4800f710 con 0x7f5c6014fe40 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.513+0000 7f5c56a00700 1 -- 172.21.15.100:0/3205006171 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4800fa90 con 0x7f5c6014fe40 2024-01-22T05:40:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.513+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c60095d30 con 0x7f5c6014fe40 2024-01-22T05:40:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.513+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c601502c0 con 0x7f5c6014fe40 2024-01-22T05:40:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.514+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c600475e0 con 0x7f5c6014fe40 2024-01-22T05:40:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.515+0000 7f5c56a00700 1 -- 172.21.15.100:0/3205006171 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5c4801c360 con 0x7f5c6014fe40 2024-01-22T05:40:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.515+0000 7f5c56a00700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c3805f150 0x7f5c38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.516+0000 7f5c56a00700 1 -- 172.21.15.100:0/3205006171 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5c480798d0 con 0x7f5c6014fe40 2024-01-22T05:40:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.516+0000 7f5c5f400700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c3805f150 0x7f5c38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.516+0000 7f5c5f400700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c3805f150 0x7f5c38061610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5c50001010 tx=0x7f5c50015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.520+0000 7f5c56a00700 1 -- 172.21.15.100:0/3205006171 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5c4804ab40 con 0x7f5c6014fe40 2024-01-22T05:40:16.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.732+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c600c8690 con 0x7f5c6014fe40 2024-01-22T05:40:16.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.732+0000 7f5c56a00700 1 -- 172.21.15.100:0/3205006171 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5c48019030 con 0x7f5c6014fe40 2024-01-22T05:40:16.734 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T05:40:16.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c3805f150 msgr2=0x7f5c38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c3805f150 0x7f5c38061610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5c50001010 tx=0x7f5c50015000).stop 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6014fe40 msgr2=0x7f5c601515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6014fe40 0x7f5c601515a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f5c48004790 tx=0x7f5c48001e50).stop 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 shutdown_connections 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f5c3805f150 0x7f5c38061610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c40003910 0x7f5c60096810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c60151a90 0x7f5c60167130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.734+0000 7f5c66600700 1 --2- 172.21.15.100:0/3205006171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6014fe40 0x7f5c601515a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.735+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 >> 172.21.15.100:0/3205006171 conn(0x7f5c60092250 msgr2=0x7f5c600adb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.735+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 shutdown_connections 2024-01-22T05:40:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:16.735+0000 7f5c66600700 1 -- 172.21.15.100:0/3205006171 wait complete. 2024-01-22T05:40:16.750 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T05:40:16.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T05:40:16.751 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-22T05:40:16.751 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T05:40:16.751 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:16.751 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T05:40:16.751 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T05:40:16.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T05:40:16.751 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:40:16.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:16.751 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-22T05:40:16.796 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:16.797 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 40774sec preferred_lft 40774sec 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:16.798 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f05d:9bff:feba:b90d/64 scope link 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 1e:0c:7c:73:80:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::1c0c:7cff:fe73:80ca/64 scope link 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether e6:39:c6:eb:cb:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::e439:c6ff:feeb:cbd7/64 scope link 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-22T05:40:16.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:16.800 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T05:40:16.900 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-22T05:40:16.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:16.903 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-22T05:40:16.949 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-22T05:40:16.950 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T05:40:16.950 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T05:40:16.950 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T05:40:16.950 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T05:40:16.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:16.951 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-22T05:40:16.951 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-22T05:40:16.951 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T05:40:16.951 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T05:40:16.951 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T05:40:16.951 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-22T05:40:17.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:17.111 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:40:17.155 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:40:17.155 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:40:17.156 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:40:17.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:17.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-22T05:40:17.264 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-22T05:40:17.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:17.264 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:17.309 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T05:40:17.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:40:17.416 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:40:17.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:40:17.480 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:40:17.482 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:40:17.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:17.483 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:40:17.526 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-22T05:40:17.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:17.571 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-01-22T05:40:17.637 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-22T05:40:17.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-22T05:40:17.703 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-22T05:40:17.706 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-22T05:40:17.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:17.706 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-01-22T05:40:17.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-01-22T05:40:17.725+0000 7f1aa222c3c0 -1 init, newargv = 0x563c18524ce0 newargc=15 2024-01-22T05:40:17.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[89157]: starting ceph client 2024-01-22T05:40:17.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[89157]: starting fuse 2024-01-22T05:40:17.755 INFO:teuthology.orchestra.run.smithi100.stdout:43 2024-01-22T05:40:17.756 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-22T05:40:17.756 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-01-22T05:40:17.757 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:40:17.935 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.89157.asok 2024-01-22T05:40:18.113 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.89157.asok 2024-01-22T05:40:18.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:18.113 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.89157.asok status 2024-01-22T05:40:18.331 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:18.331 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9854ba8e5f82e4476d4c6c06dd8feefca92b8b32", 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 16.2.14-452-g9854ba8e (9854ba8e5f82e4476d4c6c06dd8feefca92b8b32) pacific (stable)", 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "89157", 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5634, 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-01-22T05:40:18.332 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5634 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 321572308 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 321572308 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5634 192.168.0.1:0/321572308", 2024-01-22T05:40:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/321572308", 2024-01-22T05:40:18.334 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-01-22T05:40:18.334 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 24, 2024-01-22T05:40:18.334 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 52, 2024-01-22T05:40:18.334 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-01-22T05:40:18.334 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-01-22T05:40:18.334 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-01-22T05:40:18.334 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:18.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:18.345 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-01-22T05:40:18.345 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:18.390 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-01-22T05:40:18.390 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:18.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-22T05:40:18.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:18.496 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-22T05:40:18.496 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-01-22T05:40:18.496 DEBUG:teuthology.orchestra.run.smithi100:> import errno 2024-01-22T05:40:18.496 DEBUG:teuthology.orchestra.run.smithi100:> 2024-01-22T05:40:18.496 DEBUG:teuthology.orchestra.run.smithi100:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-01-22T05:40:18.496 DEBUG:teuthology.orchestra.run.smithi100:> try: 2024-01-22T05:40:18.496 DEBUG:teuthology.orchestra.run.smithi100:> if True: 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> ret = os.read(fd, 1024) 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> else: 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> os.write(fd, b'"'"'content'"'"') 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> except OSError as e: 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> if e.errno != errno.EPERM: 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> raise 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> else: 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("client does not check permission of data pool") 2024-01-22T05:40:18.497 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-01-22T05:40:18.611 INFO:teuthology.orchestra.run.smithi100.stderr:Traceback (most recent call last): 2024-01-22T05:40:18.611 INFO:teuthology.orchestra.run.smithi100.stderr: File "", line 15, in 2024-01-22T05:40:18.611 INFO:teuthology.orchestra.run.smithi100.stderr:RuntimeError: client does not check permission of data pool 2024-01-22T05:40:18.785 INFO:teuthology.orchestra.run.smithi100.stderr:daemon-helper: command failed with exit status 1 2024-01-22T05:40:18.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:40:18.793 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-01-22T05:40:19.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.021+0000 7fafefe00700 1 Processor -- start 2024-01-22T05:40:19.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.021+0000 7fafefe00700 1 -- start start 2024-01-22T05:40:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.022+0000 7fafefe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c5340 0x7fafe8064c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.022+0000 7fafefe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafe80c5e30 0x7fafe80c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.022+0000 7fafefe00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80c7060 con 0x7fafe80c6c00 2024-01-22T05:40:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.022+0000 7fafefe00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe80c62e0 con 0x7fafe80c5e30 2024-01-22T05:40:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.022+0000 7fafefe00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c2760 con 0x7fafe80c5340 2024-01-22T05:40:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.022+0000 7fafede00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafe80c5e30 0x7fafe80c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafede00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafe80c5e30 0x7fafe80c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41720/0 (socket says 172.21.15.100:41720) 2024-01-22T05:40:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafede00700 1 -- 172.21.15.100:0/3922347609 learned_addr learned my addr 172.21.15.100:0/3922347609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafed400700 1 --2- 172.21.15.100:0/3922347609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c5340 0x7fafe8064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafede00700 1 -- 172.21.15.100:0/3922347609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c5340 msgr2=0x7fafe8064c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafede00700 1 --2- 172.21.15.100:0/3922347609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c5340 0x7fafe8064c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafede00700 1 -- 172.21.15.100:0/3922347609 >> v1:172.21.15.169:6789/0 conn(0x7fafe80c6c00 legacy=0x7fafe80c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafede00700 1 -- 172.21.15.100:0/3922347609 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80c6820 con 0x7fafe80c5e30 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafede00700 1 --2- 172.21.15.100:0/3922347609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe80c2270 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fafe0009f20 tx=0x7fafe0009840).ready entity=mon.0 client_cookie=91f77aef55747900 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafe7e00700 1 -- 172.21.15.100:0/3922347609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000e070 con 0x7fafe80c5e30 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafe7e00700 1 -- 172.21.15.100:0/3922347609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000b9d0 con 0x7fafe80c5e30 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.023+0000 7fafe7e00700 1 -- 172.21.15.100:0/3922347609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000bd50 con 0x7fafe80c5e30 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 -- 172.21.15.100:0/3922347609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 msgr2=0x7fafe80c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 --2- 172.21.15.100:0/3922347609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe80c2270 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fafe0009f20 tx=0x7fafe0009840).stop 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 -- 172.21.15.100:0/3922347609 shutdown_connections 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 --2- 172.21.15.100:0/3922347609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe80c2270 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 --2- 172.21.15.100:0/3922347609 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c5340 0x7fafe8064c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 -- 172.21.15.100:0/3922347609 >> 172.21.15.100:0/3922347609 conn(0x7fafe80c3ca0 msgr2=0x7fafe80c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 -- 172.21.15.100:0/3922347609 shutdown_connections 2024-01-22T05:40:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.024+0000 7fafefe00700 1 -- 172.21.15.100:0/3922347609 wait complete. 2024-01-22T05:40:19.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.026+0000 7fafefe00700 1 Processor -- start 2024-01-22T05:40:19.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.026+0000 7fafefe00700 1 -- start start 2024-01-22T05:40:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafefe00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafe80c5340 0x7fafe81582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafefe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe8167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafefe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c6c00 0x7fafe813e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafefe00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe8159950 con 0x7fafe80c5e30 2024-01-22T05:40:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafefe00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81588b0 con 0x7fafe80c5340 2024-01-22T05:40:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafefe00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe8158b90 con 0x7fafe80c6c00 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe8167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe8167fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41724/0 (socket says 172.21.15.100:41724) 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 -- 172.21.15.100:0/1224336174 learned_addr learned my addr 172.21.15.100:0/1224336174 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafede00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c6c00 0x7fafe813e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafed400700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafe80c5340 0x7fafe81582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 -- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c6c00 msgr2=0x7fafe813e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c6c00 0x7fafe813e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 -- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafe80c5340 msgr2=0x7fafe81582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafe80c5340 0x7fafe81582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.027+0000 7fafeca00700 1 -- 172.21.15.100:0/1224336174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0009ae0 con 0x7fafe80c5e30 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.028+0000 7fafeca00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe8167fb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fafd000c440 tx=0x7fafd0007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.028+0000 7fafe4c00700 1 -- 172.21.15.100:0/1224336174 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0007020 con 0x7fafe80c5e30 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.028+0000 7fafe4c00700 1 -- 172.21.15.100:0/1224336174 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd0007180 con 0x7fafe80c5e30 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.028+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe8158e70 con 0x7fafe80c5e30 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.028+0000 7fafe4c00700 1 -- 172.21.15.100:0/1224336174 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0007520 con 0x7fafe80c5e30 2024-01-22T05:40:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.028+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe8159430 con 0x7fafe80c5e30 2024-01-22T05:40:19.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.029+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe8159650 con 0x7fafe80c5e30 2024-01-22T05:40:19.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.030+0000 7fafe4c00700 1 -- 172.21.15.100:0/1224336174 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fafd00068b0 con 0x7fafe80c5e30 2024-01-22T05:40:19.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.031+0000 7fafe4c00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fafc005f150 0x7fafc0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:19.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.031+0000 7fafe4c00700 1 -- 172.21.15.100:0/1224336174 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fafd00798f0 con 0x7fafe80c5e30 2024-01-22T05:40:19.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.031+0000 7fafed400700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fafc005f150 0x7fafc0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:19.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.031+0000 7fafed400700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fafc005f150 0x7fafc0061610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fafd8009c30 tx=0x7fafd8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.034+0000 7fafe4c00700 1 -- 172.21.15.100:0/1224336174 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fafd004abc0 con 0x7fafe80c5e30 2024-01-22T05:40:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.269+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fafe80c7060 con 0x7fafe80c5e30 2024-01-22T05:40:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.272+0000 7fafe4c00700 1 -- 172.21.15.100:0/1224336174 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7fafe80c7060 con 0x7fafe80c5e30 2024-01-22T05:40:19.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fafc005f150 msgr2=0x7fafc0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:19.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fafc005f150 0x7fafc0061610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fafd8009c30 tx=0x7fafd8009060).stop 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 msgr2=0x7fafe8167fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe8167fb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fafd000c440 tx=0x7fafd0007dd0).stop 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 shutdown_connections 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fafc005f150 0x7fafc0061610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafe80c5340 0x7fafe81582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafe80c6c00 0x7fafe813e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 --2- 172.21.15.100:0/1224336174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe80c5e30 0x7fafe8167fb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 >> 172.21.15.100:0/1224336174 conn(0x7fafe80c3ca0 msgr2=0x7fafe80c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 shutdown_connections 2024-01-22T05:40:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:19.274+0000 7fafefe00700 1 -- 172.21.15.100:0/1224336174 wait complete. 2024-01-22T05:40:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-22T05:40:19.292 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T05:40:19.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:40:19.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T05:40:19.475 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T05:40:19.476 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-01-22T05:40:19.476 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-22T05:40:19.476 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-22T05:40:19.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[89157]: fuse finished with error 0 and tester_r 0 2024-01-22T05:40:19.542 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:40:19.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:19.542 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T05:40:19.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:40:19.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:19.700 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-22T05:40:19.748 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-01-22T05:40:19.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:40:19.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:40:19.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:19.749 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-22T05:40:19.793 INFO:teuthology.orchestra.run.smithi100.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-01-22T05:40:19.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:40:19.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:40:19.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:19.795 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-22T05:40:19.840 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-01-22T05:40:19.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:40:19.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:40:20.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.022+0000 7f3ab5600700 1 Processor -- start 2024-01-22T05:40:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.023+0000 7f3ab5600700 1 -- start start 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3ab5600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3ab0153c60 0x7f3ab0154040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3ab5600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab00c1900 0x7f3ab0066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3ab5600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00bc510 con 0x7f3ab0064c30 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3ab5600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00bc7f0 con 0x7f3ab0153c60 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3ab5600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c45b0 con 0x7f3ab00c1900 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3aaea00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3ab0153c60 0x7f3ab0154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3aaf400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3ab0064c30 0x7f3ab0065050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58268/0 (socket says 172.21.15.100:58268) 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3aaf400700 1 -- 172.21.15.100:0/4221019282 learned_addr learned my addr 172.21.15.100:0/4221019282 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.024+0000 7f3aae000700 1 --2- 172.21.15.100:0/4221019282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab00c1900 0x7f3ab0066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aaea00700 1 -- 172.21.15.100:0/4221019282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab00c1900 msgr2=0x7f3ab0066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aaea00700 1 --2- 172.21.15.100:0/4221019282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab00c1900 0x7f3ab0066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aaea00700 1 -- 172.21.15.100:0/4221019282 >> v1:172.21.15.100:6789/0 conn(0x7f3ab0064c30 legacy=0x7f3ab0065050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aaea00700 1 -- 172.21.15.100:0/4221019282 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00c4890 con 0x7f3ab0153c60 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aad600700 1 -- 172.21.15.100:0/4221019282 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266754827 0 0) 0x7f3ab00bc510 con 0x7f3ab0064c30 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aaea00700 1 --2- 172.21.15.100:0/4221019282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0153c60 0x7f3ab0154040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3aa0009760 tx=0x7f3aa0009060).ready entity=mon.0 client_cookie=512191d0a1533196 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aad600700 1 -- 172.21.15.100:0/4221019282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000f510 con 0x7f3ab0153c60 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aad600700 1 -- 172.21.15.100:0/4221019282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa000f670 con 0x7f3ab0153c60 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3aad600700 1 -- 172.21.15.100:0/4221019282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000f9f0 con 0x7f3ab0153c60 2024-01-22T05:40:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3ab5600700 1 -- 172.21.15.100:0/4221019282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0153c60 msgr2=0x7f3ab0154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.025+0000 7f3ab5600700 1 --2- 172.21.15.100:0/4221019282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0153c60 0x7f3ab0154040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3aa0009760 tx=0x7f3aa0009060).stop 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.026+0000 7f3ab5600700 1 -- 172.21.15.100:0/4221019282 shutdown_connections 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.026+0000 7f3ab5600700 1 --2- 172.21.15.100:0/4221019282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0153c60 0x7f3ab0154040 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.026+0000 7f3ab5600700 1 --2- 172.21.15.100:0/4221019282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab00c1900 0x7f3ab0066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.026+0000 7f3ab5600700 1 -- 172.21.15.100:0/4221019282 >> 172.21.15.100:0/4221019282 conn(0x7f3ab00c7d20 msgr2=0x7f3ab00c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.026+0000 7f3ab5600700 1 -- 172.21.15.100:0/4221019282 shutdown_connections 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.026+0000 7f3ab5600700 1 -- 172.21.15.100:0/4221019282 wait complete. 2024-01-22T05:40:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.027+0000 7f3ab5600700 1 Processor -- start 2024-01-22T05:40:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.027+0000 7f3ab5600700 1 -- start start 2024-01-22T05:40:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3ab5600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0064c30 0x7f3ab0164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3ab5600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab00c1900 0x7f3ab0150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3ab5600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab0153c60 0x7f3ab00abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3ab5600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0150e20 con 0x7f3ab0064c30 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3ab5600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00ac350 con 0x7f3ab00c1900 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3ab5600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00ac630 con 0x7f3ab0153c60 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3aaea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0064c30 0x7f3ab0164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3aaea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0064c30 0x7f3ab0164830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41736/0 (socket says 172.21.15.100:41736) 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.028+0000 7f3aaea00700 1 -- 172.21.15.100:0/3268932336 learned_addr learned my addr 172.21.15.100:0/3268932336 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aaf400700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab0153c60 0x7f3ab00abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aae000700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab00c1900 0x7f3ab0150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aaea00700 1 -- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab0153c60 msgr2=0x7f3ab00abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aaea00700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab0153c60 0x7f3ab00abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aaea00700 1 -- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab00c1900 msgr2=0x7f3ab0150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aaea00700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab00c1900 0x7f3ab0150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aaea00700 1 -- 172.21.15.100:0/3268932336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa00092a0 con 0x7f3ab0064c30 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aaea00700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0064c30 0x7f3ab0164830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3ab00688f0 tx=0x7f3aa0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aa6000700 1 -- 172.21.15.100:0/3268932336 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000f7e0 con 0x7f3ab0064c30 2024-01-22T05:40:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aa6000700 1 -- 172.21.15.100:0/3268932336 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa000f940 con 0x7f3ab0064c30 2024-01-22T05:40:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3aa6000700 1 -- 172.21.15.100:0/3268932336 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa001b690 con 0x7f3ab0064c30 2024-01-22T05:40:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00ac910 con 0x7f3ab0064c30 2024-01-22T05:40:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.029+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab00aced0 con 0x7f3ab0064c30 2024-01-22T05:40:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.031+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab0154370 con 0x7f3ab0064c30 2024-01-22T05:40:20.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.031+0000 7f3aa6000700 1 -- 172.21.15.100:0/3268932336 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3aa001ba80 con 0x7f3ab0064c30 2024-01-22T05:40:20.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.032+0000 7f3aa6000700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a8805f150 0x7f3a88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.032+0000 7f3aa6000700 1 -- 172.21.15.100:0/3268932336 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3aa007ba10 con 0x7f3ab0064c30 2024-01-22T05:40:20.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.032+0000 7f3aae000700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a8805f150 0x7f3a88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.033+0000 7f3aae000700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a8805f150 0x7f3a88061610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f3ab0157160 tx=0x7f3a98009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.036+0000 7f3aa6000700 1 -- 172.21.15.100:0/3268932336 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3aa004ccd0 con 0x7f3ab0064c30 2024-01-22T05:40:20.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.250+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ab00a6ca0 con 0x7f3ab0064c30 2024-01-22T05:40:20.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.250+0000 7f3aa6000700 1 -- 172.21.15.100:0/3268932336 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f3aa00502f0 con 0x7f3ab0064c30 2024-01-22T05:40:20.251 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:20.251 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4035127106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4035127106},{"type":"v1","addr":"172.21.15.169:6833","nonce":4035127106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2883555784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2883555784},{"type":"v1","addr":"172.21.15.169:6835","nonce":2883555784}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2387513263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2387513263},{"type":"v1","addr":"172.21.15.100:6836","nonce":2387513263}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:39:46.740767+0000","modified":"2024-01-22T05:39:50.173071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/2256257950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2256257950},{"type":"v1","addr":"172.21.15.100:6837","nonce":2256257950}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.252+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a8805f150 msgr2=0x7f3a88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.252+0000 7f3ab5600700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a8805f150 0x7f3a88061610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f3ab0157160 tx=0x7f3a98009060).stop 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.252+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0064c30 msgr2=0x7f3ab0164830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.252+0000 7f3ab5600700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0064c30 0x7f3ab0164830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3ab00688f0 tx=0x7f3aa0017000).stop 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 shutdown_connections 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a8805f150 0x7f3a88061610 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab0153c60 0x7f3ab00abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ab0064c30 0x7f3ab0164830 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 --2- 172.21.15.100:0/3268932336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab00c1900 0x7f3ab0150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 >> 172.21.15.100:0/3268932336 conn(0x7f3ab00c7d20 msgr2=0x7f3ab0152f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 shutdown_connections 2024-01-22T05:40:20.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.253+0000 7f3ab5600700 1 -- 172.21.15.100:0/3268932336 wait complete. 2024-01-22T05:40:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-01-22T05:40:20.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:40:20.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.456+0000 7fac38e00700 1 Processor -- start 2024-01-22T05:40:20.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.456+0000 7fac38e00700 1 -- start start 2024-01-22T05:40:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac38e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac340a5ab0 0x7fac340a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac38e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340c0fc0 0x7fac34069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac38e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac34065760 con 0x7fac3406a070 2024-01-22T05:40:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac38e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340bc340 con 0x7fac340a5ab0 2024-01-22T05:40:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac38e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3406a500 con 0x7fac340c0fc0 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac32800700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fac3406a070 0x7fac34153da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58280/0 (socket says 172.21.15.100:58280) 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac32800700 1 -- 172.21.15.100:0/2636904869 learned_addr learned my addr 172.21.15.100:0/2636904869 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.457+0000 7fac31400700 1 --2- 172.21.15.100:0/2636904869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340c0fc0 0x7fac34069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac31e00700 1 --2- 172.21.15.100:0/2636904869 >> v2:172.21.15.169:3300/0 conn(0x7fac340a5ab0 0x7fac340a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac30a00700 1 -- 172.21.15.100:0/2636904869 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855133117 0 0) 0x7fac34065760 con 0x7fac3406a070 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac30a00700 1 -- 172.21.15.100:0/2636904869 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac140033f0 con 0x7fac3406a070 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac31400700 1 -- 172.21.15.100:0/2636904869 >> v2:172.21.15.169:3300/0 conn(0x7fac340a5ab0 msgr2=0x7fac340a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac31400700 1 --2- 172.21.15.100:0/2636904869 >> v2:172.21.15.169:3300/0 conn(0x7fac340a5ab0 0x7fac340a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac31400700 1 -- 172.21.15.100:0/2636904869 >> v1:172.21.15.100:6789/0 conn(0x7fac3406a070 legacy=0x7fac34153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac31400700 1 -- 172.21.15.100:0/2636904869 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3406a780 con 0x7fac340c0fc0 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac31e00700 1 --2- 172.21.15.100:0/2636904869 >> v2:172.21.15.169:3300/0 conn(0x7fac340a5ab0 0x7fac340a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac31400700 1 --2- 172.21.15.100:0/2636904869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340c0fc0 0x7fac34069b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fac1c009760 tx=0x7fac1c009060).ready entity=mon.2 client_cookie=678e05609bcfa1dc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac30a00700 1 -- 172.21.15.100:0/2636904869 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0090d0 con 0x7fac340c0fc0 2024-01-22T05:40:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.458+0000 7fac30a00700 1 -- 172.21.15.100:0/2636904869 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c00d4a0 con 0x7fac340c0fc0 2024-01-22T05:40:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac30a00700 1 -- 172.21.15.100:0/2636904869 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00d820 con 0x7fac340c0fc0 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 -- 172.21.15.100:0/2636904869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340c0fc0 msgr2=0x7fac34069b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 --2- 172.21.15.100:0/2636904869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340c0fc0 0x7fac34069b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fac1c009760 tx=0x7fac1c009060).stop 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 -- 172.21.15.100:0/2636904869 shutdown_connections 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 --2- 172.21.15.100:0/2636904869 >> v2:172.21.15.169:3300/0 conn(0x7fac340a5ab0 0x7fac340a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 --2- 172.21.15.100:0/2636904869 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340c0fc0 0x7fac34069b80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 -- 172.21.15.100:0/2636904869 >> 172.21.15.100:0/2636904869 conn(0x7fac34063090 msgr2=0x7fac340c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 -- 172.21.15.100:0/2636904869 shutdown_connections 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.459+0000 7fac38e00700 1 -- 172.21.15.100:0/2636904869 wait complete. 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.461+0000 7fac38e00700 1 Processor -- start 2024-01-22T05:40:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.461+0000 7fac38e00700 1 -- start start 2024-01-22T05:40:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac38e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac3406a070 0x7fac340aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac38e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340a5ab0 0x7fac340a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac38e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac340c0fc0 0x7fac340a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac38e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340a5250 con 0x7fac340c0fc0 2024-01-22T05:40:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac38e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340ac2e0 con 0x7fac3406a070 2024-01-22T05:40:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac38e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340ab420 con 0x7fac340a5ab0 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac340c0fc0 0x7fac340a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac340c0fc0 0x7fac340a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41748/0 (socket says 172.21.15.100:41748) 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 -- 172.21.15.100:0/1823556424 learned_addr learned my addr 172.21.15.100:0/1823556424 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac31e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac3406a070 0x7fac340aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac31400700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340a5ab0 0x7fac340a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 -- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340a5ab0 msgr2=0x7fac340a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340a5ab0 0x7fac340a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 -- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac3406a070 msgr2=0x7fac340aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac3406a070 0x7fac340aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac32800700 1 -- 172.21.15.100:0/1823556424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240092a0 con 0x7fac340c0fc0 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac31e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac3406a070 0x7fac340aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.462+0000 7fac31400700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340a5ab0 0x7fac340a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.463+0000 7fac32800700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac340c0fc0 0x7fac340a4d60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fac2c005ad0 tx=0x7fac2c0015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.463+0000 7fac29600700 1 -- 172.21.15.100:0/1823556424 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c005d30 con 0x7fac340c0fc0 2024-01-22T05:40:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.463+0000 7fac29600700 1 -- 172.21.15.100:0/1823556424 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c005e90 con 0x7fac340c0fc0 2024-01-22T05:40:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.463+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c0092a0 con 0x7fac340c0fc0 2024-01-22T05:40:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.463+0000 7fac29600700 1 -- 172.21.15.100:0/1823556424 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c007320 con 0x7fac340c0fc0 2024-01-22T05:40:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.463+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac340ab9b0 con 0x7fac340c0fc0 2024-01-22T05:40:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.464+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac340ac470 con 0x7fac340c0fc0 2024-01-22T05:40:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.465+0000 7fac29600700 1 -- 172.21.15.100:0/1823556424 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fac2c007710 con 0x7fac340c0fc0 2024-01-22T05:40:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.466+0000 7fac29600700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fac0c05f150 0x7fac0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.466+0000 7fac29600700 1 -- 172.21.15.100:0/1823556424 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fac2c07a210 con 0x7fac340c0fc0 2024-01-22T05:40:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.466+0000 7fac31e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fac0c05f150 0x7fac0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.466+0000 7fac31e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fac0c05f150 0x7fac0c061610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fac24009270 tx=0x7fac24008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.469+0000 7fac29600700 1 -- 172.21.15.100:0/1823556424 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fac2c04b4a0 con 0x7fac340c0fc0 2024-01-22T05:40:20.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.639+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac3405fdb0 con 0x7fac340c0fc0 2024-01-22T05:40:20.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.640+0000 7fac29600700 1 -- 172.21.15.100:0/1823556424 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fac2c04eac0 con 0x7fac340c0fc0 2024-01-22T05:40:20.641 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:20.642 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":52,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:47.743074+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:39:44.885259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:39:45.737245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fac0c05f150 msgr2=0x7fac0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fac0c05f150 0x7fac0c061610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fac24009270 tx=0x7fac24008040).stop 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac340c0fc0 msgr2=0x7fac340a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac340c0fc0 0x7fac340a4d60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fac2c005ad0 tx=0x7fac2c0015b0).stop 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 shutdown_connections 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fac0c05f150 0x7fac0c061610 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac3406a070 0x7fac340aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac340c0fc0 0x7fac340a4d60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 --2- 172.21.15.100:0/1823556424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac340a5ab0 0x7fac340a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 >> 172.21.15.100:0/1823556424 conn(0x7fac34063090 msgr2=0x7fac340c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 shutdown_connections 2024-01-22T05:40:20.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.642+0000 7fac38e00700 1 -- 172.21.15.100:0/1823556424 wait complete. 2024-01-22T05:40:20.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-22T05:37:50.230655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-22T05:37:51.763565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T05:39:44.885259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T05:39:45.737245+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-22T05:40:20.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-22T05:40:20.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.845+0000 7f3a89200700 1 Processor -- start 2024-01-22T05:40:20.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.845+0000 7f3a89200700 1 -- start start 2024-01-22T05:40:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a89200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a84157290 0x7f3a84092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a89200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a840c5b80 0x7f3a840c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a89200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84065000 con 0x7f3a84092600 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a89200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a840643f0 con 0x7f3a84157290 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a89200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840646d0 con 0x7f3a840c5b80 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a81e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a84157290 0x7f3a84092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a81e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a84157290 0x7f3a84092110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41760/0 (socket says 172.21.15.100:41760) 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a81e00700 1 -- 172.21.15.100:0/133976391 learned_addr learned my addr 172.21.15.100:0/133976391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a82800700 1 --2- 172.21.15.100:0/133976391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a840c5b80 0x7f3a840c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a81e00700 1 -- 172.21.15.100:0/133976391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a840c5b80 msgr2=0x7f3a840c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a81e00700 1 --2- 172.21.15.100:0/133976391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a840c5b80 0x7f3a840c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a81e00700 1 -- 172.21.15.100:0/133976391 >> v1:172.21.15.169:6789/0 conn(0x7f3a84092600 legacy=0x7f3a840c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.847+0000 7f3a81e00700 1 -- 172.21.15.100:0/133976391 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840649b0 con 0x7f3a84157290 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a81e00700 1 --2- 172.21.15.100:0/133976391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84092110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3a74006fd0 tx=0x7f3a740090f0).ready entity=mon.0 client_cookie=25814e2982607e44 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a80a00700 1 -- 172.21.15.100:0/133976391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400b600 con 0x7f3a84157290 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a80a00700 1 -- 172.21.15.100:0/133976391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400b760 con 0x7f3a84157290 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a80a00700 1 -- 172.21.15.100:0/133976391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400bae0 con 0x7f3a84157290 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 -- 172.21.15.100:0/133976391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 msgr2=0x7f3a84092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 --2- 172.21.15.100:0/133976391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84092110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3a74006fd0 tx=0x7f3a740090f0).stop 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 -- 172.21.15.100:0/133976391 shutdown_connections 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 --2- 172.21.15.100:0/133976391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84092110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 --2- 172.21.15.100:0/133976391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a840c5b80 0x7f3a840c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 -- 172.21.15.100:0/133976391 >> 172.21.15.100:0/133976391 conn(0x7f3a8405e9d0 msgr2=0x7f3a84091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 -- 172.21.15.100:0/133976391 shutdown_connections 2024-01-22T05:40:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.848+0000 7f3a89200700 1 -- 172.21.15.100:0/133976391 wait complete. 2024-01-22T05:40:20.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.850+0000 7f3a89200700 1 Processor -- start 2024-01-22T05:40:20.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.850+0000 7f3a89200700 1 -- start start 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a89200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84092600 0x7f3a840c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a89200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a840c5b80 0x7f3a840c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a89200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a89200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840c21e0 con 0x7f3a84157290 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a89200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840c1400 con 0x7f3a840c5b80 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a89200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840abb50 con 0x7f3a84092600 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a82800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a82800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84163f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41766/0 (socket says 172.21.15.100:41766) 2024-01-22T05:40:20.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.851+0000 7f3a82800700 1 -- 172.21.15.100:0/3386307067 learned_addr learned my addr 172.21.15.100:0/3386307067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a81e00700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84092600 0x7f3a840c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a82800700 1 -- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84092600 msgr2=0x7f3a840c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a81400700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a840c5b80 0x7f3a840c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a82800700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84092600 0x7f3a840c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a82800700 1 -- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a840c5b80 msgr2=0x7f3a840c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a82800700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a840c5b80 0x7f3a840c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a82800700 1 -- 172.21.15.100:0/3386307067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009370 con 0x7f3a84157290 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a81e00700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84092600 0x7f3a840c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a81400700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a840c5b80 0x7f3a840c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:20.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a82800700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84163f20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f3a7c007f20 tx=0x7f3a7c0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a79600700 1 -- 172.21.15.100:0/3386307067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00ec40 con 0x7f3a84157290 2024-01-22T05:40:20.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a79600700 1 -- 172.21.15.100:0/3386307067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00eda0 con 0x7f3a84157290 2024-01-22T05:40:20.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a79600700 1 -- 172.21.15.100:0/3386307067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c014610 con 0x7f3a84157290 2024-01-22T05:40:20.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a840abe30 con 0x7f3a84157290 2024-01-22T05:40:20.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.852+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a841649e0 con 0x7f3a84157290 2024-01-22T05:40:20.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.853+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8405fdb0 con 0x7f3a84157290 2024-01-22T05:40:20.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.854+0000 7f3a79600700 1 -- 172.21.15.100:0/3386307067 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3a7c01d3b0 con 0x7f3a84157290 2024-01-22T05:40:20.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.855+0000 7f3a79600700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a5c05f150 0x7f3a5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:20.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.855+0000 7f3a79600700 1 -- 172.21.15.100:0/3386307067 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a7c07a7b0 con 0x7f3a84157290 2024-01-22T05:40:20.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.855+0000 7f3a81e00700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a5c05f150 0x7f3a5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:20.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.855+0000 7f3a81e00700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a5c05f150 0x7f3a5c061610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3a84096850 tx=0x7f3a74017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:20.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:20.858+0000 7f3a79600700 1 -- 172.21.15.100:0/3386307067 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3a7c04b960 con 0x7f3a84157290 2024-01-22T05:40:21.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.026+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3a84064c90 con 0x7f3a84157290 2024-01-22T05:40:21.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.027+0000 7f3a79600700 1 -- 172.21.15.100:0/3386307067 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v52) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3a7c04ef80 con 0x7f3a84157290 2024-01-22T05:40:21.028 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-22T05:40:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a5c05f150 msgr2=0x7f3a5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a5c05f150 0x7f3a5c061610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3a84096850 tx=0x7f3a74017000).stop 2024-01-22T05:40:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 msgr2=0x7f3a84163f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84163f20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f3a7c007f20 tx=0x7f3a7c0098a0).stop 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 shutdown_connections 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3a5c05f150 0x7f3a5c061610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84157290 0x7f3a84163f20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84092600 0x7f3a840c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 --2- 172.21.15.100:0/3386307067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a840c5b80 0x7f3a840c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 >> 172.21.15.100:0/3386307067 conn(0x7f3a8405e9d0 msgr2=0x7f3a840c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 shutdown_connections 2024-01-22T05:40:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.029+0000 7f3a89200700 1 -- 172.21.15.100:0/3386307067 wait complete. 2024-01-22T05:40:21.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-22T05:40:21.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.234+0000 7f69b6800700 1 Processor -- start 2024-01-22T05:40:21.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.234+0000 7f69b6800700 1 -- start start 2024-01-22T05:40:21.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.235+0000 7f69b6800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.235+0000 7f69b6800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f69b00c3ca0 0x7f69b00a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.235+0000 7f69b6800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b0155320 con 0x7f69b0150c80 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.235+0000 7f69b6800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b0154710 con 0x7f69b00c3ca0 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.235+0000 7f69b6800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01549f0 con 0x7f69b01508a0 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.235+0000 7f69aea00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f69b0150c80 0x7f69b00c3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58284/0 (socket says 172.21.15.100:58284) 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.235+0000 7f69aea00700 1 -- 172.21.15.100:0/146911051 learned_addr learned my addr 172.21.15.100:0/146911051 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69afe00700 1 --2- 172.21.15.100:0/146911051 >> v2:172.21.15.169:3300/0 conn(0x7f69b00c3ca0 0x7f69b00a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69af400700 1 --2- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69ae000700 1 -- 172.21.15.100:0/146911051 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108732746 0 0) 0x7f69b0155320 con 0x7f69b0150c80 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69ae000700 1 -- 172.21.15.100:0/146911051 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69900033f0 con 0x7f69b0150c80 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69afe00700 1 -- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 msgr2=0x7f69b00c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69afe00700 1 --2- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69afe00700 1 -- 172.21.15.100:0/146911051 >> v1:172.21.15.100:6789/0 conn(0x7f69b0150c80 legacy=0x7f69b00c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69ae000700 1 -- 172.21.15.100:0/146911051 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595748591 0 0) 0x7f69900033f0 con 0x7f69b0150c80 2024-01-22T05:40:21.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69afe00700 1 -- 172.21.15.100:0/146911051 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0154cd0 con 0x7f69b00c3ca0 2024-01-22T05:40:21.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.236+0000 7f69afe00700 1 --2- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b00c3ca0 0x7f69b00a56c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f69a8009e60 tx=0x7f69a8009780).ready entity=mon.1 client_cookie=55db1651edc1c85e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:21.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69ae000700 1 -- 172.21.15.100:0/146911051 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a800e070 con 0x7f69b00c3ca0 2024-01-22T05:40:21.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69ae000700 1 -- 172.21.15.100:0/146911051 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a800b7a0 con 0x7f69b00c3ca0 2024-01-22T05:40:21.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69ae000700 1 -- 172.21.15.100:0/146911051 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998001470 con 0x7f69b00c3ca0 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 -- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b00c3ca0 msgr2=0x7f69b00a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 --2- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b00c3ca0 0x7f69b00a56c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f69a8009e60 tx=0x7f69a8009780).stop 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 -- 172.21.15.100:0/146911051 shutdown_connections 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 --2- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b00c3ca0 0x7f69b00a56c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 --2- 172.21.15.100:0/146911051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 -- 172.21.15.100:0/146911051 >> 172.21.15.100:0/146911051 conn(0x7f69b00625f0 msgr2=0x7f69b0062a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 -- 172.21.15.100:0/146911051 shutdown_connections 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.237+0000 7f69b6800700 1 -- 172.21.15.100:0/146911051 wait complete. 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.239+0000 7f69b6800700 1 Processor -- start 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.239+0000 7f69b6800700 1 -- start start 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69b6800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69b00c3ca0 0x7f69b013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69b6800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69b6800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b0150c80 0x7f69b00bc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69b6800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b013ca70 con 0x7f69b00c3ca0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69b6800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b00ac380 con 0x7f69b0150c80 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69b6800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b00ac660 con 0x7f69b01508a0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69af400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69b00c3ca0 0x7f69b013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69af400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69b00c3ca0 0x7f69b013ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41772/0 (socket says 172.21.15.100:41772) 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.240+0000 7f69af400700 1 -- 172.21.15.100:0/958618337 learned_addr learned my addr 172.21.15.100:0/958618337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69afe00700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b0150c80 0x7f69b00bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69aea00700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69af400700 1 -- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 msgr2=0x7f69b00aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69af400700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69af400700 1 -- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b0150c80 msgr2=0x7f69b00bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69af400700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b0150c80 0x7f69b00bc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69af400700 1 -- 172.21.15.100:0/958618337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8009a20 con 0x7f69b00c3ca0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69af400700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69b00c3ca0 0x7f69b013ac20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f69a000e8d0 tx=0x7f69a0006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69a6a00700 1 -- 172.21.15.100:0/958618337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a000c640 con 0x7f69b00c3ca0 2024-01-22T05:40:21.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69a6a00700 1 -- 172.21.15.100:0/958618337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a000c7a0 con 0x7f69b00c3ca0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b013c700 con 0x7f69b00c3ca0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69a6a00700 1 -- 172.21.15.100:0/958618337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a000cb20 con 0x7f69b00c3ca0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.241+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b00abf40 con 0x7f69b00c3ca0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.242+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b013cd50 con 0x7f69b00c3ca0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.243+0000 7f69a6a00700 1 -- 172.21.15.100:0/958618337 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f69a001b400 con 0x7f69b00c3ca0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.244+0000 7f69a6a00700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f698805f150 0x7f6988061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.244+0000 7f69a6a00700 1 -- 172.21.15.100:0/958618337 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f69a007a740 con 0x7f69b00c3ca0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.244+0000 7f69aea00700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f698805f150 0x7f6988061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.244+0000 7f69aea00700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f698805f150 0x7f6988061610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f69b01651f0 tx=0x7f6998009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:21.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.248+0000 7f69a6a00700 1 -- 172.21.15.100:0/958618337 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f69a004b8f0 con 0x7f69b00c3ca0 2024-01-22T05:40:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.420+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69b006c680 con 0x7f69b00c3ca0 2024-01-22T05:40:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.420+0000 7f69a6a00700 1 -- 172.21.15.100:0/958618337 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f69a004ef10 con 0x7f69b00c3ca0 2024-01-22T05:40:21.421 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 8 2024-01-22T05:40:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f698805f150 msgr2=0x7f6988061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f698805f150 0x7f6988061610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f69b01651f0 tx=0x7f6998009040).stop 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69b00c3ca0 msgr2=0x7f69b013ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69b00c3ca0 0x7f69b013ac20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f69a000e8d0 tx=0x7f69a0006f40).stop 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 shutdown_connections 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f698805f150 0x7f6988061610 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69b0150c80 0x7f69b00bc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69b00c3ca0 0x7f69b013ac20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 --2- 172.21.15.100:0/958618337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69b01508a0 0x7f69b00aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 >> 172.21.15.100:0/958618337 conn(0x7f69b00625f0 msgr2=0x7f69b00c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 shutdown_connections 2024-01-22T05:40:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.422+0000 7f69b6800700 1 -- 172.21.15.100:0/958618337 wait complete. 2024-01-22T05:40:21.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T05:40:21.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.627+0000 7f535e200700 1 Processor -- start 2024-01-22T05:40:21.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.627+0000 7f535e200700 1 -- start start 2024-01-22T05:40:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.628+0000 7f535e200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f53580a9f60 0x7f53580aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f535e200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53580c74b0 con 0x7f535805e900 2024-01-22T05:40:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f535e200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5358158660 con 0x7f53580c1940 2024-01-22T05:40:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f535e200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5358158940 con 0x7f53580a9f60 2024-01-22T05:40:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5357400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f53580a9f60 0x7f53580aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5357e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f535805e900 0x7f5358098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58298/0 (socket says 172.21.15.100:58298) 2024-01-22T05:40:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5357e00700 1 -- 172.21.15.100:0/177609359 learned_addr learned my addr 172.21.15.100:0/177609359 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:21.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5356000700 1 -- 172.21.15.100:0/177609359 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877079151 0 0) 0x7f53580c74b0 con 0x7f535805e900 2024-01-22T05:40:21.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5356000700 1 -- 172.21.15.100:0/177609359 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53380033f0 con 0x7f535805e900 2024-01-22T05:40:21.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5357400700 1 -- 172.21.15.100:0/177609359 >> v1:172.21.15.169:6789/0 conn(0x7f53580c1940 legacy=0x7f535805e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5357400700 1 -- 172.21.15.100:0/177609359 >> v1:172.21.15.100:6789/0 conn(0x7f535805e900 legacy=0x7f5358098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.629+0000 7f5357400700 1 -- 172.21.15.100:0/177609359 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580c7140 con 0x7f53580a9f60 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f5357400700 1 --2- 172.21.15.100:0/177609359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580a9f60 0x7f53580aa340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f5348009760 tx=0x7f5348009060).ready entity=mon.0 client_cookie=9210e0cbdbebc057 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f5356000700 1 -- 172.21.15.100:0/177609359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800f510 con 0x7f53580a9f60 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f5356000700 1 -- 172.21.15.100:0/177609359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800f670 con 0x7f53580a9f60 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f5356000700 1 -- 172.21.15.100:0/177609359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800f9f0 con 0x7f53580a9f60 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f535e200700 1 -- 172.21.15.100:0/177609359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580a9f60 msgr2=0x7f53580aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f535e200700 1 --2- 172.21.15.100:0/177609359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580a9f60 0x7f53580aa340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f5348009760 tx=0x7f5348009060).stop 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f535e200700 1 -- 172.21.15.100:0/177609359 shutdown_connections 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f535e200700 1 --2- 172.21.15.100:0/177609359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580a9f60 0x7f53580aa340 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f535e200700 1 -- 172.21.15.100:0/177609359 >> 172.21.15.100:0/177609359 conn(0x7f53580cada0 msgr2=0x7f53580cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f535e200700 1 -- 172.21.15.100:0/177609359 shutdown_connections 2024-01-22T05:40:21.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.630+0000 7f535e200700 1 -- 172.21.15.100:0/177609359 wait complete. 2024-01-22T05:40:21.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.632+0000 7f535e200700 1 Processor -- start 2024-01-22T05:40:21.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.632+0000 7f535e200700 1 -- start start 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f535e200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f535805e900 0x7f5358144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f535e200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53580a9f60 0x7f53580c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f535e200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580c1940 0x7f53580cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f535e200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5358144e20 con 0x7f53580c1940 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f535e200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53580c31e0 con 0x7f53580a9f60 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f535e200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53580c3670 con 0x7f535805e900 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f5357e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580c1940 0x7f53580cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f5357e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580c1940 0x7f53580cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41786/0 (socket says 172.21.15.100:41786) 2024-01-22T05:40:21.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f5357e00700 1 -- 172.21.15.100:0/855592700 learned_addr learned my addr 172.21.15.100:0/855592700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:21.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f5357400700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f535805e900 0x7f5358144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.633+0000 7f5356a00700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53580a9f60 0x7f53580c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f5357e00700 1 -- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f535805e900 msgr2=0x7f5358144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f5357e00700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f535805e900 0x7f5358144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f5357e00700 1 -- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53580a9f60 msgr2=0x7f53580c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f5357e00700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53580a9f60 0x7f53580c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f5357e00700 1 -- 172.21.15.100:0/855592700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480092a0 con 0x7f53580c1940 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f5357e00700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580c1940 0x7f53580cb180 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f535000c790 tx=0x7f5350007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f534ea00700 1 -- 172.21.15.100:0/855592700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350005d30 con 0x7f53580c1940 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f534ea00700 1 -- 172.21.15.100:0/855592700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5350005e90 con 0x7f53580c1940 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53580c25d0 con 0x7f53580c1940 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f534ea00700 1 -- 172.21.15.100:0/855592700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350007320 con 0x7f53580c1940 2024-01-22T05:40:21.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.634+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53580c2b90 con 0x7f53580c1940 2024-01-22T05:40:21.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.635+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53580c3350 con 0x7f53580c1940 2024-01-22T05:40:21.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.636+0000 7f534ea00700 1 -- 172.21.15.100:0/855592700 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5350007750 con 0x7f53580c1940 2024-01-22T05:40:21.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.637+0000 7f534ea00700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f533005f150 0x7f5330061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:21.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.637+0000 7f534ea00700 1 -- 172.21.15.100:0/855592700 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f535007a120 con 0x7f53580c1940 2024-01-22T05:40:21.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.637+0000 7f5357400700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f533005f150 0x7f5330061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:21.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.638+0000 7f5357400700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f533005f150 0x7f5330061610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f5348009760 tx=0x7f5348017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:21.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.641+0000 7f534ea00700 1 -- 172.21.15.100:0/855592700 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f535004b3f0 con 0x7f53580c1940 2024-01-22T05:40:21.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.810+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53580ca030 con 0x7f53580c1940 2024-01-22T05:40:21.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.810+0000 7f534ea00700 1 -- 172.21.15.100:0/855592700 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f535004ea10 con 0x7f53580c1940 2024-01-22T05:40:21.811 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:40:21.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f533005f150 msgr2=0x7f5330061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f533005f150 0x7f5330061610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f5348009760 tx=0x7f5348017000).stop 2024-01-22T05:40:21.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580c1940 msgr2=0x7f53580cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:21.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580c1940 0x7f53580cb180 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f535000c790 tx=0x7f5350007f90).stop 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 shutdown_connections 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f533005f150 0x7f5330061610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53580c1940 0x7f53580cb180 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f535805e900 0x7f5358144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 --2- 172.21.15.100:0/855592700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53580a9f60 0x7f53580c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 >> 172.21.15.100:0/855592700 conn(0x7f53580cada0 msgr2=0x7f53580ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 shutdown_connections 2024-01-22T05:40:21.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:21.812+0000 7f535e200700 1 -- 172.21.15.100:0/855592700 wait complete. 2024-01-22T05:40:21.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T05:40:22.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.015+0000 7fdb79800700 1 Processor -- start 2024-01-22T05:40:22.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.015+0000 7fdb79800700 1 -- start start 2024-01-22T05:40:22.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.016+0000 7fdb79800700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdb740c0e10 0x7fdb740aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.016+0000 7fdb79800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740c74b0 con 0x7fdb7405e900 2024-01-22T05:40:22.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.016+0000 7fdb79800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb74158660 con 0x7fdb740a9f60 2024-01-22T05:40:22.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.016+0000 7fdb79800700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb74158940 con 0x7fdb740c0e10 2024-01-22T05:40:22.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb72000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdb7405e900 0x7fdb74098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58306/0 (socket says 172.21.15.100:58306) 2024-01-22T05:40:22.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb72000700 1 -- 172.21.15.100:0/1155625579 learned_addr learned my addr 172.21.15.100:0/1155625579 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:22.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb73400700 1 --2- 172.21.15.100:0/1155625579 >> v2:172.21.15.169:3300/0 conn(0x7fdb740c0e10 0x7fdb740aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636377081 0 0) 0x7fdb740c74b0 con 0x7fdb7405e900 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb540033f0 con 0x7fdb7405e900 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224593888 0 0) 0x7fdb540033f0 con 0x7fdb7405e900 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 >> v2:172.21.15.169:3300/0 conn(0x7fdb740c0e10 msgr2=0x7fdb740aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 --2- 172.21.15.100:0/1155625579 >> v2:172.21.15.169:3300/0 conn(0x7fdb740c0e10 0x7fdb740aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 >> v1:172.21.15.169:6789/0 conn(0x7fdb740a9f60 legacy=0x7fdb7405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740c7140 con 0x7fdb7405e900 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7fdb5c001470 con 0x7fdb7405e900 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.017+0000 7fdb73400700 1 --2- 172.21.15.100:0/1155625579 >> v2:172.21.15.169:3300/0 conn(0x7fdb740c0e10 0x7fdb740aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 >> v1:172.21.15.100:6789/0 conn(0x7fdb7405e900 legacy=0x7fdb74098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb71600700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb540038e0 0x7fdb54003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb71600700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54004690 0x7fdb54004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb71600700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb54005000 0x7fdb5400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74158940 con 0x7fdb54005000 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5400bf60 con 0x7fdb54004690 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5400c0f0 con 0x7fdb540038e0 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb54005000 0x7fdb5400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb72000700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54004690 0x7fdb54004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb72a00700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb540038e0 0x7fdb54003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 -- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb540038e0 msgr2=0x7fdb54003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb540038e0 0x7fdb54003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 -- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54004690 msgr2=0x7fdb54004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54004690 0x7fdb54004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 -- 172.21.15.100:0/1155625579 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540033f0 con 0x7fdb54005000 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 -- 172.21.15.100:0/1155625579 reap_dead start 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.018+0000 7fdb73400700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb54005000 0x7fdb5400b8e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fdb740aa830 tx=0x7fdb6c00b040).ready entity=mon.0 client_cookie=770e17e7204fe023 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c009c50 con 0x7fdb54005000 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c00f040 con 0x7fdb54005000 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb71600700 1 -- 172.21.15.100:0/1155625579 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00ee50 con 0x7fdb54005000 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb79800700 1 -- 172.21.15.100:0/1155625579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb54005000 msgr2=0x7fdb5400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb79800700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb54005000 0x7fdb5400b8e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fdb740aa830 tx=0x7fdb6c00b040).stop 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb79800700 1 -- 172.21.15.100:0/1155625579 shutdown_connections 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb79800700 1 --2- 172.21.15.100:0/1155625579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb54005000 0x7fdb5400b8e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb79800700 1 -- 172.21.15.100:0/1155625579 >> 172.21.15.100:0/1155625579 conn(0x7fdb740cada0 msgr2=0x7fdb740cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb79800700 1 -- 172.21.15.100:0/1155625579 shutdown_connections 2024-01-22T05:40:22.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.019+0000 7fdb79800700 1 -- 172.21.15.100:0/1155625579 wait complete. 2024-01-22T05:40:22.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.021+0000 7fdb79800700 1 Processor -- start 2024-01-22T05:40:22.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.021+0000 7fdb79800700 1 -- start start 2024-01-22T05:40:22.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb79800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54005000 0x7fdb74156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb79800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb74151790 0x7fdb74167aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb79800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74167f90 0x7fdb740c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb79800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74168410 con 0x7fdb74167f90 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb79800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb741564a0 con 0x7fdb54005000 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb79800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74168610 con 0x7fdb74151790 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb73400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74167f90 0x7fdb740c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb73400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74167f90 0x7fdb740c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41808/0 (socket says 172.21.15.100:41808) 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb73400700 1 -- 172.21.15.100:0/3313207214 learned_addr learned my addr 172.21.15.100:0/3313207214 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb72a00700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54005000 0x7fdb74156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.022+0000 7fdb72000700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb74151790 0x7fdb74167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb73400700 1 -- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb74151790 msgr2=0x7fdb74167aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb73400700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb74151790 0x7fdb74167aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb73400700 1 -- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54005000 msgr2=0x7fdb74156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb73400700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54005000 0x7fdb74156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb73400700 1 -- 172.21.15.100:0/3313207214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74155e50 con 0x7fdb74167f90 2024-01-22T05:40:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb73400700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74167f90 0x7fdb740c3b70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fdb740ca5a0 tx=0x7fdb6c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb6a000700 1 -- 172.21.15.100:0/3313207214 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c009c50 con 0x7fdb74167f90 2024-01-22T05:40:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb6a000700 1 -- 172.21.15.100:0/3313207214 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c01e5f0 con 0x7fdb74167f90 2024-01-22T05:40:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb74156130 con 0x7fdb74167f90 2024-01-22T05:40:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb6a000700 1 -- 172.21.15.100:0/3313207214 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c01e9b0 con 0x7fdb74167f90 2024-01-22T05:40:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.023+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb74156e20 con 0x7fdb74167f90 2024-01-22T05:40:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.024+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb74156650 con 0x7fdb74167f90 2024-01-22T05:40:22.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.025+0000 7fdb6a000700 1 -- 172.21.15.100:0/3313207214 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdb6c01b040 con 0x7fdb74167f90 2024-01-22T05:40:22.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.026+0000 7fdb6a000700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdb4c05f150 0x7fdb4c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.026+0000 7fdb6a000700 1 -- 172.21.15.100:0/3313207214 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb6c07bfc0 con 0x7fdb74167f90 2024-01-22T05:40:22.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.026+0000 7fdb72a00700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdb4c05f150 0x7fdb4c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.026+0000 7fdb72a00700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdb4c05f150 0x7fdb4c061610 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fdb64007fd0 tx=0x7fdb64007bb0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.030+0000 7fdb6a000700 1 -- 172.21.15.100:0/3313207214 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb74156650 con 0x7fdb74167f90 2024-01-22T05:40:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.201+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb74156610 con 0x7fdb74167f90 2024-01-22T05:40:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.202+0000 7fdb6a000700 1 -- 172.21.15.100:0/3313207214 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb6c017030 con 0x7fdb74167f90 2024-01-22T05:40:22.203 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-22T05:40:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdb4c05f150 msgr2=0x7fdb4c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdb4c05f150 0x7fdb4c061610 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fdb64007fd0 tx=0x7fdb64007bb0).stop 2024-01-22T05:40:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74167f90 msgr2=0x7fdb740c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74167f90 0x7fdb740c3b70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fdb740ca5a0 tx=0x7fdb6c018000).stop 2024-01-22T05:40:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 shutdown_connections 2024-01-22T05:40:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdb4c05f150 0x7fdb4c061610 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb54005000 0x7fdb74156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74167f90 0x7fdb740c3b70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 --2- 172.21.15.100:0/3313207214 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdb74151790 0x7fdb74167aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 >> 172.21.15.100:0/3313207214 conn(0x7fdb740cada0 msgr2=0x7fdb740cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 shutdown_connections 2024-01-22T05:40:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.204+0000 7fdb79800700 1 -- 172.21.15.100:0/3313207214 wait complete. 2024-01-22T05:40:22.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:40:22.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.407+0000 7f8ba6e00700 1 Processor -- start 2024-01-22T05:40:22.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.407+0000 7f8ba6e00700 1 -- start start 2024-01-22T05:40:22.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.408+0000 7f8ba6e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8ba00668e0 0x7f8ba00c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.408+0000 7f8ba6e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ba0064950 0x7f8ba00c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.408+0000 7f8ba6e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba01546c0 con 0x7f8ba0064dd0 2024-01-22T05:40:22.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.408+0000 7f8ba6e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba00bc180 con 0x7f8ba0064950 2024-01-22T05:40:22.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.408+0000 7f8ba6e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba00bc460 con 0x7f8ba00668e0 2024-01-22T05:40:22.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ba0064950 0x7f8ba00c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ba0064950 0x7f8ba00c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41814/0 (socket says 172.21.15.100:41814) 2024-01-22T05:40:22.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 -- 172.21.15.100:0/2508793078 learned_addr learned my addr 172.21.15.100:0/2508793078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:22.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9fe00700 1 --2- 172.21.15.100:0/2508793078 >> v2:172.21.15.169:3300/0 conn(0x7f8ba00668e0 0x7f8ba00c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 -- 172.21.15.100:0/2508793078 >> v2:172.21.15.169:3300/0 conn(0x7f8ba00668e0 msgr2=0x7f8ba00c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 --2- 172.21.15.100:0/2508793078 >> v2:172.21.15.169:3300/0 conn(0x7f8ba00668e0 0x7f8ba00c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 -- 172.21.15.100:0/2508793078 >> v1:172.21.15.169:6789/0 conn(0x7f8ba0064dd0 legacy=0x7f8ba00bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 -- 172.21.15.100:0/2508793078 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba00bc740 con 0x7f8ba0064950 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9fe00700 1 --2- 172.21.15.100:0/2508793078 >> v2:172.21.15.169:3300/0 conn(0x7f8ba00668e0 0x7f8ba00c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.409+0000 7f8b9f400700 1 --2- 172.21.15.100:0/2508793078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064950 0x7f8ba00c27f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f8ba0067a80 tx=0x7f8b880090f0).ready entity=mon.0 client_cookie=a7abf05673b275af server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8b9ea00700 1 -- 172.21.15.100:0/2508793078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800b5a0 con 0x7f8ba0064950 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8b9ea00700 1 -- 172.21.15.100:0/2508793078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800b700 con 0x7f8ba0064950 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8b9ea00700 1 -- 172.21.15.100:0/2508793078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800ba80 con 0x7f8ba0064950 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2508793078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064950 msgr2=0x7f8ba00c27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2508793078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064950 0x7f8ba00c27f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f8ba0067a80 tx=0x7f8b880090f0).stop 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2508793078 shutdown_connections 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2508793078 >> v2:172.21.15.169:3300/0 conn(0x7f8ba00668e0 0x7f8ba00c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2508793078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064950 0x7f8ba00c27f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2508793078 >> 172.21.15.100:0/2508793078 conn(0x7f8ba00c78d0 msgr2=0x7f8ba00c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:22.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2508793078 shutdown_connections 2024-01-22T05:40:22.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.410+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2508793078 wait complete. 2024-01-22T05:40:22.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.412+0000 7f8ba6e00700 1 Processor -- start 2024-01-22T05:40:22.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.412+0000 7f8ba6e00700 1 -- start start 2024-01-22T05:40:22.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8ba6e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba0064950 0x7f8ba0093e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8ba6e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064dd0 0x7f8ba0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8ba6e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ba00668e0 0x7f8ba0157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8ba6e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00939a0 con 0x7f8ba0064dd0 2024-01-22T05:40:22.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8ba6e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0094320 con 0x7f8ba0064950 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8ba6e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0092d90 con 0x7f8ba00668e0 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8b9f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064dd0 0x7f8ba0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8b9f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064dd0 0x7f8ba0151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41824/0 (socket says 172.21.15.100:41824) 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8b9f400700 1 -- 172.21.15.100:0/2735386997 learned_addr learned my addr 172.21.15.100:0/2735386997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8b9fe00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba0064950 0x7f8ba0093e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.413+0000 7f8ba4e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ba00668e0 0x7f8ba0157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b9f400700 1 -- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ba00668e0 msgr2=0x7f8ba0157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b9f400700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ba00668e0 0x7f8ba0157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b9f400700 1 -- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba0064950 msgr2=0x7f8ba0093e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b9f400700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba0064950 0x7f8ba0093e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b9f400700 1 -- 172.21.15.100:0/2735386997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88009370 con 0x7f8ba0064dd0 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8ba4e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ba00668e0 0x7f8ba0157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b9f400700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064dd0 0x7f8ba0151fd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f8b88006fd0 tx=0x7f8b88015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b97400700 1 -- 172.21.15.100:0/2735386997 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800b870 con 0x7f8ba0064dd0 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b97400700 1 -- 172.21.15.100:0/2735386997 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800b9d0 con 0x7f8ba0064dd0 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba0093070 con 0x7f8ba0064dd0 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8b97400700 1 -- 172.21.15.100:0/2735386997 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8801b620 con 0x7f8ba0064dd0 2024-01-22T05:40:22.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.414+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba0093630 con 0x7f8ba0064dd0 2024-01-22T05:40:22.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.415+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba0158680 con 0x7f8ba0064dd0 2024-01-22T05:40:22.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.416+0000 7f8b97400700 1 -- 172.21.15.100:0/2735386997 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8b8801ba10 con 0x7f8ba0064dd0 2024-01-22T05:40:22.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.417+0000 7f8b97400700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8b7805f150 0x7f8b78061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.417+0000 7f8b97400700 1 -- 172.21.15.100:0/2735386997 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8b8807bb30 con 0x7f8ba0064dd0 2024-01-22T05:40:22.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.417+0000 7f8b9fe00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8b7805f150 0x7f8b78061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.417+0000 7f8b9fe00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8b7805f150 0x7f8b78061610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f8b9000abd0 tx=0x7f8b90008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.421+0000 7f8b97400700 1 -- 172.21.15.100:0/2735386997 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8b8804cdf0 con 0x7f8ba0064dd0 2024-01-22T05:40:22.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.631+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ba005fdb0 con 0x7f8ba0064dd0 2024-01-22T05:40:22.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.631+0000 7f8b97400700 1 -- 172.21.15.100:0/2735386997 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f8b88050410 con 0x7f8ba0064dd0 2024-01-22T05:40:22.632 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:22.632 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4035127106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4035127106},{"type":"v1","addr":"172.21.15.169:6833","nonce":4035127106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2883555784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2883555784},{"type":"v1","addr":"172.21.15.169:6835","nonce":2883555784}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2387513263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2387513263},{"type":"v1","addr":"172.21.15.100:6836","nonce":2387513263}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:39:46.740767+0000","modified":"2024-01-22T05:39:50.173071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/2256257950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2256257950},{"type":"v1","addr":"172.21.15.100:6837","nonce":2256257950}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:40:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8b7805f150 msgr2=0x7f8b78061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8b7805f150 0x7f8b78061610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f8b9000abd0 tx=0x7f8b90008040).stop 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064dd0 msgr2=0x7f8ba0151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064dd0 0x7f8ba0151fd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f8b88006fd0 tx=0x7f8b88015000).stop 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 shutdown_connections 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f8b7805f150 0x7f8b78061610 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba0064950 0x7f8ba0093e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ba00668e0 0x7f8ba0157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 --2- 172.21.15.100:0/2735386997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0064dd0 0x7f8ba0151fd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.633+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 >> 172.21.15.100:0/2735386997 conn(0x7f8ba00c78d0 msgr2=0x7f8ba0152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.634+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 shutdown_connections 2024-01-22T05:40:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.634+0000 7f8ba6e00700 1 -- 172.21.15.100:0/2735386997 wait complete. 2024-01-22T05:40:22.636 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-01-22T05:40:22.652 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:40:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.835+0000 7fb2ba400700 1 Processor -- start 2024-01-22T05:40:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.835+0000 7fb2ba400700 1 -- start start 2024-01-22T05:40:22.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.836+0000 7fb2ba400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b4154060 0x7fb2b4154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.836+0000 7fb2ba400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2b40c64b0 0x7fb2b40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.836+0000 7fb2ba400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b40c1530 con 0x7fb2b40aa3f0 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.836+0000 7fb2ba400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b40cbb60 con 0x7fb2b40c64b0 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.836+0000 7fb2ba400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b40cb880 con 0x7fb2b4154060 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2b40c64b0 0x7fb2b40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2b40c64b0 0x7fb2b40c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41840/0 (socket says 172.21.15.100:41840) 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 -- 172.21.15.100:0/1165958881 learned_addr learned my addr 172.21.15.100:0/1165958881 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3400700 1 --2- 172.21.15.100:0/1165958881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b4154060 0x7fb2b4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 -- 172.21.15.100:0/1165958881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b4154060 msgr2=0x7fb2b4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 --2- 172.21.15.100:0/1165958881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b4154060 0x7fb2b4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 -- 172.21.15.100:0/1165958881 >> v1:172.21.15.169:6789/0 conn(0x7fb2b40aa3f0 legacy=0x7fb2b40c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 -- 172.21.15.100:0/1165958881 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40c17d0 con 0x7fb2b40c64b0 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.837+0000 7fb2b3e00700 1 --2- 172.21.15.100:0/1165958881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b40c64b0 0x7fb2b40c9950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fb2ac009f20 tx=0x7fb2ac009840).ready entity=mon.0 client_cookie=ce4dcf3df38e0607 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2b2000700 1 -- 172.21.15.100:0/1165958881 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00e070 con 0x7fb2b40c64b0 2024-01-22T05:40:22.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2b2000700 1 -- 172.21.15.100:0/1165958881 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac00b9d0 con 0x7fb2b40c64b0 2024-01-22T05:40:22.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2b2000700 1 -- 172.21.15.100:0/1165958881 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00bd50 con 0x7fb2b40c64b0 2024-01-22T05:40:22.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 -- 172.21.15.100:0/1165958881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b40c64b0 msgr2=0x7fb2b40c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 --2- 172.21.15.100:0/1165958881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b40c64b0 0x7fb2b40c9950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fb2ac009f20 tx=0x7fb2ac009840).stop 2024-01-22T05:40:22.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 -- 172.21.15.100:0/1165958881 shutdown_connections 2024-01-22T05:40:22.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 --2- 172.21.15.100:0/1165958881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b40c64b0 0x7fb2b40c9950 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 --2- 172.21.15.100:0/1165958881 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b4154060 0x7fb2b4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 -- 172.21.15.100:0/1165958881 >> 172.21.15.100:0/1165958881 conn(0x7fb2b405e9d0 msgr2=0x7fb2b40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:22.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 -- 172.21.15.100:0/1165958881 shutdown_connections 2024-01-22T05:40:22.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.838+0000 7fb2ba400700 1 -- 172.21.15.100:0/1165958881 wait complete. 2024-01-22T05:40:22.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.840+0000 7fb2ba400700 1 Processor -- start 2024-01-22T05:40:22.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.841+0000 7fb2ba400700 1 -- start start 2024-01-22T05:40:22.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2ba400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b40aa3f0 0x7fb2b40a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2ba400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b40c64b0 0x7fb2b41521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2ba400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b4154060 0x7fb2b41407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2ba400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41526a0 con 0x7fb2b4154060 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2ba400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4164020 con 0x7fb2b40aa3f0 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2ba400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b40a81d0 con 0x7fb2b40c64b0 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b4154060 0x7fb2b41407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b4154060 0x7fb2b41407b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41846/0 (socket says 172.21.15.100:41846) 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3e00700 1 -- 172.21.15.100:0/2407965300 learned_addr learned my addr 172.21.15.100:0/2407965300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b40aa3f0 0x7fb2b40a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b2a00700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b40c64b0 0x7fb2b41521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3e00700 1 -- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b40c64b0 msgr2=0x7fb2b41521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3e00700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b40c64b0 0x7fb2b41521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3e00700 1 -- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b40aa3f0 msgr2=0x7fb2b40a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.842+0000 7fb2b3e00700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b40aa3f0 0x7fb2b40a7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2b3e00700 1 -- 172.21.15.100:0/2407965300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac009ae0 con 0x7fb2b4154060 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2b2a00700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b40c64b0 0x7fb2b41521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:22.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2b3e00700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b4154060 0x7fb2b41407b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fb2ac010000 tx=0x7fb2b40c0470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2aaa00700 1 -- 172.21.15.100:0/2407965300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0092e0 con 0x7fb2b4154060 2024-01-22T05:40:22.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2aaa00700 1 -- 172.21.15.100:0/2407965300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac013e30 con 0x7fb2b4154060 2024-01-22T05:40:22.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b40a84b0 con 0x7fb2b4154060 2024-01-22T05:40:22.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2aaa00700 1 -- 172.21.15.100:0/2407965300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac01e6c0 con 0x7fb2b4154060 2024-01-22T05:40:22.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.843+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b41642e0 con 0x7fb2b4154060 2024-01-22T05:40:22.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.844+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b4164500 con 0x7fb2b4154060 2024-01-22T05:40:22.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.845+0000 7fb2aaa00700 1 -- 172.21.15.100:0/2407965300 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb2ac003040 con 0x7fb2b4154060 2024-01-22T05:40:22.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.845+0000 7fb2aaa00700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb28c05f120 0x7fb28c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:22.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.846+0000 7fb2aaa00700 1 -- 172.21.15.100:0/2407965300 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2ac07b760 con 0x7fb2b4154060 2024-01-22T05:40:22.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.846+0000 7fb2b3400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb28c05f120 0x7fb28c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:22.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.846+0000 7fb2b3400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb28c05f120 0x7fb28c0615e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fb2a4009b20 tx=0x7fb2a4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:22.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:22.850+0000 7fb2aaa00700 1 -- 172.21.15.100:0/2407965300 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb2ac04ca20 con 0x7fb2b4154060 2024-01-22T05:40:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.024+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2b406abb0 con 0x7fb2b4154060 2024-01-22T05:40:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.025+0000 7fb2aaa00700 1 -- 172.21.15.100:0/2407965300 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fb2ac023070 con 0x7fb2b4154060 2024-01-22T05:40:23.026 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:23.026 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":52,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:47.743074+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:39:44.885259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:39:45.737245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:40:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb28c05f120 msgr2=0x7fb28c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb28c05f120 0x7fb28c0615e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fb2a4009b20 tx=0x7fb2a4008040).stop 2024-01-22T05:40:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b4154060 msgr2=0x7fb2b41407b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b4154060 0x7fb2b41407b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fb2ac010000 tx=0x7fb2b40c0470).stop 2024-01-22T05:40:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 shutdown_connections 2024-01-22T05:40:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb28c05f120 0x7fb28c0615e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b40aa3f0 0x7fb2b40a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b4154060 0x7fb2b41407b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 --2- 172.21.15.100:0/2407965300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b40c64b0 0x7fb2b41521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 >> 172.21.15.100:0/2407965300 conn(0x7fb2b405e9d0 msgr2=0x7fb2b40ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 shutdown_connections 2024-01-22T05:40:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.027+0000 7fb2ba400700 1 -- 172.21.15.100:0/2407965300 wait complete. 2024-01-22T05:40:23.046 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:40:23.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:40:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.228+0000 7f6488000700 1 Processor -- start 2024-01-22T05:40:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.228+0000 7f6488000700 1 -- start start 2024-01-22T05:40:23.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.229+0000 7f6488000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800668e0 0x7f64800c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.229+0000 7f6488000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64801546c0 con 0x7f64800c2f00 2024-01-22T05:40:23.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.229+0000 7f6488000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64800bc180 con 0x7f6480064950 2024-01-22T05:40:23.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.229+0000 7f6488000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800bc460 con 0x7f64800668e0 2024-01-22T05:40:23.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f6486000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f64800c2f00 0x7f64800bd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43320/0 (socket says 172.21.15.100:43320) 2024-01-22T05:40:23.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f6486000700 1 -- 172.21.15.100:0/3605601322 learned_addr learned my addr 172.21.15.100:0/3605601322 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:23.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f6485600700 1 --2- 172.21.15.100:0/3605601322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800668e0 0x7f64800c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f647fe00700 1 -- 172.21.15.100:0/3605601322 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905928801 0 0) 0x7f64801546c0 con 0x7f64800c2f00 2024-01-22T05:40:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f647fe00700 1 -- 172.21.15.100:0/3605601322 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64600033f0 con 0x7f64800c2f00 2024-01-22T05:40:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f647fe00700 1 -- 172.21.15.100:0/3605601322 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861154232 0 0) 0x7f64800bc180 con 0x7f6480064950 2024-01-22T05:40:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f647fe00700 1 -- 172.21.15.100:0/3605601322 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64801546c0 con 0x7f6480064950 2024-01-22T05:40:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f6485600700 1 -- 172.21.15.100:0/3605601322 >> v1:172.21.15.169:6789/0 conn(0x7f6480064950 legacy=0x7f64800c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f6485600700 1 -- 172.21.15.100:0/3605601322 >> v1:172.21.15.100:6789/0 conn(0x7f64800c2f00 legacy=0x7f64800bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.230+0000 7f6485600700 1 -- 172.21.15.100:0/3605601322 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800bc740 con 0x7f64800668e0 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.231+0000 7f6485600700 1 --2- 172.21.15.100:0/3605601322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800668e0 0x7f64800c4200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6470009790 tx=0x7f6470009060).ready entity=mon.2 client_cookie=3ce9836299bc6566 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.231+0000 7f647fe00700 1 -- 172.21.15.100:0/3605601322 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647000f510 con 0x7f64800668e0 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.231+0000 7f647fe00700 1 -- 172.21.15.100:0/3605601322 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647000f670 con 0x7f64800668e0 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.231+0000 7f647fe00700 1 -- 172.21.15.100:0/3605601322 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647000f9f0 con 0x7f64800668e0 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.231+0000 7f6488000700 1 -- 172.21.15.100:0/3605601322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800668e0 msgr2=0x7f64800c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.231+0000 7f6488000700 1 --2- 172.21.15.100:0/3605601322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800668e0 0x7f64800c4200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6470009790 tx=0x7f6470009060).stop 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.232+0000 7f6488000700 1 -- 172.21.15.100:0/3605601322 shutdown_connections 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.232+0000 7f6488000700 1 --2- 172.21.15.100:0/3605601322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800668e0 0x7f64800c4200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.232+0000 7f6488000700 1 -- 172.21.15.100:0/3605601322 >> 172.21.15.100:0/3605601322 conn(0x7f64800c78d0 msgr2=0x7f64800c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.232+0000 7f6488000700 1 -- 172.21.15.100:0/3605601322 shutdown_connections 2024-01-22T05:40:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.232+0000 7f6488000700 1 -- 172.21.15.100:0/3605601322 wait complete. 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.233+0000 7f6488000700 1 Processor -- start 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.233+0000 7f6488000700 1 -- start start 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6488000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6480064950 0x7f64800a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6488000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64800668e0 0x7f648014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6488000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800c2f00 0x7f64800a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6488000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800a5a40 con 0x7f6480064950 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6488000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800a4e30 con 0x7f64800668e0 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6488000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800a5110 con 0x7f64800c2f00 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6485600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6480064950 0x7f64800a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6485600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6480064950 0x7f64800a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36106/0 (socket says 172.21.15.100:36106) 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.234+0000 7f6485600700 1 -- 172.21.15.100:0/2802442978 learned_addr learned my addr 172.21.15.100:0/2802442978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6486000700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800c2f00 0x7f64800a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6484c00700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64800668e0 0x7f648014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6485600700 1 -- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800c2f00 msgr2=0x7f64800a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6485600700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800c2f00 0x7f64800a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6485600700 1 -- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64800668e0 msgr2=0x7f648014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6485600700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64800668e0 0x7f648014e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6485600700 1 -- 172.21.15.100:0/2802442978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700092a0 con 0x7f6480064950 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6485600700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6480064950 0x7f64800a5ed0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f64800684a0 tx=0x7f6470017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f647cc00700 1 -- 172.21.15.100:0/2802442978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647000f7e0 con 0x7f6480064950 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f647cc00700 1 -- 172.21.15.100:0/2802442978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647000f940 con 0x7f6480064950 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64800a53f0 con 0x7f6480064950 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f647cc00700 1 -- 172.21.15.100:0/2802442978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647001b660 con 0x7f6480064950 2024-01-22T05:40:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.235+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648014eb40 con 0x7f6480064950 2024-01-22T05:40:23.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.237+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64800a5d20 con 0x7f6480064950 2024-01-22T05:40:23.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.237+0000 7f647cc00700 1 -- 172.21.15.100:0/2802442978 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f647001b9d0 con 0x7f6480064950 2024-01-22T05:40:23.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.238+0000 7f647cc00700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f645805f120 0x7f64580615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.238+0000 7f647cc00700 1 -- 172.21.15.100:0/2802442978 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f647007bd50 con 0x7f6480064950 2024-01-22T05:40:23.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.238+0000 7f6484c00700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f645805f120 0x7f64580615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.239+0000 7f6484c00700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f645805f120 0x7f64580615e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f648014f450 tx=0x7f6468009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:23.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.242+0000 7f647cc00700 1 -- 172.21.15.100:0/2802442978 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f647004cf60 con 0x7f6480064950 2024-01-22T05:40:23.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.455+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f648005fdb0 con 0x7f6480064950 2024-01-22T05:40:23.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.456+0000 7f647cc00700 1 -- 172.21.15.100:0/2802442978 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f6470050580 con 0x7f6480064950 2024-01-22T05:40:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:23.457 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4035127106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4035127106},{"type":"v1","addr":"172.21.15.169:6833","nonce":4035127106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2883555784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2883555784},{"type":"v1","addr":"172.21.15.169:6835","nonce":2883555784}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2387513263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2387513263},{"type":"v1","addr":"172.21.15.100:6836","nonce":2387513263}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:39:46.740767+0000","modified":"2024-01-22T05:39:50.173071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/2256257950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2256257950},{"type":"v1","addr":"172.21.15.100:6837","nonce":2256257950}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:40:23.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f645805f120 msgr2=0x7f64580615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f645805f120 0x7f64580615e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f648014f450 tx=0x7f6468009040).stop 2024-01-22T05:40:23.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6480064950 msgr2=0x7f64800a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6480064950 0x7f64800a5ed0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f64800684a0 tx=0x7f6470017000).stop 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 shutdown_connections 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f645805f120 0x7f64580615e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64800c2f00 0x7f64800a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6480064950 0x7f64800a5ed0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 --2- 172.21.15.100:0/2802442978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64800668e0 0x7f648014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 >> 172.21.15.100:0/2802442978 conn(0x7f64800c78d0 msgr2=0x7f64800c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 shutdown_connections 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.458+0000 7f6488000700 1 -- 172.21.15.100:0/2802442978 wait complete. 2024-01-22T05:40:23.460 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-01-22T05:40:23.476 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:40:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.658+0000 7f3712200700 1 Processor -- start 2024-01-22T05:40:23.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.658+0000 7f3712200700 1 -- start start 2024-01-22T05:40:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.659+0000 7f3712200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f370c0c45a0 0x7f370c0be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.659+0000 7f3712200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f370c0c7d30 0x7f370c0be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.659+0000 7f3712200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c0928b0 con 0x7f370c153ee0 2024-01-22T05:40:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.659+0000 7f3712200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0bef90 con 0x7f370c0c7d30 2024-01-22T05:40:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.659+0000 7f3712200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0bf270 con 0x7f370c0c45a0 2024-01-22T05:40:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f370c0c7d30 0x7f370c0be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f370c0c7d30 0x7f370c0be7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36114/0 (socket says 172.21.15.100:36114) 2024-01-22T05:40:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 -- 172.21.15.100:0/2412785902 learned_addr learned my addr 172.21.15.100:0/2412785902 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370aa00700 1 --2- 172.21.15.100:0/2412785902 >> v2:172.21.15.169:3300/0 conn(0x7f370c0c45a0 0x7f370c0be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 -- 172.21.15.100:0/2412785902 >> v2:172.21.15.169:3300/0 conn(0x7f370c0c45a0 msgr2=0x7f370c0be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 --2- 172.21.15.100:0/2412785902 >> v2:172.21.15.169:3300/0 conn(0x7f370c0c45a0 0x7f370c0be2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 -- 172.21.15.100:0/2412785902 >> v1:172.21.15.169:6789/0 conn(0x7f370c153ee0 legacy=0x7f370c0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 -- 172.21.15.100:0/2412785902 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0bfba0 con 0x7f370c0c7d30 2024-01-22T05:40:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.660+0000 7f370be00700 1 --2- 172.21.15.100:0/2412785902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c0c7d30 0x7f370c0be7c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f370c0ab960 tx=0x7f3704009840).ready entity=mon.0 client_cookie=cf5bbea76318381b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f370a000700 1 -- 172.21.15.100:0/2412785902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370400e070 con 0x7f370c0c7d30 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f370a000700 1 -- 172.21.15.100:0/2412785902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370400ba20 con 0x7f370c0c7d30 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f370a000700 1 -- 172.21.15.100:0/2412785902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370400bda0 con 0x7f370c0c7d30 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 -- 172.21.15.100:0/2412785902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c0c7d30 msgr2=0x7f370c0be7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 --2- 172.21.15.100:0/2412785902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c0c7d30 0x7f370c0be7c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f370c0ab960 tx=0x7f3704009840).stop 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 -- 172.21.15.100:0/2412785902 shutdown_connections 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 --2- 172.21.15.100:0/2412785902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c0c7d30 0x7f370c0be7c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 --2- 172.21.15.100:0/2412785902 >> v2:172.21.15.169:3300/0 conn(0x7f370c0c45a0 0x7f370c0be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 -- 172.21.15.100:0/2412785902 >> 172.21.15.100:0/2412785902 conn(0x7f370c091a00 msgr2=0x7f370c091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:23.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 -- 172.21.15.100:0/2412785902 shutdown_connections 2024-01-22T05:40:23.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.661+0000 7f3712200700 1 -- 172.21.15.100:0/2412785902 wait complete. 2024-01-22T05:40:23.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.663+0000 7f3712200700 1 Processor -- start 2024-01-22T05:40:23.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.663+0000 7f3712200700 1 -- start start 2024-01-22T05:40:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f3712200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c0c45a0 0x7f370c13f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f3712200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f370c0c7d30 0x7f370c0ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f3712200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c153ee0 0x7f370c067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f3712200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0c0dd0 con 0x7f370c153ee0 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f3712200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c13f830 con 0x7f370c0c45a0 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f3712200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0c01c0 con 0x7f370c0c7d30 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f370be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c153ee0 0x7f370c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f370be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c153ee0 0x7f370c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36120/0 (socket says 172.21.15.100:36120) 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f370be00700 1 -- 172.21.15.100:0/2769973359 learned_addr learned my addr 172.21.15.100:0/2769973359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f370aa00700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f370c0c7d30 0x7f370c0ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.664+0000 7f370b400700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c0c45a0 0x7f370c13f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f370be00700 1 -- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f370c0c7d30 msgr2=0x7f370c0ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f370be00700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f370c0c7d30 0x7f370c0ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f370be00700 1 -- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c0c45a0 msgr2=0x7f370c13f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f370be00700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c0c45a0 0x7f370c13f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f370be00700 1 -- 172.21.15.100:0/2769973359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009ae0 con 0x7f370c153ee0 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f370be00700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c153ee0 0x7f370c067550 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f370400b6c0 tx=0x7f3704009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f3702a00700 1 -- 172.21.15.100:0/2769973359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040092e0 con 0x7f370c153ee0 2024-01-22T05:40:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f3702a00700 1 -- 172.21.15.100:0/2769973359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370401e470 con 0x7f370c153ee0 2024-01-22T05:40:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f3702a00700 1 -- 172.21.15.100:0/2769973359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370401e830 con 0x7f370c153ee0 2024-01-22T05:40:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c0c04a0 con 0x7f370c153ee0 2024-01-22T05:40:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.665+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c0c0a60 con 0x7f370c153ee0 2024-01-22T05:40:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.666+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c05fdb0 con 0x7f370c153ee0 2024-01-22T05:40:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.667+0000 7f3702a00700 1 -- 172.21.15.100:0/2769973359 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3704003040 con 0x7f370c153ee0 2024-01-22T05:40:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.668+0000 7f3702a00700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f36e405f150 0x7f36e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.668+0000 7f3702a00700 1 -- 172.21.15.100:0/2769973359 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f370407bc10 con 0x7f370c153ee0 2024-01-22T05:40:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.668+0000 7f370b400700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f36e405f150 0x7f36e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.669+0000 7f370b400700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f36e405f150 0x7f36e4061610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f36fc007fd0 tx=0x7f36fc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:23.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.671+0000 7f3702a00700 1 -- 172.21.15.100:0/2769973359 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f370404cf50 con 0x7f370c153ee0 2024-01-22T05:40:23.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.881+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f370c0c0f10 con 0x7f370c153ee0 2024-01-22T05:40:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.882+0000 7f3702a00700 1 -- 172.21.15.100:0/2769973359 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f3704023070 con 0x7f370c153ee0 2024-01-22T05:40:23.883 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:23.883 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4035127106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4035127106},{"type":"v1","addr":"172.21.15.169:6833","nonce":4035127106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2883555784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2883555784},{"type":"v1","addr":"172.21.15.169:6835","nonce":2883555784}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2387513263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2387513263},{"type":"v1","addr":"172.21.15.100:6836","nonce":2387513263}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T05:39:46.740767+0000","modified":"2024-01-22T05:39:50.173071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/2256257950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2256257950},{"type":"v1","addr":"172.21.15.100:6837","nonce":2256257950}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-22T05:40:23.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f36e405f150 msgr2=0x7f36e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f36e405f150 0x7f36e4061610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f36fc007fd0 tx=0x7f36fc009040).stop 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c153ee0 msgr2=0x7f370c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c153ee0 0x7f370c067550 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f370400b6c0 tx=0x7f3704009840).stop 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 shutdown_connections 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f36e405f150 0x7f36e4061610 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c0c45a0 0x7f370c13f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f370c153ee0 0x7f370c067550 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 --2- 172.21.15.100:0/2769973359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f370c0c7d30 0x7f370c0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 >> 172.21.15.100:0/2769973359 conn(0x7f370c091a00 msgr2=0x7f370c0c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 shutdown_connections 2024-01-22T05:40:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:23.884+0000 7f3712200700 1 -- 172.21.15.100:0/2769973359 wait complete. 2024-01-22T05:40:23.887 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-01-22T05:40:23.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:40:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.086+0000 7fdd53a00700 1 Processor -- start 2024-01-22T05:40:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.086+0000 7fdd53a00700 1 -- start start 2024-01-22T05:40:24.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.087+0000 7fdd53a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdd4c153fb0 0x7fdd4c0c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.087+0000 7fdd53a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd4c0a7c90 0x7fdd4c0639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.087+0000 7fdd53a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c0c5d20 con 0x7fdd4c098920 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.087+0000 7fdd53a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c57a0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.087+0000 7fdd53a00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c16c0 con 0x7fdd4c153fb0 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd4be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd4c0a7c90 0x7fdd4c0639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd51a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdd4c098920 0x7fdd4c0c61b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43330/0 (socket says 172.21.15.100:43330) 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd51a00700 1 -- 172.21.15.100:0/3533190661 learned_addr learned my addr 172.21.15.100:0/3533190661 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:24.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd51000700 1 --2- 172.21.15.100:0/3533190661 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c153fb0 0x7fdd4c0c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd4be00700 1 -- 172.21.15.100:0/3533190661 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c153fb0 msgr2=0x7fdd4c0c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd4be00700 1 --2- 172.21.15.100:0/3533190661 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c153fb0 0x7fdd4c0c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd4be00700 1 -- 172.21.15.100:0/3533190661 >> v1:172.21.15.100:6789/0 conn(0x7fdd4c098920 legacy=0x7fdd4c0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd4be00700 1 -- 172.21.15.100:0/3533190661 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0c19a0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd4b400700 1 -- 172.21.15.100:0/3533190661 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003277827 0 0) 0x7fdd4c0c5d20 con 0x7fdd4c098920 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd51000700 1 --2- 172.21.15.100:0/3533190661 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c153fb0 0x7fdd4c0c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.088+0000 7fdd4be00700 1 --2- 172.21.15.100:0/3533190661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0639e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fdd4c084340 tx=0x7fdd34009060).ready entity=mon.0 client_cookie=aaa56ccf7a825eb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd4b400700 1 -- 172.21.15.100:0/3533190661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400b580 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd4b400700 1 -- 172.21.15.100:0/3533190661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400b6e0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd4b400700 1 -- 172.21.15.100:0/3533190661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400ba60 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 -- 172.21.15.100:0/3533190661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 msgr2=0x7fdd4c0639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 --2- 172.21.15.100:0/3533190661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0639e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fdd4c084340 tx=0x7fdd34009060).stop 2024-01-22T05:40:24.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 -- 172.21.15.100:0/3533190661 shutdown_connections 2024-01-22T05:40:24.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 --2- 172.21.15.100:0/3533190661 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c153fb0 0x7fdd4c0c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 --2- 172.21.15.100:0/3533190661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0639e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 -- 172.21.15.100:0/3533190661 >> 172.21.15.100:0/3533190661 conn(0x7fdd4c0c78a0 msgr2=0x7fdd4c0c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:24.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 -- 172.21.15.100:0/3533190661 shutdown_connections 2024-01-22T05:40:24.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.089+0000 7fdd53a00700 1 -- 172.21.15.100:0/3533190661 wait complete. 2024-01-22T05:40:24.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.091+0000 7fdd53a00700 1 Processor -- start 2024-01-22T05:40:24.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.091+0000 7fdd53a00700 1 -- start start 2024-01-22T05:40:24.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd53a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c098920 0x7fdd4c14caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd53a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd53a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c153fb0 0x7fdd4c0c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd53a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c3f10 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd53a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c3300 con 0x7fdd4c098920 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd53a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c35e0 con 0x7fdd4c153fb0 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd4be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd4be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36138/0 (socket says 172.21.15.100:36138) 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd4be00700 1 -- 172.21.15.100:0/1008735091 learned_addr learned my addr 172.21.15.100:0/1008735091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd4be00700 1 -- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c153fb0 msgr2=0x7fdd4c0c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd4be00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c153fb0 0x7fdd4c0c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd4be00700 1 -- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c098920 msgr2=0x7fdd4c14caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.092+0000 7fdd51000700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c098920 0x7fdd4c14caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd4be00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c098920 0x7fdd4c14caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd4be00700 1 -- 172.21.15.100:0/1008735091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340092a0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd51000700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c098920 0x7fdd4c14caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:24.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd4be00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0c2870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fdd4c0842a0 tx=0x7fdd34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:24.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd43e00700 1 -- 172.21.15.100:0/1008735091 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400b850 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd43e00700 1 -- 172.21.15.100:0/1008735091 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400b9b0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c0c38c0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd43e00700 1 -- 172.21.15.100:0/1008735091 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3401b640 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.093+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c158ea0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.094+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c0aaf70 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.095+0000 7fdd43e00700 1 -- 172.21.15.100:0/1008735091 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdd3401ba30 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.096+0000 7fdd43e00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdd2405f150 0x7fdd24061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.096+0000 7fdd43e00700 1 -- 172.21.15.100:0/1008735091 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd3407bcd0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.096+0000 7fdd51000700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdd2405f150 0x7fdd24061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.097+0000 7fdd51000700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdd2405f150 0x7fdd24061610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdd3c006d80 tx=0x7fdd3c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:24.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.100+0000 7fdd43e00700 1 -- 172.21.15.100:0/1008735091 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd3404cfa0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.273+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd4c1502a0 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.276+0000 7fdd43e00700 1 -- 172.21.15.100:0/1008735091 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fdd34028070 con 0x7fdd4c0a7c90 2024-01-22T05:40:24.277 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:24.278 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":52,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:39:47.743074+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-22T05:39:44.885259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-22T05:39:45.737245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdd2405f150 msgr2=0x7fdd24061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdd2405f150 0x7fdd24061610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdd3c006d80 tx=0x7fdd3c008040).stop 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 msgr2=0x7fdd4c0c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0c2870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fdd4c0842a0 tx=0x7fdd34017000).stop 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 shutdown_connections 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdd2405f150 0x7fdd24061610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c098920 0x7fdd4c14caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c153fb0 0x7fdd4c0c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 --2- 172.21.15.100:0/1008735091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd4c0a7c90 0x7fdd4c0c2870 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 >> 172.21.15.100:0/1008735091 conn(0x7fdd4c0c78a0 msgr2=0x7fdd4c0a8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 shutdown_connections 2024-01-22T05:40:24.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.278+0000 7fdd53a00700 1 -- 172.21.15.100:0/1008735091 wait complete. 2024-01-22T05:40:24.297 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T05:40:24.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.481+0000 7fc787200700 1 Processor -- start 2024-01-22T05:40:24.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.481+0000 7fc787200700 1 -- start start 2024-01-22T05:40:24.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.482+0000 7fc787200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc780155380 0x7fc7800c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.482+0000 7fc787200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc7800c52b0 0x7fc7800c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.482+0000 7fc787200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc780065720 con 0x7fc780154fa0 2024-01-22T05:40:24.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.482+0000 7fc787200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc780066640 con 0x7fc7800c52b0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.482+0000 7fc787200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800c5720 con 0x7fc780155380 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc785200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc7800c52b0 0x7fc7800c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc77fe00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc780154fa0 0x7fc780065f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43340/0 (socket says 172.21.15.100:43340) 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc77fe00700 1 -- 172.21.15.100:0/172952793 learned_addr learned my addr 172.21.15.100:0/172952793 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc77f400700 1 --2- 172.21.15.100:0/172952793 >> v2:172.21.15.169:3300/0 conn(0x7fc780155380 0x7fc7800c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc785200700 1 -- 172.21.15.100:0/172952793 >> v2:172.21.15.169:3300/0 conn(0x7fc780155380 msgr2=0x7fc7800c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc785200700 1 --2- 172.21.15.100:0/172952793 >> v2:172.21.15.169:3300/0 conn(0x7fc780155380 0x7fc7800c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc785200700 1 -- 172.21.15.100:0/172952793 >> v1:172.21.15.100:6789/0 conn(0x7fc780154fa0 legacy=0x7fc780065f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc785200700 1 -- 172.21.15.100:0/172952793 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780064b10 con 0x7fc7800c52b0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc77ea00700 1 -- 172.21.15.100:0/172952793 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217834891 0 0) 0x7fc780065720 con 0x7fc780154fa0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc785200700 1 --2- 172.21.15.100:0/172952793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7800c52b0 0x7fc7800c1970 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fc7800c47e0 tx=0x7fc778009780).ready entity=mon.0 client_cookie=52fb7225a8198b0e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc77ea00700 1 -- 172.21.15.100:0/172952793 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800e070 con 0x7fc7800c52b0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc77ea00700 1 -- 172.21.15.100:0/172952793 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77800bc30 con 0x7fc7800c52b0 2024-01-22T05:40:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.483+0000 7fc77ea00700 1 -- 172.21.15.100:0/172952793 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778012410 con 0x7fc7800c52b0 2024-01-22T05:40:24.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 -- 172.21.15.100:0/172952793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7800c52b0 msgr2=0x7fc7800c1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 --2- 172.21.15.100:0/172952793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7800c52b0 0x7fc7800c1970 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fc7800c47e0 tx=0x7fc778009780).stop 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 -- 172.21.15.100:0/172952793 shutdown_connections 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 --2- 172.21.15.100:0/172952793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7800c52b0 0x7fc7800c1970 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 --2- 172.21.15.100:0/172952793 >> v2:172.21.15.169:3300/0 conn(0x7fc780155380 0x7fc7800c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 -- 172.21.15.100:0/172952793 >> 172.21.15.100:0/172952793 conn(0x7fc7800630c0 msgr2=0x7fc7800c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 -- 172.21.15.100:0/172952793 shutdown_connections 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.484+0000 7fc787200700 1 -- 172.21.15.100:0/172952793 wait complete. 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.486+0000 7fc787200700 1 Processor -- start 2024-01-22T05:40:24.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.486+0000 7fc787200700 1 -- start start 2024-01-22T05:40:24.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc787200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7800c52b0 0x7fc7801492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc787200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc780154fa0 0x7fc7800a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc787200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc780155380 0x7fc7800a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc787200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800a7660 con 0x7fc780154fa0 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc787200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78014a100 con 0x7fc7800c52b0 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc787200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7801521d0 con 0x7fc780155380 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc780154fa0 0x7fc7800a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc780154fa0 0x7fc7800a8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36158/0 (socket says 172.21.15.100:36158) 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 -- 172.21.15.100:0/2268659062 learned_addr learned my addr 172.21.15.100:0/2268659062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77fe00700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7800c52b0 0x7fc7801492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc785200700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc780155380 0x7fc7800a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 -- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc780155380 msgr2=0x7fc7800a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc780155380 0x7fc7800a7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 -- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7800c52b0 msgr2=0x7fc7801492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:24.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7800c52b0 0x7fc7801492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:24.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 -- 172.21.15.100:0/2268659062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009a20 con 0x7fc780154fa0 2024-01-22T05:40:24.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.487+0000 7fc77f400700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc780154fa0 0x7fc7800a8680 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fc76800d8c0 tx=0x7fc768008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:24.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.488+0000 7fc777400700 1 -- 172.21.15.100:0/2268659062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011590 con 0x7fc780154fa0 2024-01-22T05:40:24.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.488+0000 7fc777400700 1 -- 172.21.15.100:0/2268659062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7680116f0 con 0x7fc780154fa0 2024-01-22T05:40:24.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.488+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc780149860 con 0x7fc780154fa0 2024-01-22T05:40:24.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.488+0000 7fc777400700 1 -- 172.21.15.100:0/2268659062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011a70 con 0x7fc780154fa0 2024-01-22T05:40:24.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.488+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc780149e20 con 0x7fc780154fa0 2024-01-22T05:40:24.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.489+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7800a7430 con 0x7fc780154fa0 2024-01-22T05:40:24.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.490+0000 7fc777400700 1 -- 172.21.15.100:0/2268659062 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc768012420 con 0x7fc780154fa0 2024-01-22T05:40:24.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.490+0000 7fc777400700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc75805f150 0x7fc758061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:24.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.490+0000 7fc777400700 1 -- 172.21.15.100:0/2268659062 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc768079a90 con 0x7fc780154fa0 2024-01-22T05:40:24.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.491+0000 7fc77fe00700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc75805f150 0x7fc758061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:24.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.491+0000 7fc77fe00700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc75805f150 0x7fc758061610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fc770007fd0 tx=0x7fc770007dd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:24.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.494+0000 7fc777400700 1 -- 172.21.15.100:0/2268659062 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc7800a7430 con 0x7fc780154fa0 2024-01-22T05:40:24.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:24.727+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7800a7430 con 0x7fc780154fa0 2024-01-22T05:40:25.275 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-22T05:40:25.274+0000 7f8b0ae00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T05:40:25.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.281+0000 7fc777400700 1 -- 172.21.15.100:0/2268659062 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc7800a7430 con 0x7fc780154fa0 2024-01-22T05:40:25.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc75805f150 msgr2=0x7fc758061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:25.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc75805f150 0x7fc758061610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fc770007fd0 tx=0x7fc770007dd0).stop 2024-01-22T05:40:25.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc780154fa0 msgr2=0x7fc7800a8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:25.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc780154fa0 0x7fc7800a8680 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fc76800d8c0 tx=0x7fc768008040).stop 2024-01-22T05:40:25.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 shutdown_connections 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc75805f150 0x7fc758061610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7800c52b0 0x7fc7801492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc780155380 0x7fc7800a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 --2- 172.21.15.100:0/2268659062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc780154fa0 0x7fc7800a8680 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 >> 172.21.15.100:0/2268659062 conn(0x7fc7800630c0 msgr2=0x7fc78006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 shutdown_connections 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.284+0000 7fc787200700 1 -- 172.21.15.100:0/2268659062 wait complete. 2024-01-22T05:40:25.286 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T05:40:25.289 INFO:tasks.ceph.mds.a.smithi100.stderr: -2416> 2024-01-22T05:39:51.239+0000 7f79f0200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T05:40:25.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T05:40:25.330 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-22T05:40:25.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.493+0000 7f01af200700 1 Processor -- start 2024-01-22T05:40:25.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.493+0000 7f01af200700 1 -- start start 2024-01-22T05:40:25.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.494+0000 7f01af200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01a8157290 0x7f01a8092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:25.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01af200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01af200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a8065000 con 0x7f01a8092600 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01af200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80643f0 con 0x7f01a8157290 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01af200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80646d0 con 0x7f01a80c5b80 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a7e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01a8157290 0x7f01a8092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a7400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f01a8092600 0x7f01a80c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43348/0 (socket says 172.21.15.100:43348) 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a7400700 1 -- 172.21.15.100:0/576716222 learned_addr learned my addr 172.21.15.100:0/576716222 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01ad200700 1 --2- 172.21.15.100:0/576716222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a7e00700 1 -- 172.21.15.100:0/576716222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 msgr2=0x7f01a80c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a6a00700 1 -- 172.21.15.100:0/576716222 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196932097 0 0) 0x7f01a8065000 con 0x7f01a8092600 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a7e00700 1 --2- 172.21.15.100:0/576716222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a7e00700 1 -- 172.21.15.100:0/576716222 >> v1:172.21.15.100:6789/0 conn(0x7f01a8092600 legacy=0x7f01a80c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.495+0000 7f01a7e00700 1 -- 172.21.15.100:0/576716222 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80649b0 con 0x7f01a8157290 2024-01-22T05:40:25.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01a7e00700 1 --2- 172.21.15.100:0/576716222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8092110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f0198009760 tx=0x7f0198009060).ready entity=mon.0 client_cookie=af7c6306e0a3f638 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01a6a00700 1 -- 172.21.15.100:0/576716222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800b580 con 0x7f01a8157290 2024-01-22T05:40:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01a6a00700 1 -- 172.21.15.100:0/576716222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800b6e0 con 0x7f01a8157290 2024-01-22T05:40:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01a6a00700 1 -- 172.21.15.100:0/576716222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800ba60 con 0x7f01a8157290 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01af200700 1 -- 172.21.15.100:0/576716222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 msgr2=0x7f01a8092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01af200700 1 --2- 172.21.15.100:0/576716222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8092110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f0198009760 tx=0x7f0198009060).stop 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01af200700 1 -- 172.21.15.100:0/576716222 shutdown_connections 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01af200700 1 --2- 172.21.15.100:0/576716222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8092110 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01af200700 1 --2- 172.21.15.100:0/576716222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01af200700 1 -- 172.21.15.100:0/576716222 >> 172.21.15.100:0/576716222 conn(0x7f01a805e9d0 msgr2=0x7f01a8091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.496+0000 7f01af200700 1 -- 172.21.15.100:0/576716222 shutdown_connections 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.497+0000 7f01af200700 1 -- 172.21.15.100:0/576716222 wait complete. 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.498+0000 7f01af200700 1 Processor -- start 2024-01-22T05:40:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.498+0000 7f01af200700 1 -- start start 2024-01-22T05:40:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01af200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a8092600 0x7f01a81620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01af200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01af200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8166aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:25.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01af200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8166610 con 0x7f01a8157290 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01af200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8165a00 con 0x7f01a8092600 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01af200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8165ce0 con 0x7f01a80c5b80 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01ad200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8166aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01ad200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8166aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36180/0 (socket says 172.21.15.100:36180) 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.499+0000 7f01ad200700 1 -- 172.21.15.100:0/4212043718 learned_addr learned my addr 172.21.15.100:0/4212043718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01a7400700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01a7e00700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a8092600 0x7f01a81620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01ad200700 1 -- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 msgr2=0x7f01a80ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01ad200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01ad200700 1 -- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a8092600 msgr2=0x7f01a81620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01ad200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a8092600 0x7f01a81620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01ad200700 1 -- 172.21.15.100:0/4212043718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980092a0 con 0x7f01a8157290 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01ad200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8166aa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f01a0007f20 tx=0x7f01a00098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:25.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f019f400700 1 -- 172.21.15.100:0/4212043718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000eca0 con 0x7f01a8157290 2024-01-22T05:40:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f019f400700 1 -- 172.21.15.100:0/4212043718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000ee00 con 0x7f01a8157290 2024-01-22T05:40:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a8165fc0 con 0x7f01a8157290 2024-01-22T05:40:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f019f400700 1 -- 172.21.15.100:0/4212043718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0014610 con 0x7f01a8157290 2024-01-22T05:40:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.500+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a814b390 con 0x7f01a8157290 2024-01-22T05:40:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.501+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a805fdb0 con 0x7f01a8157290 2024-01-22T05:40:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.502+0000 7f019f400700 1 -- 172.21.15.100:0/4212043718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f01a001d3b0 con 0x7f01a8157290 2024-01-22T05:40:25.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.503+0000 7f019f400700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f018005f150 0x7f0180061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:25.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.503+0000 7f019f400700 1 -- 172.21.15.100:0/4212043718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f01a007a750 con 0x7f01a8157290 2024-01-22T05:40:25.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.503+0000 7f01a7e00700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f018005f150 0x7f0180061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:25.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.504+0000 7f01a7e00700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f018005f150 0x7f0180061610 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f019800b340 tx=0x7f0198017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:25.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.508+0000 7f019f400700 1 -- 172.21.15.100:0/4212043718 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f01a004b970 con 0x7f01a8157290 2024-01-22T05:40:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:25.720+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f01a8166750 con 0x7f01a8157290 2024-01-22T05:40:26.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.284+0000 7f019f400700 1 -- 172.21.15.100:0/4212043718 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f01a004ef90 con 0x7f01a8157290 2024-01-22T05:40:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f018005f150 msgr2=0x7f0180061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:26.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f018005f150 0x7f0180061610 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f019800b340 tx=0x7f0198017000).stop 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 msgr2=0x7f01a8166aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8166aa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f01a0007f20 tx=0x7f01a00098a0).stop 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 shutdown_connections 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f018005f150 0x7f0180061610 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01a8092600 0x7f01a81620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a8157290 0x7f01a8166aa0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 --2- 172.21.15.100:0/4212043718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01a80c5b80 0x7f01a80ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 >> 172.21.15.100:0/4212043718 conn(0x7f01a805e9d0 msgr2=0x7f01a8066640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.287+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 shutdown_connections 2024-01-22T05:40:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.288+0000 7f01af200700 1 -- 172.21.15.100:0/4212043718 wait complete. 2024-01-22T05:40:26.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T05:40:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.542+0000 7fb3d7000700 1 Processor -- start 2024-01-22T05:40:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.542+0000 7fb3d7000700 1 -- start start 2024-01-22T05:40:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3d7000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3d0154190 0x7fb3d00a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3d7000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00c0cc0 0x7fb3d00c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3d7000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d00c9cb0 con 0x7fb3d00ca140 2024-01-22T05:40:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3d7000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d00851f0 con 0x7fb3d0154190 2024-01-22T05:40:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3d7000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00c6cf0 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3cfe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3d0154190 0x7fb3d00a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3cf400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb3d00ca140 0x7fb3d00ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43364/0 (socket says 172.21.15.100:43364) 2024-01-22T05:40:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.543+0000 7fb3cf400700 1 -- 172.21.15.100:0/4054790437 learned_addr learned my addr 172.21.15.100:0/4054790437 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3d5000700 1 --2- 172.21.15.100:0/4054790437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00c0cc0 0x7fb3d00c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cea00700 1 -- 172.21.15.100:0/4054790437 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408959979 0 0) 0x7fb3d00c9cb0 con 0x7fb3d00ca140 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cfe00700 1 -- 172.21.15.100:0/4054790437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00c0cc0 msgr2=0x7fb3d00c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cfe00700 1 --2- 172.21.15.100:0/4054790437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00c0cc0 0x7fb3d00c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cfe00700 1 -- 172.21.15.100:0/4054790437 >> v1:172.21.15.100:6789/0 conn(0x7fb3d00ca140 legacy=0x7fb3d00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cfe00700 1 -- 172.21.15.100:0/4054790437 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00c6fd0 con 0x7fb3d0154190 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cfe00700 1 --2- 172.21.15.100:0/4054790437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d0154190 0x7fb3d00a7b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb3c0006fd0 tx=0x7fb3c0006f40).ready entity=mon.0 client_cookie=13838cccf513efed server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cea00700 1 -- 172.21.15.100:0/4054790437 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0005880 con 0x7fb3d0154190 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cea00700 1 -- 172.21.15.100:0/4054790437 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c00059e0 con 0x7fb3d0154190 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.544+0000 7fb3cea00700 1 -- 172.21.15.100:0/4054790437 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0005d60 con 0x7fb3d0154190 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 -- 172.21.15.100:0/4054790437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d0154190 msgr2=0x7fb3d00a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 --2- 172.21.15.100:0/4054790437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d0154190 0x7fb3d00a7b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb3c0006fd0 tx=0x7fb3c0006f40).stop 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 -- 172.21.15.100:0/4054790437 shutdown_connections 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 --2- 172.21.15.100:0/4054790437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d0154190 0x7fb3d00a7b20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 --2- 172.21.15.100:0/4054790437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00c0cc0 0x7fb3d00c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 -- 172.21.15.100:0/4054790437 >> 172.21.15.100:0/4054790437 conn(0x7fb3d005e9d0 msgr2=0x7fb3d00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 -- 172.21.15.100:0/4054790437 shutdown_connections 2024-01-22T05:40:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.545+0000 7fb3d7000700 1 -- 172.21.15.100:0/4054790437 wait complete. 2024-01-22T05:40:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.546+0000 7fb3d7000700 1 Processor -- start 2024-01-22T05:40:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.547+0000 7fb3d7000700 1 -- start start 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.547+0000 7fb3d7000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d00c0cc0 0x7fb3d01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.547+0000 7fb3d7000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00ca140 0x7fb3d0164f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.547+0000 7fb3d7000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3d0154190 0x7fb3d014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.547+0000 7fb3d7000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0168840 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.547+0000 7fb3d7000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0165480 con 0x7fb3d0154190 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.547+0000 7fb3d7000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d014d4a0 con 0x7fb3d00ca140 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d00c0cc0 0x7fb3d01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d00c0cc0 0x7fb3d01598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36204/0 (socket says 172.21.15.100:36204) 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 -- 172.21.15.100:0/183223199 learned_addr learned my addr 172.21.15.100:0/183223199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cf400700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00ca140 0x7fb3d0164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3d5000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3d0154190 0x7fb3d014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 -- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00ca140 msgr2=0x7fb3d0164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00ca140 0x7fb3d0164f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 -- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3d0154190 msgr2=0x7fb3d014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3d0154190 0x7fb3d014cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 -- 172.21.15.100:0/183223199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0009250 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cf400700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00ca140 0x7fb3d0164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3d5000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3d0154190 0x7fb3d014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3cfe00700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d00c0cc0 0x7fb3d01598d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fb3c0006f80 tx=0x7fb3c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3c7400700 1 -- 172.21.15.100:0/183223199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000b790 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3c7400700 1 -- 172.21.15.100:0/183223199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000b910 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d0167bc0 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.548+0000 7fb3c7400700 1 -- 172.21.15.100:0/183223199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000bcd0 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.549+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d0168180 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.550+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d00b0de0 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.550+0000 7fb3c7400700 1 -- 172.21.15.100:0/183223199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb3c0011650 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.551+0000 7fb3c7400700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb3a805f180 0x7fb3a8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.551+0000 7fb3c7400700 1 -- 172.21.15.100:0/183223199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb3c007afc0 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.551+0000 7fb3cf400700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb3a805f180 0x7fb3a8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.552+0000 7fb3cf400700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb3a805f180 0x7fb3a8061640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fb3d0167a80 tx=0x7fb3b8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.555+0000 7fb3c7400700 1 -- 172.21.15.100:0/183223199 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3c00a9b00 con 0x7fb3d00c0cc0 2024-01-22T05:40:26.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:26.726+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3d00c9660 con 0x7fb3d00c0cc0 2024-01-22T05:40:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.289+0000 7fb3c7400700 1 -- 172.21.15.100:0/183223199 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb3c0021070 con 0x7fb3d00c0cc0 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb3a805f180 msgr2=0x7fb3a8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb3a805f180 0x7fb3a8061640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fb3d0167a80 tx=0x7fb3b8009040).stop 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d00c0cc0 msgr2=0x7fb3d01598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d00c0cc0 0x7fb3d01598d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fb3c0006f80 tx=0x7fb3c0016000).stop 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 shutdown_connections 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fb3a805f180 0x7fb3a8061640 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3d0154190 0x7fb3d014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d00c0cc0 0x7fb3d01598d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 --2- 172.21.15.100:0/183223199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3d00ca140 0x7fb3d0164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 >> 172.21.15.100:0/183223199 conn(0x7fb3d005e9d0 msgr2=0x7fb3d00645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 shutdown_connections 2024-01-22T05:40:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.292+0000 7fb3d7000700 1 -- 172.21.15.100:0/183223199 wait complete. 2024-01-22T05:40:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-01-22T05:40:27.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T05:40:27.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:40:27.399 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:40:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.504+0000 7f8017000700 1 Processor -- start 2024-01-22T05:40:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.504+0000 7f8017000700 1 -- start start 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.505+0000 7f8017000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8010154260 0x7f80100cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.505+0000 7f8017000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f80100c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.505+0000 7f8017000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80100c1a40 con 0x7f80100c65f0 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.505+0000 7f8017000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100cbd30 con 0x7f8010154260 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.505+0000 7f8017000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c6a80 con 0x7f80100c5c80 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8010154260 0x7f80100cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8010154260 0x7f80100cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36218/0 (socket says 172.21.15.100:36218) 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 -- 172.21.15.100:0/148042591 learned_addr learned my addr 172.21.15.100:0/148042591 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800f400700 1 --2- 172.21.15.100:0/148042591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f80100c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 -- 172.21.15.100:0/148042591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 msgr2=0x7f80100c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 --2- 172.21.15.100:0/148042591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f80100c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 -- 172.21.15.100:0/148042591 >> v1:172.21.15.169:6789/0 conn(0x7f80100c65f0 legacy=0x7f8010157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 -- 172.21.15.100:0/148042591 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100c1110 con 0x7f8010154260 2024-01-22T05:40:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800fe00700 1 --2- 172.21.15.100:0/148042591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100cb4e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f8000009820 tx=0x7f80000090f0).ready entity=mon.0 client_cookie=16b8d7eea7ee110c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.506+0000 7f800ea00700 1 -- 172.21.15.100:0/148042591 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000b580 con 0x7f8010154260 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f800ea00700 1 -- 172.21.15.100:0/148042591 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800000b6e0 con 0x7f8010154260 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f800ea00700 1 -- 172.21.15.100:0/148042591 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000ba80 con 0x7f8010154260 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 -- 172.21.15.100:0/148042591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 msgr2=0x7f80100cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 --2- 172.21.15.100:0/148042591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100cb4e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f8000009820 tx=0x7f80000090f0).stop 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 -- 172.21.15.100:0/148042591 shutdown_connections 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 --2- 172.21.15.100:0/148042591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100cb4e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 --2- 172.21.15.100:0/148042591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f80100c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 -- 172.21.15.100:0/148042591 >> 172.21.15.100:0/148042591 conn(0x7f801005e9d0 msgr2=0x7f80100cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 -- 172.21.15.100:0/148042591 shutdown_connections 2024-01-22T05:40:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.507+0000 7f8017000700 1 -- 172.21.15.100:0/148042591 wait complete. 2024-01-22T05:40:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.509+0000 7f8017000700 1 Processor -- start 2024-01-22T05:40:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.509+0000 7f8017000700 1 -- start start 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8017000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f8010167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8017000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80100c65f0 0x7f80100c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8017000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8017000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c4da0 con 0x7f8010154260 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8017000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c29d0 con 0x7f80100c65f0 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8017000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c1dc0 con 0x7f80100c5c80 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36222/0 (socket says 172.21.15.100:36222) 2024-01-22T05:40:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f800fe00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f8010167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 -- 172.21.15.100:0/1489585776 learned_addr learned my addr 172.21.15.100:0/1489585776 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f800f400700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80100c65f0 0x7f80100c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 -- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 msgr2=0x7f8010167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f8010167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 -- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80100c65f0 msgr2=0x7f80100c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80100c65f0 0x7f80100c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f8015000700 1 -- 172.21.15.100:0/1489585776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009310 con 0x7f8010154260 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f800fe00700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f8010167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.510+0000 7f800f400700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80100c65f0 0x7f80100c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.511+0000 7f8015000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100c48b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f8008002230 tx=0x7f80080015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.511+0000 7f8007400700 1 -- 172.21.15.100:0/1489585776 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800e4a0 con 0x7f8010154260 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.511+0000 7f8007400700 1 -- 172.21.15.100:0/1489585776 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800800e600 con 0x7f8010154260 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.511+0000 7f8007400700 1 -- 172.21.15.100:0/1489585776 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800e980 con 0x7f8010154260 2024-01-22T05:40:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.511+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80100c20a0 con 0x7f8010154260 2024-01-22T05:40:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.511+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80100c26e0 con 0x7f8010154260 2024-01-22T05:40:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.512+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80100ad8c0 con 0x7f8010154260 2024-01-22T05:40:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.513+0000 7f8007400700 1 -- 172.21.15.100:0/1489585776 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f800801b3b0 con 0x7f8010154260 2024-01-22T05:40:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.513+0000 7f8007400700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fe805f150 0x7f7fe8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.513+0000 7f8007400700 1 -- 172.21.15.100:0/1489585776 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f80080797f0 con 0x7f8010154260 2024-01-22T05:40:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.514+0000 7f800fe00700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fe805f150 0x7f7fe8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.514+0000 7f800fe00700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fe805f150 0x7f7fe8061610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f8000009130 tx=0x7f8000017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.517+0000 7f8007400700 1 -- 172.21.15.100:0/1489585776 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8008048b00 con 0x7f8010154260 2024-01-22T05:40:27.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:27.689+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80100c13f0 con 0x7f8010154260 2024-01-22T05:40:28.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.298+0000 7f8007400700 1 -- 172.21.15.100:0/1489585776 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7f800804abb0 con 0x7f8010154260 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.300+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fe805f150 msgr2=0x7f7fe8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.300+0000 7f8017000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fe805f150 0x7f7fe8061610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f8000009130 tx=0x7f8000017000).stop 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.300+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 msgr2=0x7f80100c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.300+0000 7f8017000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100c48b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f8008002230 tx=0x7f80080015e0).stop 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 shutdown_connections 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f7fe805f150 0x7f7fe8061610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010154260 0x7f80100c48b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80100c5c80 0x7f8010167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 --2- 172.21.15.100:0/1489585776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80100c65f0 0x7f80100c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 >> 172.21.15.100:0/1489585776 conn(0x7f801005e9d0 msgr2=0x7f80100630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 shutdown_connections 2024-01-22T05:40:28.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.301+0000 7f8017000700 1 -- 172.21.15.100:0/1489585776 wait complete. 2024-01-22T05:40:28.302 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-01-22T05:40:28.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-22T05:40:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.563+0000 7f9142200700 1 Processor -- start 2024-01-22T05:40:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.564+0000 7f9142200700 1 -- start start 2024-01-22T05:40:28.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f9142200700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f913c05e900 0x7f913c0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f9142200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f913c0c1940 0x7f913c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f9142200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0c74b0 con 0x7f913c0a9f60 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f9142200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c0cab90 con 0x7f913c0c1940 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f9142200700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c158660 con 0x7f913c05e900 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f913be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f913c0c1940 0x7f913c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f913b400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f913c0a9f60 0x7f913c05e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43370/0 (socket says 172.21.15.100:43370) 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f913b400700 1 -- 172.21.15.100:0/2807526231 learned_addr learned my addr 172.21.15.100:0/2807526231 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.565+0000 7f913aa00700 1 --2- 172.21.15.100:0/2807526231 >> v2:172.21.15.169:3300/0 conn(0x7f913c05e900 0x7f913c0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913be00700 1 -- 172.21.15.100:0/2807526231 >> v2:172.21.15.169:3300/0 conn(0x7f913c05e900 msgr2=0x7f913c0aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913be00700 1 --2- 172.21.15.100:0/2807526231 >> v2:172.21.15.169:3300/0 conn(0x7f913c05e900 0x7f913c0aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913be00700 1 -- 172.21.15.100:0/2807526231 >> v1:172.21.15.100:6789/0 conn(0x7f913c0a9f60 legacy=0x7f913c05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913be00700 1 -- 172.21.15.100:0/2807526231 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c158940 con 0x7f913c0c1940 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913a000700 1 -- 172.21.15.100:0/2807526231 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435570277 0 0) 0x7f913c0c74b0 con 0x7f913c0a9f60 2024-01-22T05:40:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913be00700 1 --2- 172.21.15.100:0/2807526231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0c1940 0x7f913c0ca6a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f913c0c88d0 tx=0x7f9134009780).ready entity=mon.0 client_cookie=c4e066a33d666e8d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913a000700 1 -- 172.21.15.100:0/2807526231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400e070 con 0x7f913c0c1940 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913a000700 1 -- 172.21.15.100:0/2807526231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913400bc30 con 0x7f913c0c1940 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f913a000700 1 -- 172.21.15.100:0/2807526231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134012410 con 0x7f913c0c1940 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f9142200700 1 -- 172.21.15.100:0/2807526231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0c1940 msgr2=0x7f913c0ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.566+0000 7f9142200700 1 --2- 172.21.15.100:0/2807526231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0c1940 0x7f913c0ca6a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f913c0c88d0 tx=0x7f9134009780).stop 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.567+0000 7f9142200700 1 -- 172.21.15.100:0/2807526231 shutdown_connections 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.567+0000 7f9142200700 1 --2- 172.21.15.100:0/2807526231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0c1940 0x7f913c0ca6a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.567+0000 7f9142200700 1 --2- 172.21.15.100:0/2807526231 >> v2:172.21.15.169:3300/0 conn(0x7f913c05e900 0x7f913c0aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.567+0000 7f9142200700 1 -- 172.21.15.100:0/2807526231 >> 172.21.15.100:0/2807526231 conn(0x7f913c0cada0 msgr2=0x7f913c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.567+0000 7f9142200700 1 -- 172.21.15.100:0/2807526231 shutdown_connections 2024-01-22T05:40:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.567+0000 7f9142200700 1 -- 172.21.15.100:0/2807526231 wait complete. 2024-01-22T05:40:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.569+0000 7f9142200700 1 Processor -- start 2024-01-22T05:40:28.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.569+0000 7f9142200700 1 -- start start 2024-01-22T05:40:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f9142200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f913c05e900 0x7f913c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f9142200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0a9f60 0x7f913c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f9142200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f913c0c1940 0x7f913c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f9142200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0c1e70 con 0x7f913c0a9f60 2024-01-22T05:40:28.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f9142200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0c3e70 con 0x7f913c05e900 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f9142200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0c4150 con 0x7f913c0c1940 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f913aa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0a9f60 0x7f913c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f913aa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0a9f60 0x7f913c156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36246/0 (socket says 172.21.15.100:36246) 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.570+0000 7f913aa00700 1 -- 172.21.15.100:0/4098180219 learned_addr learned my addr 172.21.15.100:0/4098180219 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913aa00700 1 -- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f913c0c1940 msgr2=0x7f913c156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913aa00700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f913c0c1940 0x7f913c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913b400700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f913c05e900 0x7f913c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913aa00700 1 -- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f913c05e900 msgr2=0x7f913c152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913aa00700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f913c05e900 0x7f913c152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913aa00700 1 -- 172.21.15.100:0/4098180219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134009a20 con 0x7f913c0a9f60 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913b400700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f913c05e900 0x7f913c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f913aa00700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0a9f60 0x7f913c156a10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f912400d890 tx=0x7f9124008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:28.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f9132a00700 1 -- 172.21.15.100:0/4098180219 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240125f0 con 0x7f913c0a9f60 2024-01-22T05:40:28.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f9132a00700 1 -- 172.21.15.100:0/4098180219 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124012750 con 0x7f913c0a9f60 2024-01-22T05:40:28.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c0c4430 con 0x7f913c0a9f60 2024-01-22T05:40:28.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f9132a00700 1 -- 172.21.15.100:0/4098180219 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124012ad0 con 0x7f913c0a9f60 2024-01-22T05:40:28.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.571+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0c49f0 con 0x7f913c0a9f60 2024-01-22T05:40:28.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.573+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c0c1fe0 con 0x7f913c0a9f60 2024-01-22T05:40:28.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.573+0000 7f9132a00700 1 -- 172.21.15.100:0/4098180219 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9124013480 con 0x7f913c0a9f60 2024-01-22T05:40:28.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.574+0000 7f9132a00700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f911405f150 0x7f9114061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.574+0000 7f9132a00700 1 -- 172.21.15.100:0/4098180219 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f9124079db0 con 0x7f913c0a9f60 2024-01-22T05:40:28.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.574+0000 7f913b400700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f911405f150 0x7f9114061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.575+0000 7f913b400700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f911405f150 0x7f9114061610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f912c001750 tx=0x7f912c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.578+0000 7f9132a00700 1 -- 172.21.15.100:0/4098180219 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f913c0c1fe0 con 0x7f913c0a9f60 2024-01-22T05:40:28.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.749+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f913c0c1fe0 con 0x7f913c0a9f60 2024-01-22T05:40:28.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.753+0000 7f9132a00700 1 -- 172.21.15.100:0/4098180219 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f913c0c1fe0 con 0x7f913c0a9f60 2024-01-22T05:40:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f911405f150 msgr2=0x7f9114061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f911405f150 0x7f9114061610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f912c001750 tx=0x7f912c009040).stop 2024-01-22T05:40:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0a9f60 msgr2=0x7f913c156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0a9f60 0x7f913c156a10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f912400d890 tx=0x7f9124008040).stop 2024-01-22T05:40:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 shutdown_connections 2024-01-22T05:40:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f911405f150 0x7f9114061610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f913c05e900 0x7f913c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f913c0c1940 0x7f913c156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:28.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 --2- 172.21.15.100:0/4098180219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0a9f60 0x7f913c156a10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 >> 172.21.15.100:0/4098180219 conn(0x7f913c0cada0 msgr2=0x7f913c05e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:28.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 shutdown_connections 2024-01-22T05:40:28.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.756+0000 7f9142200700 1 -- 172.21.15.100:0/4098180219 wait complete. 2024-01-22T05:40:28.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-01-22T05:40:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.957+0000 7fda5d000700 1 Processor -- start 2024-01-22T05:40:28.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.957+0000 7fda5d000700 1 -- start start 2024-01-22T05:40:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.959+0000 7fda5d000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda58150510 0x7fda580bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.959+0000 7fda5d000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda580bd610 0x7fda58069390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.959+0000 7fda5d000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda580bcc90 con 0x7fda581508f0 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.959+0000 7fda5d000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda580bc080 con 0x7fda580bd610 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.959+0000 7fda5d000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda580bc360 con 0x7fda58150510 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda580bd610 0x7fda58069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda580bd610 0x7fda58069390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36256/0 (socket says 172.21.15.100:36256) 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 -- 172.21.15.100:0/1780368536 learned_addr learned my addr 172.21.15.100:0/1780368536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55e00700 1 --2- 172.21.15.100:0/1780368536 >> v2:172.21.15.169:3300/0 conn(0x7fda58150510 0x7fda580bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 -- 172.21.15.100:0/1780368536 >> v2:172.21.15.169:3300/0 conn(0x7fda58150510 msgr2=0x7fda580bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 --2- 172.21.15.100:0/1780368536 >> v2:172.21.15.169:3300/0 conn(0x7fda58150510 0x7fda580bd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 -- 172.21.15.100:0/1780368536 >> v1:172.21.15.169:6789/0 conn(0x7fda581508f0 legacy=0x7fda580c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 -- 172.21.15.100:0/1780368536 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580bc640 con 0x7fda580bd610 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.960+0000 7fda55400700 1 --2- 172.21.15.100:0/1780368536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda580bd610 0x7fda58069390 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fda5805ef30 tx=0x7fda400090f0).ready entity=mon.0 client_cookie=af23df92fbc99a55 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda54a00700 1 -- 172.21.15.100:0/1780368536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000b520 con 0x7fda580bd610 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda54a00700 1 -- 172.21.15.100:0/1780368536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000b680 con 0x7fda580bd610 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda54a00700 1 -- 172.21.15.100:0/1780368536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000ba00 con 0x7fda580bd610 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 -- 172.21.15.100:0/1780368536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda580bd610 msgr2=0x7fda58069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 --2- 172.21.15.100:0/1780368536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda580bd610 0x7fda58069390 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fda5805ef30 tx=0x7fda400090f0).stop 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 -- 172.21.15.100:0/1780368536 shutdown_connections 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 --2- 172.21.15.100:0/1780368536 >> v2:172.21.15.169:3300/0 conn(0x7fda58150510 0x7fda580bd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 --2- 172.21.15.100:0/1780368536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda580bd610 0x7fda58069390 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 -- 172.21.15.100:0/1780368536 >> 172.21.15.100:0/1780368536 conn(0x7fda58063090 msgr2=0x7fda580c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 -- 172.21.15.100:0/1780368536 shutdown_connections 2024-01-22T05:40:28.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.961+0000 7fda5d000700 1 -- 172.21.15.100:0/1780368536 wait complete. 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.963+0000 7fda5d000700 1 Processor -- start 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.963+0000 7fda5d000700 1 -- start start 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda5d000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda580bd610 0x7fda580a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda5d000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda58150510 0x7fda580a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda5d000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda581508f0 0x7fda580bef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda5d000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58144fa0 con 0x7fda58150510 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda5d000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58162800 con 0x7fda580bd610 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda5d000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda580a7b40 con 0x7fda581508f0 2024-01-22T05:40:28.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda58150510 0x7fda580a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda58150510 0x7fda580a72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36262/0 (socket says 172.21.15.100:36262) 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 -- 172.21.15.100:0/1936958176 learned_addr learned my addr 172.21.15.100:0/1936958176 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55e00700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda580bd610 0x7fda580a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda56800700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda581508f0 0x7fda580bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 -- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda581508f0 msgr2=0x7fda580bef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda581508f0 0x7fda580bef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 -- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda580bd610 msgr2=0x7fda580a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda580bd610 0x7fda580a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.964+0000 7fda55400700 1 -- 172.21.15.100:0/1936958176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009370 con 0x7fda58150510 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.965+0000 7fda55400700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda58150510 0x7fda580a72c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fda40011000 tx=0x7fda40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.965+0000 7fda4d600700 1 -- 172.21.15.100:0/1936958176 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000be90 con 0x7fda58150510 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.965+0000 7fda4d600700 1 -- 172.21.15.100:0/1936958176 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000b7f0 con 0x7fda58150510 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.965+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5815fa60 con 0x7fda58150510 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.965+0000 7fda4d600700 1 -- 172.21.15.100:0/1936958176 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4001c650 con 0x7fda58150510 2024-01-22T05:40:28.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.965+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda58160020 con 0x7fda58150510 2024-01-22T05:40:28.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.966+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda58160240 con 0x7fda58150510 2024-01-22T05:40:28.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.967+0000 7fda4d600700 1 -- 172.21.15.100:0/1936958176 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fda4001ca00 con 0x7fda58150510 2024-01-22T05:40:28.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.968+0000 7fda4d600700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda3005f150 0x7fda30061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:28.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.968+0000 7fda4d600700 1 -- 172.21.15.100:0/1936958176 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fda4007bbc0 con 0x7fda58150510 2024-01-22T05:40:28.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.968+0000 7fda55e00700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda3005f150 0x7fda30061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:28.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.969+0000 7fda55e00700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda3005f150 0x7fda30061610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fda48009c30 tx=0x7fda48009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:28.972+0000 7fda4d600700 1 -- 172.21.15.100:0/1936958176 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fda4004d0d0 con 0x7fda58150510 2024-01-22T05:40:29.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.207+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fda5805fdb0 con 0x7fda58150510 2024-01-22T05:40:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.301+0000 7fda4d600700 1 -- 172.21.15.100:0/1936958176 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v146) v1 ==== 134+0+0 (secure 0 0 0) 0x7fda4002a030 con 0x7fda58150510 2024-01-22T05:40:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda3005f150 msgr2=0x7fda30061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda3005f150 0x7fda30061610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fda48009c30 tx=0x7fda48009060).stop 2024-01-22T05:40:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda58150510 msgr2=0x7fda580a72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda58150510 0x7fda580a72c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fda40011000 tx=0x7fda40017000).stop 2024-01-22T05:40:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 shutdown_connections 2024-01-22T05:40:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fda3005f150 0x7fda30061610 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda580bd610 0x7fda580a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda581508f0 0x7fda580bef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 --2- 172.21.15.100:0/1936958176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda58150510 0x7fda580a72c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 >> 172.21.15.100:0/1936958176 conn(0x7fda58063090 msgr2=0x7fda58064770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 shutdown_connections 2024-01-22T05:40:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:29.303+0000 7fda5d000700 1 -- 172.21.15.100:0/1936958176 wait complete. 2024-01-22T05:40:29.321 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks/cephfs/mount.py", line 669, in run_python 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: p.wait() 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-01-22T05:40:29.322 INFO:tasks.cephfs_test_runner: 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner:Ran 2 tests in 109.448s 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks/cephfs/mount.py", line 669, in run_python 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: p.wait() 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-22T05:40:29.323 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-22T05:40:29.324 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-22T05:40:29.324 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-22T05:40:29.324 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-01-22T05:40:29.324 INFO:tasks.cephfs_test_runner: 2024-01-22T05:40:29.324 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-22T05:40:29.561 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=885a8a6aa97847dea7428c68fb5af6d8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9854ba8e5f82e4476d4c6c06dd8feefca92b8b32/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-22T05:40:29.563 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-22T05:40:29.572 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-22T05:40:29.585 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-22T05:40:29.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:29.585 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-22T05:40:29.642 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T05:40:29.642 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-22T05:40:29.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:29.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T05:40:29.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:29.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-22T05:40:29.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:29.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-01-22T05:40:29.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:29.943 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-01-22T05:40:29.994 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-22T05:40:29.995 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-22T05:40:29.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:29.995 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-22T05:40:30.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:30.067 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-22T05:40:30.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T05:40:30.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-01-22T05:40:30.251 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-22T05:40:30.260 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-01-22T05:40:30.260 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:40:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.446+0000 7ff88e200700 1 Processor -- start 2024-01-22T05:40:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.446+0000 7ff88e200700 1 -- start start 2024-01-22T05:40:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff88e200700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff888154040 0x7ff888066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff88e200700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880bc510 con 0x7ff888064c30 2024-01-22T05:40:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff88e200700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880bc7f0 con 0x7ff888153c60 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff88e200700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880c45b0 con 0x7ff888154040 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff87fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff888154040 0x7ff888066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff887e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff888064c30 0x7ff888063370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43384/0 (socket says 172.21.15.100:43384) 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff887e00700 1 -- 172.21.15.100:0/3994166500 learned_addr learned my addr 172.21.15.100:0/3994166500 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff87fe00700 1 -- 172.21.15.100:0/3994166500 >> v1:172.21.15.169:6789/0 conn(0x7ff888153c60 legacy=0x7ff8880c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff87fe00700 1 -- 172.21.15.100:0/3994166500 >> v1:172.21.15.100:6789/0 conn(0x7ff888064c30 legacy=0x7ff888063370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff87fe00700 1 -- 172.21.15.100:0/3994166500 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880c4890 con 0x7ff888154040 2024-01-22T05:40:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.448+0000 7ff886a00700 1 -- 172.21.15.100:0/3994166500 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893462401 0 0) 0x7ff8880bc510 con 0x7ff888064c30 2024-01-22T05:40:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.449+0000 7ff87fe00700 1 --2- 172.21.15.100:0/3994166500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888066520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7ff870009760 tx=0x7ff870009060).ready entity=mon.0 client_cookie=bccbeab26c0dfdf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.449+0000 7ff886a00700 1 -- 172.21.15.100:0/3994166500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000b580 con 0x7ff888154040 2024-01-22T05:40:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.449+0000 7ff886a00700 1 -- 172.21.15.100:0/3994166500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87000b6e0 con 0x7ff888154040 2024-01-22T05:40:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.449+0000 7ff886a00700 1 -- 172.21.15.100:0/3994166500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000ba60 con 0x7ff888154040 2024-01-22T05:40:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.449+0000 7ff88e200700 1 -- 172.21.15.100:0/3994166500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 msgr2=0x7ff888066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.449+0000 7ff88e200700 1 --2- 172.21.15.100:0/3994166500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888066520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7ff870009760 tx=0x7ff870009060).stop 2024-01-22T05:40:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.450+0000 7ff88e200700 1 -- 172.21.15.100:0/3994166500 shutdown_connections 2024-01-22T05:40:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.450+0000 7ff88e200700 1 --2- 172.21.15.100:0/3994166500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888066520 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.450+0000 7ff88e200700 1 -- 172.21.15.100:0/3994166500 >> 172.21.15.100:0/3994166500 conn(0x7ff8880c7d20 msgr2=0x7ff8880c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.450+0000 7ff88e200700 1 -- 172.21.15.100:0/3994166500 shutdown_connections 2024-01-22T05:40:30.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.450+0000 7ff88e200700 1 -- 172.21.15.100:0/3994166500 wait complete. 2024-01-22T05:40:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.451+0000 7ff88e200700 1 Processor -- start 2024-01-22T05:40:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.451+0000 7ff88e200700 1 -- start start 2024-01-22T05:40:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff88e200700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff888064c30 0x7ff888150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff88e200700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff888153c60 0x7ff8880aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff88e200700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff88e200700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880aac40 con 0x7ff888154040 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff88e200700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880ac120 con 0x7ff888153c60 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff88e200700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880ad110 con 0x7ff888064c30 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff887e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff887e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36282/0 (socket says 172.21.15.100:36282) 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.452+0000 7ff887e00700 1 -- 172.21.15.100:0/2099647236 learned_addr learned my addr 172.21.15.100:0/2099647236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff887400700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff888064c30 0x7ff888150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff87fe00700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff888153c60 0x7ff8880aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff887e00700 1 -- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff888064c30 msgr2=0x7ff888150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff887e00700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff888064c30 0x7ff888150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff887e00700 1 -- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff888153c60 msgr2=0x7ff8880aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff887e00700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff888153c60 0x7ff8880aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff887e00700 1 -- 172.21.15.100:0/2099647236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700092a0 con 0x7ff888154040 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff87fe00700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff888153c60 0x7ff8880aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff887e00700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888151850 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ff88000c7e0 tx=0x7ff880007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff87ea00700 1 -- 172.21.15.100:0/2099647236 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880005d30 con 0x7ff888154040 2024-01-22T05:40:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff87ea00700 1 -- 172.21.15.100:0/2099647236 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff880005e90 con 0x7ff888154040 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff87ea00700 1 -- 172.21.15.100:0/2099647236 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880007320 con 0x7ff888154040 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88813e980 con 0x7ff888154040 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.453+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8880ac630 con 0x7ff888154040 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.454+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888155300 con 0x7ff888154040 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.455+0000 7ff87ea00700 1 -- 172.21.15.100:0/2099647236 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff880007710 con 0x7ff888154040 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.456+0000 7ff87ea00700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff86005f150 0x7ff860061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.456+0000 7ff87ea00700 1 -- 172.21.15.100:0/2099647236 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff880079f20 con 0x7ff888154040 2024-01-22T05:40:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.456+0000 7ff887400700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff86005f150 0x7ff860061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.457+0000 7ff887400700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff86005f150 0x7ff860061610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff878003900 tx=0x7ff878007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:30.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.460+0000 7ff87ea00700 1 -- 172.21.15.100:0/2099647236 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff88004b3d0 con 0x7ff888154040 2024-01-22T05:40:30.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.632+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff88805fe10 con 0x7ff888154040 2024-01-22T05:40:30.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.633+0000 7ff87ea00700 1 -- 172.21.15.100:0/2099647236 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+13891 (secure 0 0 0) 0x7ff88004e9f0 con 0x7ff888154040 2024-01-22T05:40:30.633 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:30.633 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:40:28.289597+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/2256257950":"2024-01-23T05:40:24.729183+0000","172.21.15.100:6835/2256257950":"2024-01-23T05:40:24.729183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:40:30.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff86005f150 msgr2=0x7ff860061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff86005f150 0x7ff860061610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff878003900 tx=0x7ff878007d40).stop 2024-01-22T05:40:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 msgr2=0x7ff888151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888151850 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ff88000c7e0 tx=0x7ff880007f90).stop 2024-01-22T05:40:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 shutdown_connections 2024-01-22T05:40:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff86005f150 0x7ff860061610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff888154040 0x7ff888151850 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff888064c30 0x7ff888150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 --2- 172.21.15.100:0/2099647236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff888153c60 0x7ff8880aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 >> 172.21.15.100:0/2099647236 conn(0x7ff8880c7d20 msgr2=0x7ff8880a5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:30.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 shutdown_connections 2024-01-22T05:40:30.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.635+0000 7ff88e200700 1 -- 172.21.15.100:0/2099647236 wait complete. 2024-01-22T05:40:30.653 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-22T05:40:30.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:40:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.836+0000 7f4df2c00700 1 Processor -- start 2024-01-22T05:40:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.836+0000 7f4df2c00700 1 -- start start 2024-01-22T05:40:30.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.837+0000 7f4df2c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df2c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4dec0c7d30 0x7f4dec0be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df2c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0928b0 con 0x7f4dec1542c0 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df2c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0bef90 con 0x7f4dec0c7d30 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df2c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0bf270 con 0x7f4dec153ee0 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df0c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4dec0c7d30 0x7f4dec0be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df0c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4dec0c7d30 0x7f4dec0be9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36294/0 (socket says 172.21.15.100:36294) 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df0c00700 1 -- 172.21.15.100:0/686052316 learned_addr learned my addr 172.21.15.100:0/686052316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4debe00700 1 --2- 172.21.15.100:0/686052316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df0c00700 1 -- 172.21.15.100:0/686052316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 msgr2=0x7f4dec0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df0c00700 1 --2- 172.21.15.100:0/686052316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df0c00700 1 -- 172.21.15.100:0/686052316 >> v1:172.21.15.169:6789/0 conn(0x7f4dec1542c0 legacy=0x7f4dec0be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4df0c00700 1 -- 172.21.15.100:0/686052316 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0bfba0 con 0x7f4dec0c7d30 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.838+0000 7f4debe00700 1 --2- 172.21.15.100:0/686052316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df0c00700 1 --2- 172.21.15.100:0/686052316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0be9e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f4de4009f20 tx=0x7f4de4009840).ready entity=mon.0 client_cookie=b84d9b797d00e7dc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4deaa00700 1 -- 172.21.15.100:0/686052316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400e070 con 0x7f4dec0c7d30 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4deaa00700 1 -- 172.21.15.100:0/686052316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400ba40 con 0x7f4dec0c7d30 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4deaa00700 1 -- 172.21.15.100:0/686052316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400bdc0 con 0x7f4dec0c7d30 2024-01-22T05:40:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 -- 172.21.15.100:0/686052316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 msgr2=0x7f4dec0be9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 --2- 172.21.15.100:0/686052316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0be9e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f4de4009f20 tx=0x7f4de4009840).stop 2024-01-22T05:40:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 -- 172.21.15.100:0/686052316 shutdown_connections 2024-01-22T05:40:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 --2- 172.21.15.100:0/686052316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0be9e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 --2- 172.21.15.100:0/686052316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 -- 172.21.15.100:0/686052316 >> 172.21.15.100:0/686052316 conn(0x7f4dec091a00 msgr2=0x7f4dec091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 -- 172.21.15.100:0/686052316 shutdown_connections 2024-01-22T05:40:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.839+0000 7f4df2c00700 1 -- 172.21.15.100:0/686052316 wait complete. 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.841+0000 7f4df2c00700 1 Processor -- start 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.841+0000 7f4df2c00700 1 -- start start 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4df2c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4df2c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4df2c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dec1542c0 0x7f4dec0bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4df2c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0c0340 con 0x7f4dec0c7d30 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4df2c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0ad610 con 0x7f4dec1542c0 2024-01-22T05:40:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4df2c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0ad8f0 con 0x7f4dec153ee0 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4debe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4debe00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36296/0 (socket says 172.21.15.100:36296) 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4debe00700 1 -- 172.21.15.100:0/3115911932 learned_addr learned my addr 172.21.15.100:0/3115911932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4df0c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dec1542c0 0x7f4dec0bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4debe00700 1 -- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 msgr2=0x7f4dec0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.842+0000 7f4deb400700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4debe00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4debe00700 1 -- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dec1542c0 msgr2=0x7f4dec0bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4debe00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dec1542c0 0x7f4dec0bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4debe00700 1 -- 172.21.15.100:0/3115911932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009ae0 con 0x7f4dec0c7d30 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4df0c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dec1542c0 0x7f4dec0bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4deb400700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4debe00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0ae6b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4ddc00c880 tx=0x7f4ddc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4de3400700 1 -- 172.21.15.100:0/3115911932 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc010580 con 0x7f4dec0c7d30 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4de3400700 1 -- 172.21.15.100:0/3115911932 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0106e0 con 0x7f4dec0c7d30 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec0adbd0 con 0x7f4dec0c7d30 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4de3400700 1 -- 172.21.15.100:0/3115911932 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc010a60 con 0x7f4dec0c7d30 2024-01-22T05:40:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.843+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec0ae190 con 0x7f4dec0c7d30 2024-01-22T05:40:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.844+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec05fdb0 con 0x7f4dec0c7d30 2024-01-22T05:40:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.845+0000 7f4de3400700 1 -- 172.21.15.100:0/3115911932 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4ddc01a410 con 0x7f4dec0c7d30 2024-01-22T05:40:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.846+0000 7f4de3400700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4dc405f120 0x7f4dc40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.846+0000 7f4de3400700 1 -- 172.21.15.100:0/3115911932 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4ddc079a40 con 0x7f4dec0c7d30 2024-01-22T05:40:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.846+0000 7f4deb400700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4dc405f120 0x7f4dc40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.846+0000 7f4deb400700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4dc405f120 0x7f4dc40615e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f4dec0c8f30 tx=0x7f4dd4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:30.850+0000 7f4de3400700 1 -- 172.21.15.100:0/3115911932 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4ddc04aef0 con 0x7f4dec0c7d30 2024-01-22T05:40:31.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.016+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dec0bf550 con 0x7f4dc405f120 2024-01-22T05:40:31.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.019+0000 7f4de3400700 1 -- 172.21.15.100:0/3115911932 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71015 (secure 0 0 0) 0x7f4dec0bf550 con 0x7f4dc405f120 2024-01-22T05:40:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4dc405f120 msgr2=0x7f4dc40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4dc405f120 0x7f4dc40615e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f4dec0c8f30 tx=0x7f4dd4008040).stop 2024-01-22T05:40:31.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 msgr2=0x7f4dec0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0ae6b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4ddc00c880 tx=0x7f4ddc008040).stop 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 shutdown_connections 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f4dc405f120 0x7f4dc40615e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dec1542c0 0x7f4dec0bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dec0c7d30 0x7f4dec0ae6b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 --2- 172.21.15.100:0/3115911932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dec153ee0 0x7f4dec0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 >> 172.21.15.100:0/3115911932 conn(0x7f4dec091a00 msgr2=0x7f4dec0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 shutdown_connections 2024-01-22T05:40:31.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.021+0000 7f4df2c00700 1 -- 172.21.15.100:0/3115911932 wait complete. 2024-01-22T05:40:31.023 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:40:31.038 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-01-22T05:40:29.166377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381692,"kb_used_data":4924,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593028,"statfs":{"total":773094113280,"available":770655260672,"internally_reserved":0,"allocated":5042176,"data_stored":2221429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11844,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.125790"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.852637+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:47.852637+0000","last_peered":"2024-01-22T05:39:47.852637+0000","last_clean":"2024-01-22T05:39:47.852637+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:47.852637+0000","last_undegraded":"2024-01-22T05:39:47.852637+0000","last_fullsized":"2024-01-22T05:39:47.852637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.761733+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:39:47.761733+0000","last_peered":"2024-01-22T05:39:47.761733+0000","last_clean":"2024-01-22T05:39:47.761733+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:39:47.761733+0000","last_undegraded":"2024-01-22T05:39:47.761733+0000","last_fullsized":"2024-01-22T05:39:47.761733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.852261+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:47.852261+0000","last_peered":"2024-01-22T05:39:47.852261+0000","last_clean":"2024-01-22T05:39:47.852261+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:47.852261+0000","last_undegraded":"2024-01-22T05:39:47.852261+0000","last_fullsized":"2024-01-22T05:39:47.852261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.850715+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:47.850715+0000","last_peered":"2024-01-22T05:39:47.850715+0000","last_clean":"2024-01-22T05:39:47.850715+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:47.850715+0000","last_undegraded":"2024-01-22T05:39:47.850715+0000","last_fullsized":"2024-01-22T05:39:47.850715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.849514+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:47.849514+0000","last_peered":"2024-01-22T05:39:47.849514+0000","last_clean":"2024-01-22T05:39:47.849514+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:47.849514+0000","last_undegraded":"2024-01-22T05:39:47.849514+0000","last_fullsized":"2024-01-22T05:39:47.849514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.851721+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:47.851721+0000","last_peered":"2024-01-22T05:39:47.851721+0000","last_clean":"2024-01-22T05:39:47.851721+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:47.851721+0000","last_undegraded":"2024-01-22T05:39:47.851721+0000","last_fullsized":"2024-01-22T05:39:47.851721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.760853+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:47.760853+0000","last_peered":"2024-01-22T05:39:47.760853+0000","last_clean":"2024-01-22T05:39:47.760853+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:47.760853+0000","last_undegraded":"2024-01-22T05:39:47.760853+0000","last_fullsized":"2024-01-22T05:39:47.760853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.851242+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:47.851242+0000","last_peered":"2024-01-22T05:39:47.851242+0000","last_clean":"2024-01-22T05:39:47.851242+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:47.851242+0000","last_undegraded":"2024-01-22T05:39:47.851242+0000","last_fullsized":"2024-01-22T05:39:47.851242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.849571+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:47.849571+0000","last_peered":"2024-01-22T05:39:47.849571+0000","last_clean":"2024-01-22T05:39:47.849571+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:47.849571+0000","last_undegraded":"2024-01-22T05:39:47.849571+0000","last_fullsized":"2024-01-22T05:39:47.849571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":647168,"data_stored":292858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.53800000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.84999999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98199999999999998,"5min":1.008,"15min":1.008},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95299999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.097},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90900000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0589999999999999,"5min":1.625,"15min":1.625},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.046}]}]},{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":634880,"data_stored":278135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.95799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58599999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93200000000000005,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.625},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.371,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91800000000000004,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.82799999999999996,"5min":3.589,"15min":3.589},"last":0.55300000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88200000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.501},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94699999999999995,"5min":1.228,"15min":1.228},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.41399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.68200000000000005},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51700000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94399999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86099999999999999,"5min":1.135,"15min":1.135},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.48999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.125,"15min":1.125},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.316},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.46500000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34799999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.52900000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.59099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.372}]},{"osd":3,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.498,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.88500000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":1.038,"15min":1.038},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.54000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.875,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.97999999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.91900000000000004,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":622592,"data_stored":271178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93300000000000005,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.79800000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1080000000000001,"5min":1.355,"15min":1.355},"last":0.51400000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.71099999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.23,"15min":1.23},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.75},"min":{"1min":0.57299999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1910000000000001,"5min":1.851,"15min":1.851},"last":0.72499999999999998}]},{"osd":5,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.748},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.145,"5min":3.145,"15min":3.145},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.72499999999999998,"15min":0.69899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.61499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":647168,"data_stored":293390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.43099999999999999,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53300000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73399999999999999,"5min":1.403,"15min":1.403},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.503,"15min":0.504},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.88800000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.94399999999999995,"5min":1.655,"15min":1.655},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91200000000000003,"5min":1.004,"15min":1.004},"last":0.76700000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0129999999999999,"5min":1.595,"15min":1.595},"last":0.878},{"interface":"front","average":{"1min":0.749,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.87,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":1.536,"15min":1.536},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.63300000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0609999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.82299999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64800000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.441,"15min":0.439},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.56299999999999994,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.57399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.503},{"interface":"front","average":{"1min":0.442,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.52200000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.82299999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.754}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":0.996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.90800000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.79900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.78900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542177,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60699999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.37},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.496,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95699999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.745,"15min":0.748},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0269999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95799999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":0.81899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.006,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93300000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.026,"5min":1.137,"15min":1.137},"last":0.56299999999999994}]}]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77200000000000002,"5min":1.266,"15min":1.266},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.53000000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.753},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":1.071,"15min":1.071},"last":0.78900000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.82199999999999995,"5min":1.113,"15min":1.113},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90200000000000002,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.5},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.625},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:40:31.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:40:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.224+0000 7f0cd7e00700 1 Processor -- start 2024-01-22T05:40:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.224+0000 7f0cd7e00700 1 -- start start 2024-01-22T05:40:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.225+0000 7f0cd7e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.225+0000 7f0cd7e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0cd00c0fc0 0x7f0cd0069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.225+0000 7f0cd7e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd0065760 con 0x7f0cd006a070 2024-01-22T05:40:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.225+0000 7f0cd7e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd00bc340 con 0x7f0cd00c0fc0 2024-01-22T05:40:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.225+0000 7f0cd7e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd006a520 con 0x7f0cd00a5ab0 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd5400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd4a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0cd00c0fc0 0x7f0cd0069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd5400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:54666/0 (socket says 172.21.15.100:54666) 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd4a00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0cd00c0fc0 0x7f0cd0069b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:56976/0 (socket says 172.21.15.100:56976) 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd5400700 1 -- 172.21.15.100:0/3376702540 learned_addr learned my addr 172.21.15.100:0/3376702540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd5400700 1 -- 172.21.15.100:0/3376702540 >> v2:172.21.15.169:3300/0 conn(0x7f0cd00c0fc0 msgr2=0x7f0cd0069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd5400700 1 --2- 172.21.15.100:0/3376702540 >> v2:172.21.15.169:3300/0 conn(0x7f0cd00c0fc0 0x7f0cd0069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd5400700 1 -- 172.21.15.100:0/3376702540 >> v1:172.21.15.169:6789/0 conn(0x7f0cd006a070 legacy=0x7f0cd0153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.226+0000 7f0cd5400700 1 -- 172.21.15.100:0/3376702540 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd006a780 con 0x7f0cd00a5ab0 2024-01-22T05:40:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0cd5400700 1 --2- 172.21.15.100:0/3376702540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00a5e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0cc0006fd0 tx=0x7f0cc00090f0).ready entity=mon.2 client_cookie=d63f17203715bd26 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0ccfe00700 1 -- 172.21.15.100:0/3376702540 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000b580 con 0x7f0cd00a5ab0 2024-01-22T05:40:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0ccfe00700 1 -- 172.21.15.100:0/3376702540 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc000b6e0 con 0x7f0cd00a5ab0 2024-01-22T05:40:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0ccfe00700 1 -- 172.21.15.100:0/3376702540 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000ba80 con 0x7f0cd00a5ab0 2024-01-22T05:40:31.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0cd7e00700 1 -- 172.21.15.100:0/3376702540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 msgr2=0x7f0cd00a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/3376702540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00a5e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0cc0006fd0 tx=0x7f0cc00090f0).stop 2024-01-22T05:40:31.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0cd7e00700 1 -- 172.21.15.100:0/3376702540 shutdown_connections 2024-01-22T05:40:31.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/3376702540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00a5e90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/3376702540 >> v2:172.21.15.169:3300/0 conn(0x7f0cd00c0fc0 0x7f0cd0069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.227+0000 7f0cd7e00700 1 -- 172.21.15.100:0/3376702540 >> 172.21.15.100:0/3376702540 conn(0x7f0cd0063090 msgr2=0x7f0cd00c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.228+0000 7f0cd7e00700 1 -- 172.21.15.100:0/3376702540 shutdown_connections 2024-01-22T05:40:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.228+0000 7f0cd7e00700 1 -- 172.21.15.100:0/3376702540 wait complete. 2024-01-22T05:40:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.229+0000 7f0cd7e00700 1 Processor -- start 2024-01-22T05:40:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.229+0000 7f0cd7e00700 1 -- start start 2024-01-22T05:40:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd7e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd006a070 0x7f0cd00bf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd7e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00bda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd7e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cd00c0fc0 0x7f0cd00bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd7e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd013cf20 con 0x7f0cd006a070 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd7e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd00bf580 con 0x7f0cd00c0fc0 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd7e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0168670 con 0x7f0cd00a5ab0 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd5400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd006a070 0x7f0cd00bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd5400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd006a070 0x7f0cd00bf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36312/0 (socket says 172.21.15.100:36312) 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.230+0000 7f0cd5400700 1 -- 172.21.15.100:0/295136958 learned_addr learned my addr 172.21.15.100:0/295136958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd4a00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5400700 1 -- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 msgr2=0x7f0cd00bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cd00c0fc0 0x7f0cd00bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5400700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00bda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5400700 1 -- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cd00c0fc0 msgr2=0x7f0cd00bdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5400700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cd00c0fc0 0x7f0cd00bdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5400700 1 -- 172.21.15.100:0/295136958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0009370 con 0x7f0cd006a070 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd4a00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cd00c0fc0 0x7f0cd00bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd5400700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd006a070 0x7f0cd00bf090 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0cc0009ea0 tx=0x7f0cc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cccc00700 1 -- 172.21.15.100:0/295136958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000be40 con 0x7f0cd006a070 2024-01-22T05:40:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cccc00700 1 -- 172.21.15.100:0/295136958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc000b850 con 0x7f0cd006a070 2024-01-22T05:40:31.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd00ac4d0 con 0x7f0cd006a070 2024-01-22T05:40:31.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cccc00700 1 -- 172.21.15.100:0/295136958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc001c420 con 0x7f0cd006a070 2024-01-22T05:40:31.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.231+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd00be5d0 con 0x7f0cd006a070 2024-01-22T05:40:31.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.232+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd005fdb0 con 0x7f0cd006a070 2024-01-22T05:40:31.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.233+0000 7f0cccc00700 1 -- 172.21.15.100:0/295136958 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0cc001c790 con 0x7f0cd006a070 2024-01-22T05:40:31.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.234+0000 7f0cccc00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0ca805f150 0x7f0ca8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.234+0000 7f0cccc00700 1 -- 172.21.15.100:0/295136958 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0cc007bb20 con 0x7f0cd006a070 2024-01-22T05:40:31.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.234+0000 7f0cd4a00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0ca805f150 0x7f0ca8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.234+0000 7f0cd4a00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0ca805f150 0x7f0ca8061610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0cb8006d80 tx=0x7f0cb8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:31.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.238+0000 7f0cccc00700 1 -- 172.21.15.100:0/295136958 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0cc004d0f0 con 0x7f0cd006a070 2024-01-22T05:40:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.407+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0cd01687b0 con 0x7f0ca805f150 2024-01-22T05:40:31.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.410+0000 7f0cccc00700 1 -- 172.21.15.100:0/295136958 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71015 (secure 0 0 0) 0x7f0cb80097c0 con 0x7f0ca805f150 2024-01-22T05:40:31.411 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.412+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0ca805f150 msgr2=0x7f0ca8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.412+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0ca805f150 0x7f0ca8061610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0cb8006d80 tx=0x7f0cb8008040).stop 2024-01-22T05:40:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.412+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd006a070 msgr2=0x7f0cd00bf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.412+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd006a070 0x7f0cd00bf090 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0cc0009ea0 tx=0x7f0cc0017000).stop 2024-01-22T05:40:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 shutdown_connections 2024-01-22T05:40:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f0ca805f150 0x7f0ca8061610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cd00c0fc0 0x7f0cd00bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd006a070 0x7f0cd00bf090 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 --2- 172.21.15.100:0/295136958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cd00a5ab0 0x7f0cd00bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 >> 172.21.15.100:0/295136958 conn(0x7f0cd0063090 msgr2=0x7f0cd00c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 shutdown_connections 2024-01-22T05:40:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.413+0000 7f0cd7e00700 1 -- 172.21.15.100:0/295136958 wait complete. 2024-01-22T05:40:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:40:31.430 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-01-22T05:40:31.166681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381728,"kb_used_data":4960,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752592992,"statfs":{"total":773094113280,"available":770655223808,"internally_reserved":0,"allocated":5079040,"data_stored":2240186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11844,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.125790"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.852637+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:47.852637+0000","last_peered":"2024-01-22T05:39:47.852637+0000","last_clean":"2024-01-22T05:39:47.852637+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:47.852637+0000","last_undegraded":"2024-01-22T05:39:47.852637+0000","last_fullsized":"2024-01-22T05:39:47.852637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.294656+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:40:27.294656+0000","last_peered":"2024-01-22T05:40:27.294656+0000","last_clean":"2024-01-22T05:40:27.294656+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:40:27.294656+0000","last_undegraded":"2024-01-22T05:40:27.294656+0000","last_fullsized":"2024-01-22T05:40:27.294656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.852261+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:47.852261+0000","last_peered":"2024-01-22T05:39:47.852261+0000","last_clean":"2024-01-22T05:39:47.852261+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:47.852261+0000","last_undegraded":"2024-01-22T05:39:47.852261+0000","last_fullsized":"2024-01-22T05:39:47.852261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.850715+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:47.850715+0000","last_peered":"2024-01-22T05:39:47.850715+0000","last_clean":"2024-01-22T05:39:47.850715+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:47.850715+0000","last_undegraded":"2024-01-22T05:39:47.850715+0000","last_fullsized":"2024-01-22T05:39:47.850715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.849514+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:47.849514+0000","last_peered":"2024-01-22T05:39:47.849514+0000","last_clean":"2024-01-22T05:39:47.849514+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:47.849514+0000","last_undegraded":"2024-01-22T05:39:47.849514+0000","last_fullsized":"2024-01-22T05:39:47.849514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.851721+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:47.851721+0000","last_peered":"2024-01-22T05:39:47.851721+0000","last_clean":"2024-01-22T05:39:47.851721+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:47.851721+0000","last_undegraded":"2024-01-22T05:39:47.851721+0000","last_fullsized":"2024-01-22T05:39:47.851721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.760853+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:47.760853+0000","last_peered":"2024-01-22T05:39:47.760853+0000","last_clean":"2024-01-22T05:39:47.760853+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:47.760853+0000","last_undegraded":"2024-01-22T05:39:47.760853+0000","last_fullsized":"2024-01-22T05:39:47.760853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.851242+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:47.851242+0000","last_peered":"2024-01-22T05:39:47.851242+0000","last_clean":"2024-01-22T05:39:47.851242+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:47.851242+0000","last_undegraded":"2024-01-22T05:39:47.851242+0000","last_fullsized":"2024-01-22T05:39:47.851242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.849571+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:47.849571+0000","last_peered":"2024-01-22T05:39:47.849571+0000","last_clean":"2024-01-22T05:39:47.849571+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:47.849571+0000","last_undegraded":"2024-01-22T05:39:47.849571+0000","last_fullsized":"2024-01-22T05:39:47.849571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":647168,"data_stored":292858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.53800000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.84999999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98199999999999998,"5min":1.008,"15min":1.008},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95299999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.097},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90900000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0589999999999999,"5min":1.625,"15min":1.625},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.046}]}]},{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":634880,"data_stored":278135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.95799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58599999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93200000000000005,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.625},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.371,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91800000000000004,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.82799999999999996,"5min":3.589,"15min":3.589},"last":0.55300000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88200000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.501},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94699999999999995,"5min":1.228,"15min":1.228},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.41399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.68200000000000005},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51700000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94399999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86099999999999999,"5min":1.135,"15min":1.135},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.48999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.125,"15min":1.125},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.316},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.46500000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34799999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.52900000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.59099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.372}]},{"osd":3,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.498,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.88500000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":1.038,"15min":1.038},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.54000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.875,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.97999999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.91900000000000004,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93300000000000005,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1080000000000001,"5min":1.355,"15min":1.355},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.23,"15min":1.23},"last":0.746},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.75},"min":{"1min":0.57299999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1910000000000001,"5min":1.851,"15min":1.851},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.145,"5min":3.145,"15min":3.145},"last":0.68600000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.72499999999999998,"15min":0.69899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.65100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":647168,"data_stored":293390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.43099999999999999,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53300000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73399999999999999,"5min":1.403,"15min":1.403},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.503,"15min":0.504},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.88800000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.94399999999999995,"5min":1.655,"15min":1.655},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91200000000000003,"5min":1.004,"15min":1.004},"last":0.76700000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0129999999999999,"5min":1.595,"15min":1.595},"last":0.878},{"interface":"front","average":{"1min":0.749,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.87,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":1.536,"15min":1.536},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.63300000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0609999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.82299999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64800000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.441,"15min":0.439},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.56299999999999994,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.57399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.503},{"interface":"front","average":{"1min":0.442,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.52200000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.82299999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.754}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":0.996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.90800000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.79900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.78900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542177,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60699999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.37},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.496,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95699999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.745,"15min":0.748},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0269999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95799999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":0.81899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.006,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93300000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.026,"5min":1.137,"15min":1.137},"last":0.56299999999999994}]}]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77200000000000002,"5min":1.266,"15min":1.266},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.53000000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.753},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":1.071,"15min":1.071},"last":0.78900000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.82199999999999995,"5min":1.113,"15min":1.113},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90200000000000002,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.5},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.625},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:40:31.432 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-22T05:40:31.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:40:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.617+0000 7f0945e00700 1 Processor -- start 2024-01-22T05:40:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.617+0000 7f0945e00700 1 -- start start 2024-01-22T05:40:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.618+0000 7f0945e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09400c14e0 0x7f09400c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.618+0000 7f0945e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09400a5280 con 0x7f0940065820 2024-01-22T05:40:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.618+0000 7f0945e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09400a5560 con 0x7f09400bc2d0 2024-01-22T05:40:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.618+0000 7f0945e00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09400a5f00 con 0x7f09400c14e0 2024-01-22T05:40:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.618+0000 7f093ea00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09400c14e0 0x7f09400c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.618+0000 7f093f400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0940065820 0x7f094015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43392/0 (socket says 172.21.15.100:43392) 2024-01-22T05:40:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.618+0000 7f093f400700 1 -- 172.21.15.100:0/1743055398 learned_addr learned my addr 172.21.15.100:0/1743055398 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093ea00700 1 -- 172.21.15.100:0/1743055398 >> v1:172.21.15.169:6789/0 conn(0x7f09400bc2d0 legacy=0x7f09400c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093ea00700 1 -- 172.21.15.100:0/1743055398 >> v1:172.21.15.100:6789/0 conn(0x7f0940065820 legacy=0x7f094015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093ea00700 1 -- 172.21.15.100:0/1743055398 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400a5840 con 0x7f09400c14e0 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093d600700 1 -- 172.21.15.100:0/1743055398 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976826593 0 0) 0x7f09400a5280 con 0x7f0940065820 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093ea00700 1 --2- 172.21.15.100:0/1743055398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09400c14e0 0x7f09400c2bc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0930009760 tx=0x7f0930009060).ready entity=mon.0 client_cookie=39c06b1e28a1d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093d600700 1 -- 172.21.15.100:0/1743055398 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000b520 con 0x7f09400c14e0 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093d600700 1 -- 172.21.15.100:0/1743055398 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000b680 con 0x7f09400c14e0 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.619+0000 7f093d600700 1 -- 172.21.15.100:0/1743055398 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000ba00 con 0x7f09400c14e0 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.620+0000 7f0945e00700 1 -- 172.21.15.100:0/1743055398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09400c14e0 msgr2=0x7f09400c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.620+0000 7f0945e00700 1 --2- 172.21.15.100:0/1743055398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09400c14e0 0x7f09400c2bc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0930009760 tx=0x7f0930009060).stop 2024-01-22T05:40:31.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.620+0000 7f0945e00700 1 -- 172.21.15.100:0/1743055398 shutdown_connections 2024-01-22T05:40:31.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.620+0000 7f0945e00700 1 --2- 172.21.15.100:0/1743055398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09400c14e0 0x7f09400c2bc0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.620+0000 7f0945e00700 1 -- 172.21.15.100:0/1743055398 >> 172.21.15.100:0/1743055398 conn(0x7f0940063090 msgr2=0x7f09400c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:31.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.620+0000 7f0945e00700 1 -- 172.21.15.100:0/1743055398 shutdown_connections 2024-01-22T05:40:31.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.620+0000 7f0945e00700 1 -- 172.21.15.100:0/1743055398 wait complete. 2024-01-22T05:40:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.621+0000 7f0945e00700 1 Processor -- start 2024-01-22T05:40:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.622+0000 7f0945e00700 1 -- start start 2024-01-22T05:40:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.622+0000 7f0945e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940065820 0x7f09401426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.622+0000 7f0945e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09400bc2d0 0x7f0940069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.622+0000 7f0945e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09400c14e0 0x7f0940069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.622+0000 7f0945e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940069d40 con 0x7f0940065820 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.622+0000 7f0945e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940142be0 con 0x7f09400bc2d0 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.622+0000 7f0945e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400a6540 con 0x7f09400c14e0 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940065820 0x7f09401426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940065820 0x7f09401426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36318/0 (socket says 172.21.15.100:36318) 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 -- 172.21.15.100:0/1267203876 learned_addr learned my addr 172.21.15.100:0/1267203876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093e000700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09400bc2d0 0x7f0940069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093f400700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09400c14e0 0x7f0940069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 -- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09400c14e0 msgr2=0x7f0940069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09400c14e0 0x7f0940069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 -- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09400bc2d0 msgr2=0x7f0940069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09400bc2d0 0x7f0940069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 -- 172.21.15.100:0/1267203876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300092a0 con 0x7f0940065820 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093f400700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09400c14e0 0x7f0940069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:31.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f093ea00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940065820 0x7f09401426f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f0930009eb0 tx=0x7f0930017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.623+0000 7f0936000700 1 -- 172.21.15.100:0/1267203876 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000b7f0 con 0x7f0940065820 2024-01-22T05:40:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.624+0000 7f0936000700 1 -- 172.21.15.100:0/1267203876 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000b950 con 0x7f0940065820 2024-01-22T05:40:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.624+0000 7f0936000700 1 -- 172.21.15.100:0/1267203876 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093001b650 con 0x7f0940065820 2024-01-22T05:40:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.624+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09400a6820 con 0x7f0940065820 2024-01-22T05:40:31.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.624+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09400a6de0 con 0x7f0940065820 2024-01-22T05:40:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.625+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094005fdb0 con 0x7f0940065820 2024-01-22T05:40:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.625+0000 7f0936000700 1 -- 172.21.15.100:0/1267203876 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f093001ba00 con 0x7f0940065820 2024-01-22T05:40:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.626+0000 7f0936000700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f091805f120 0x7f09180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.626+0000 7f0936000700 1 -- 172.21.15.100:0/1267203876 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f093007b7a0 con 0x7f0940065820 2024-01-22T05:40:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.626+0000 7f093e000700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f091805f120 0x7f09180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:31.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.627+0000 7f093e000700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f091805f120 0x7f09180615e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f09400ac8b0 tx=0x7f0928007d20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:31.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.630+0000 7f0936000700 1 -- 172.21.15.100:0/1267203876 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f093004cd70 con 0x7f0940065820 2024-01-22T05:40:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.798+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09400a5b20 con 0x7f091805f120 2024-01-22T05:40:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.801+0000 7f0936000700 1 -- 172.21.15.100:0/1267203876 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71015 (secure 0 0 0) 0x7f09400a5b20 con 0x7f091805f120 2024-01-22T05:40:31.802 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.803+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f091805f120 msgr2=0x7f09180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.803+0000 7f0945e00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f091805f120 0x7f09180615e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f09400ac8b0 tx=0x7f0928007d20).stop 2024-01-22T05:40:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940065820 msgr2=0x7f09401426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940065820 0x7f09401426f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f0930009eb0 tx=0x7f0930017000).stop 2024-01-22T05:40:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 shutdown_connections 2024-01-22T05:40:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f091805f120 0x7f09180615e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09400c14e0 0x7f0940069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940065820 0x7f09401426f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 --2- 172.21.15.100:0/1267203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09400bc2d0 0x7f0940069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 >> 172.21.15.100:0/1267203876 conn(0x7f0940063090 msgr2=0x7f09401539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 shutdown_connections 2024-01-22T05:40:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:31.804+0000 7f0945e00700 1 -- 172.21.15.100:0/1267203876 wait complete. 2024-01-22T05:40:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:40:31.821 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-01-22T05:40:31.166681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381728,"kb_used_data":4960,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752592992,"statfs":{"total":773094113280,"available":770655223808,"internally_reserved":0,"allocated":5079040,"data_stored":2240186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11844,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.125790"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.852637+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:39:47.852637+0000","last_peered":"2024-01-22T05:39:47.852637+0000","last_clean":"2024-01-22T05:39:47.852637+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:39:47.852637+0000","last_undegraded":"2024-01-22T05:39:47.852637+0000","last_fullsized":"2024-01-22T05:39:47.852637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.294656+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:40:27.294656+0000","last_peered":"2024-01-22T05:40:27.294656+0000","last_clean":"2024-01-22T05:40:27.294656+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:40:27.294656+0000","last_undegraded":"2024-01-22T05:40:27.294656+0000","last_fullsized":"2024-01-22T05:40:27.294656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.852261+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:39:47.852261+0000","last_peered":"2024-01-22T05:39:47.852261+0000","last_clean":"2024-01-22T05:39:47.852261+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:39:47.852261+0000","last_undegraded":"2024-01-22T05:39:47.852261+0000","last_fullsized":"2024-01-22T05:39:47.852261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.850715+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:39:47.850715+0000","last_peered":"2024-01-22T05:39:47.850715+0000","last_clean":"2024-01-22T05:39:47.850715+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:39:47.850715+0000","last_undegraded":"2024-01-22T05:39:47.850715+0000","last_fullsized":"2024-01-22T05:39:47.850715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.849514+0000","last_change":"2024-01-22T05:37:52.197825+0000","last_active":"2024-01-22T05:39:47.849514+0000","last_peered":"2024-01-22T05:39:47.849514+0000","last_clean":"2024-01-22T05:39:47.849514+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:39:47.849514+0000","last_undegraded":"2024-01-22T05:39:47.849514+0000","last_fullsized":"2024-01-22T05:39:47.849514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:51.179660+0000","last_clean_scrub_stamp":"2024-01-22T05:37:51.179660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.851721+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:39:47.851721+0000","last_peered":"2024-01-22T05:39:47.851721+0000","last_clean":"2024-01-22T05:39:47.851721+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:39:47.851721+0000","last_undegraded":"2024-01-22T05:39:47.851721+0000","last_fullsized":"2024-01-22T05:39:47.851721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.760853+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:39:47.760853+0000","last_peered":"2024-01-22T05:39:47.760853+0000","last_clean":"2024-01-22T05:39:47.760853+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:39:47.760853+0000","last_undegraded":"2024-01-22T05:39:47.760853+0000","last_fullsized":"2024-01-22T05:39:47.760853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.851242+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:39:47.851242+0000","last_peered":"2024-01-22T05:39:47.851242+0000","last_clean":"2024-01-22T05:39:47.851242+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:39:47.851242+0000","last_undegraded":"2024-01-22T05:39:47.851242+0000","last_fullsized":"2024-01-22T05:39:47.851242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-22T05:39:47.849571+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:39:47.849571+0000","last_peered":"2024-01-22T05:39:47.849571+0000","last_clean":"2024-01-22T05:39:47.849571+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:39:47.849571+0000","last_undegraded":"2024-01-22T05:39:47.849571+0000","last_fullsized":"2024-01-22T05:39:47.849571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":647168,"data_stored":292858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.53800000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.84999999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98199999999999998,"5min":1.008,"15min":1.008},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95299999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.097},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90900000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0589999999999999,"5min":1.625,"15min":1.625},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.046}]}]},{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":634880,"data_stored":278135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.95799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58599999999999997}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93200000000000005,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.625},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.371,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91800000000000004,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.82799999999999996,"5min":3.589,"15min":3.589},"last":0.55300000000000005}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88200000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.501},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94699999999999995,"5min":1.228,"15min":1.228},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.41399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.68200000000000005},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51700000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94399999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86099999999999999,"5min":1.135,"15min":1.135},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.48999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.125,"15min":1.125},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.316},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.46500000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34799999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.52900000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.59099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.372}]},{"osd":3,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.498,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.88500000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":1.038,"15min":1.038},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.54000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.875,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.97999999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.91900000000000004,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93300000000000005,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1080000000000001,"5min":1.355,"15min":1.355},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.23,"15min":1.23},"last":0.746},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.75},"min":{"1min":0.57299999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1910000000000001,"5min":1.851,"15min":1.851},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.145,"5min":3.145,"15min":3.145},"last":0.68600000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.72499999999999998,"15min":0.69899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.65100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":647168,"data_stored":293390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.43099999999999999,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53300000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73399999999999999,"5min":1.403,"15min":1.403},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.503,"15min":0.504},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.88800000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.94399999999999995,"5min":1.655,"15min":1.655},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91200000000000003,"5min":1.004,"15min":1.004},"last":0.76700000000000002}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0129999999999999,"5min":1.595,"15min":1.595},"last":0.878},{"interface":"front","average":{"1min":0.749,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.87,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":1.536,"15min":1.536},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.63300000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0609999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.82299999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":626688,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64800000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.441,"15min":0.439},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.56299999999999994,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.57399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.503},{"interface":"front","average":{"1min":0.442,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.52200000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.82299999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.754}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":0.996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.90800000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.79900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.78900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542177,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60699999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.37},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.496,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95699999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.745,"15min":0.748},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0269999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95799999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":0.81899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.006,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93300000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.026,"5min":1.137,"15min":1.137},"last":0.56299999999999994}]}]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":618496,"data_stored":271108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77200000000000002,"5min":1.266,"15min":1.266},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.53000000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.753},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":1.071,"15min":1.071},"last":0.78900000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.82199999999999995,"5min":1.113,"15min":1.113},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90200000000000002,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.5},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.625},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:40:31.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T05:40:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.006+0000 7ff229a00700 1 Processor -- start 2024-01-22T05:40:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.006+0000 7ff229a00700 1 -- start start 2024-01-22T05:40:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff229a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff2240a58a0 0x7ff22406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff229a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240a5c80 0x7ff224064b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff229a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff224065c90 con 0x7ff2240681e0 2024-01-22T05:40:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff229a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22406a790 con 0x7ff2240a58a0 2024-01-22T05:40:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff229a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240bba50 con 0x7ff2240a5c80 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff222a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff2240a58a0 0x7ff22406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff222a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff2240a58a0 0x7ff22406a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36330/0 (socket says 172.21.15.100:36330) 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff222a00700 1 -- 172.21.15.100:0/3045385891 learned_addr learned my addr 172.21.15.100:0/3045385891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.007+0000 7ff222000700 1 --2- 172.21.15.100:0/3045385891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240a5c80 0x7ff224064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff222a00700 1 -- 172.21.15.100:0/3045385891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240a5c80 msgr2=0x7ff224064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff222a00700 1 --2- 172.21.15.100:0/3045385891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240a5c80 0x7ff224064b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff222a00700 1 -- 172.21.15.100:0/3045385891 >> v1:172.21.15.169:6789/0 conn(0x7ff2240681e0 legacy=0x7ff224155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff222a00700 1 -- 172.21.15.100:0/3045385891 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2240653f0 con 0x7ff2240a58a0 2024-01-22T05:40:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff222a00700 1 --2- 172.21.15.100:0/3045385891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff22406a2a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7ff214006fd0 tx=0x7ff2140090f0).ready entity=mon.0 client_cookie=8f44c77d9bf94147 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:32.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff221600700 1 -- 172.21.15.100:0/3045385891 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400b580 con 0x7ff2240a58a0 2024-01-22T05:40:32.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff221600700 1 -- 172.21.15.100:0/3045385891 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21400b6e0 con 0x7ff2240a58a0 2024-01-22T05:40:32.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.008+0000 7ff221600700 1 -- 172.21.15.100:0/3045385891 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400ba60 con 0x7ff2240a58a0 2024-01-22T05:40:32.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 -- 172.21.15.100:0/3045385891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 msgr2=0x7ff22406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:32.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 --2- 172.21.15.100:0/3045385891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff22406a2a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7ff214006fd0 tx=0x7ff2140090f0).stop 2024-01-22T05:40:32.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 -- 172.21.15.100:0/3045385891 shutdown_connections 2024-01-22T05:40:32.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 --2- 172.21.15.100:0/3045385891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff22406a2a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 --2- 172.21.15.100:0/3045385891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240a5c80 0x7ff224064b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 -- 172.21.15.100:0/3045385891 >> 172.21.15.100:0/3045385891 conn(0x7ff224063090 msgr2=0x7ff2240c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 -- 172.21.15.100:0/3045385891 shutdown_connections 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.009+0000 7ff229a00700 1 -- 172.21.15.100:0/3045385891 wait complete. 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.010+0000 7ff229a00700 1 Processor -- start 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.010+0000 7ff229a00700 1 -- start start 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.011+0000 7ff229a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240681e0 0x7ff224165310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.011+0000 7ff229a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff2240ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.011+0000 7ff229a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2240a5c80 0x7ff2240bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.011+0000 7ff229a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff224163190 con 0x7ff2240a58a0 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.011+0000 7ff229a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2241625c0 con 0x7ff2240a5c80 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.011+0000 7ff229a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff224165800 con 0x7ff2240681e0 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff2240ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff2240ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36342/0 (socket says 172.21.15.100:36342) 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 -- 172.21.15.100:0/713868161 learned_addr learned my addr 172.21.15.100:0/713868161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240681e0 0x7ff224165310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff223400700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2240a5c80 0x7ff2240bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 -- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240681e0 msgr2=0x7ff224165310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240681e0 0x7ff224165310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 -- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2240a5c80 msgr2=0x7ff2240bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:32.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2240a5c80 0x7ff2240bf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 -- 172.21.15.100:0/713868161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214009370 con 0x7ff2240a58a0 2024-01-22T05:40:32.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.012+0000 7ff222000700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff2240ac480 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7ff20c00e8d0 tx=0x7ff20c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:32.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.013+0000 7ff21a000700 1 -- 172.21.15.100:0/713868161 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c012600 con 0x7ff2240a58a0 2024-01-22T05:40:32.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.013+0000 7ff21a000700 1 -- 172.21.15.100:0/713868161 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c012760 con 0x7ff2240a58a0 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.013+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224162860 con 0x7ff2240a58a0 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.013+0000 7ff21a000700 1 -- 172.21.15.100:0/713868161 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c012ae0 con 0x7ff2240a58a0 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.013+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff224162e20 con 0x7ff2240a58a0 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.014+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224162fb0 con 0x7ff2240a58a0 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.014+0000 7ff21a000700 1 -- 172.21.15.100:0/713868161 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff20c01b400 con 0x7ff2240a58a0 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.015+0000 7ff21a000700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff1fc05f150 0x7ff1fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.015+0000 7ff21a000700 1 -- 172.21.15.100:0/713868161 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff20c07a300 con 0x7ff2240a58a0 2024-01-22T05:40:32.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.015+0000 7ff222a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff1fc05f150 0x7ff1fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:32.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.016+0000 7ff222a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff1fc05f150 0x7ff1fc061610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff214009fd0 tx=0x7ff214017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:32.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.019+0000 7ff21a000700 1 -- 172.21.15.100:0/713868161 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff20c04b810 con 0x7ff2240a58a0 2024-01-22T05:40:32.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.189+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff22405fdb0 con 0x7ff2240a58a0 2024-01-22T05:40:32.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.190+0000 7ff21a000700 1 -- 172.21.15.100:0/713868161 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+13891 (secure 0 0 0) 0x7ff20c016070 con 0x7ff2240a58a0 2024-01-22T05:40:32.190 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:32.190 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"fsid":"2373e7ef-4ea1-4c09-a2b1-243cb5e8dade","created":"2024-01-22T05:37:39.361006+0000","modified":"2024-01-22T05:40:28.289597+0000","last_up_change":"2024-01-22T05:37:50.165508+0000","last_in_change":"2024-01-22T05:37:42.671647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-22T05:37:50.230655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-22T05:37:51.763565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"0be2e69c-1c5c-409e-b9f7-9bc05b0fc24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":71172},{"type":"v1","addr":"172.21.15.100:6809","nonce":71172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":71172},{"type":"v1","addr":"172.21.15.100:6811","nonce":71172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":71172},{"type":"v1","addr":"172.21.15.100:6815","nonce":71172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":71172},{"type":"v1","addr":"172.21.15.100:6813","nonce":71172}]},"public_addr":"172.21.15.100:6809/71172","cluster_addr":"172.21.15.100:6811/71172","heartbeat_back_addr":"172.21.15.100:6815/71172","heartbeat_front_addr":"172.21.15.100:6813/71172","state":["exists","up"]},{"osd":1,"uuid":"e3fa0f3d-b64f-4171-8e6e-e9a05c475621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":71171},{"type":"v1","addr":"172.21.15.100:6801","nonce":71171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":71171},{"type":"v1","addr":"172.21.15.100:6803","nonce":71171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":71171},{"type":"v1","addr":"172.21.15.100:6807","nonce":71171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":71171},{"type":"v1","addr":"172.21.15.100:6805","nonce":71171}]},"public_addr":"172.21.15.100:6801/71171","cluster_addr":"172.21.15.100:6803/71171","heartbeat_back_addr":"172.21.15.100:6807/71171","heartbeat_front_addr":"172.21.15.100:6805/71171","state":["exists","up"]},{"osd":2,"uuid":"eeb3045c-1006-4507-81b8-f3e5aa64f58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":71181},{"type":"v1","addr":"172.21.15.100:6819","nonce":71181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":71181},{"type":"v1","addr":"172.21.15.100:6824","nonce":71181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":71181},{"type":"v1","addr":"172.21.15.100:6831","nonce":71181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":71181},{"type":"v1","addr":"172.21.15.100:6829","nonce":71181}]},"public_addr":"172.21.15.100:6819/71181","cluster_addr":"172.21.15.100:6824/71181","heartbeat_back_addr":"172.21.15.100:6831/71181","heartbeat_front_addr":"172.21.15.100:6829/71181","state":["exists","up"]},{"osd":3,"uuid":"c104c1a5-b0ff-49b1-aff1-e15ea0da5d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":71188},{"type":"v1","addr":"172.21.15.100:6818","nonce":71188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":71188},{"type":"v1","addr":"172.21.15.100:6822","nonce":71188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":71188},{"type":"v1","addr":"172.21.15.100:6828","nonce":71188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":71188},{"type":"v1","addr":"172.21.15.100:6825","nonce":71188}]},"public_addr":"172.21.15.100:6818/71188","cluster_addr":"172.21.15.100:6822/71188","heartbeat_back_addr":"172.21.15.100:6828/71188","heartbeat_front_addr":"172.21.15.100:6825/71188","state":["exists","up"]},{"osd":4,"uuid":"8e126466-6240-4a2b-a018-9acb4c33339d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":71444},{"type":"v1","addr":"172.21.15.169:6801","nonce":71444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":71444},{"type":"v1","addr":"172.21.15.169:6803","nonce":71444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":71444},{"type":"v1","addr":"172.21.15.169:6807","nonce":71444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":71444},{"type":"v1","addr":"172.21.15.169:6805","nonce":71444}]},"public_addr":"172.21.15.169:6801/71444","cluster_addr":"172.21.15.169:6803/71444","heartbeat_back_addr":"172.21.15.169:6807/71444","heartbeat_front_addr":"172.21.15.169:6805/71444","state":["exists","up"]},{"osd":5,"uuid":"d750198a-b937-4f26-9296-d869c978a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":71446},{"type":"v1","addr":"172.21.15.169:6809","nonce":71446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":71446},{"type":"v1","addr":"172.21.15.169:6811","nonce":71446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":71446},{"type":"v1","addr":"172.21.15.169:6815","nonce":71446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":71446},{"type":"v1","addr":"172.21.15.169:6813","nonce":71446}]},"public_addr":"172.21.15.169:6809/71446","cluster_addr":"172.21.15.169:6811/71446","heartbeat_back_addr":"172.21.15.169:6815/71446","heartbeat_front_addr":"172.21.15.169:6813/71446","state":["exists","up"]},{"osd":6,"uuid":"2479324c-1b69-4eae-9ef0-adad8ddf1f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6823","nonce":71469},{"type":"v1","addr":"172.21.15.169:6825","nonce":71469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":71469},{"type":"v1","addr":"172.21.15.169:6827","nonce":71469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":71469},{"type":"v1","addr":"172.21.15.169:6831","nonce":71469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":71469},{"type":"v1","addr":"172.21.15.169:6829","nonce":71469}]},"public_addr":"172.21.15.169:6825/71469","cluster_addr":"172.21.15.169:6827/71469","heartbeat_back_addr":"172.21.15.169:6831/71469","heartbeat_front_addr":"172.21.15.169:6829/71469","state":["exists","up"]},{"osd":7,"uuid":"7c3441e2-5820-4513-a604-10d364a30aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":71472},{"type":"v1","addr":"172.21.15.169:6817","nonce":71472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":71472},{"type":"v1","addr":"172.21.15.169:6819","nonce":71472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":71472},{"type":"v1","addr":"172.21.15.169:6824","nonce":71472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":71472},{"type":"v1","addr":"172.21.15.169:6821","nonce":71472}]},"public_addr":"172.21.15.169:6817/71472","cluster_addr":"172.21.15.169:6819/71472","heartbeat_back_addr":"172.21.15.169:6824/71472","heartbeat_front_addr":"172.21.15.169:6821/71472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.186811+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.116479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.221613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.190454+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.106737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.217650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.213810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T05:37:48.200536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/2256257950":"2024-01-23T05:40:24.729183+0000","172.21.15.100:6835/2256257950":"2024-01-23T05:40:24.729183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T05:40:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.192+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff1fc05f150 msgr2=0x7ff1fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.192+0000 7ff229a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff1fc05f150 0x7ff1fc061610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff214009fd0 tx=0x7ff214017000).stop 2024-01-22T05:40:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.192+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 msgr2=0x7ff2240ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.192+0000 7ff229a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff2240ac480 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7ff20c00e8d0 tx=0x7ff20c009060).stop 2024-01-22T05:40:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 shutdown_connections 2024-01-22T05:40:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7ff1fc05f150 0x7ff1fc061610 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2240a5c80 0x7ff2240bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2240681e0 0x7ff224165310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 --2- 172.21.15.100:0/713868161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2240a58a0 0x7ff2240ac480 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:32.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 >> 172.21.15.100:0/713868161 conn(0x7ff224063090 msgr2=0x7ff2240c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:32.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 shutdown_connections 2024-01-22T05:40:32.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:32.193+0000 7ff229a00700 1 -- 172.21.15.100:0/713868161 wait complete. 2024-01-22T05:40:33.212 INFO:tasks.ceph:Scrubbing osd.0 2024-01-22T05:40:33.212 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:33.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.411+0000 7fa6d1e00700 1 Processor -- start 2024-01-22T05:40:33.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.411+0000 7fa6d1e00700 1 -- start start 2024-01-22T05:40:33.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.412+0000 7fa6d1e00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa6cc157290 0x7fa6cc092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.412+0000 7fa6d1e00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc065000 con 0x7fa6cc092600 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.412+0000 7fa6d1e00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0643f0 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.412+0000 7fa6d1e00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc0646d0 con 0x7fa6cc157290 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.412+0000 7fa6ca000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa6cc092600 0x7fa6cc0c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37364/0 (socket says 172.21.15.100:37364) 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.412+0000 7fa6ca000700 1 -- 172.21.15.100:0/650750085 learned_addr learned my addr 172.21.15.100:0/650750085 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6caa00700 1 --2- 172.21.15.100:0/650750085 >> v2:172.21.15.169:3300/0 conn(0x7fa6cc157290 0x7fa6cc092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6c9600700 1 -- 172.21.15.100:0/650750085 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369552589 0 0) 0x7fa6cc065000 con 0x7fa6cc092600 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6c9600700 1 -- 172.21.15.100:0/650750085 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6ac0033f0 con 0x7fa6cc092600 2024-01-22T05:40:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6c9600700 1 -- 172.21.15.100:0/650750085 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774274734 0 0) 0x7fa6cc0643f0 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6c9600700 1 -- 172.21.15.100:0/650750085 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6cc065000 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6caa00700 1 -- 172.21.15.100:0/650750085 >> v1:172.21.15.169:6789/0 conn(0x7fa6cc0c5b80 legacy=0x7fa6cc0c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6caa00700 1 -- 172.21.15.100:0/650750085 >> v1:172.21.15.100:6789/0 conn(0x7fa6cc092600 legacy=0x7fa6cc0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6caa00700 1 -- 172.21.15.100:0/650750085 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0649b0 con 0x7fa6cc157290 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.413+0000 7fa6caa00700 1 --2- 172.21.15.100:0/650750085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc157290 0x7fa6cc092110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fa6cc05ee20 tx=0x7fa6bc009060).ready entity=mon.1 client_cookie=55275391bd233c26 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6c9600700 1 -- 172.21.15.100:0/650750085 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00d4a0 con 0x7fa6cc157290 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6c9600700 1 -- 172.21.15.100:0/650750085 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc00d600 con 0x7fa6cc157290 2024-01-22T05:40:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6c9600700 1 -- 172.21.15.100:0/650750085 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00d980 con 0x7fa6cc157290 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6d1e00700 1 -- 172.21.15.100:0/650750085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc157290 msgr2=0x7fa6cc092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6d1e00700 1 --2- 172.21.15.100:0/650750085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc157290 0x7fa6cc092110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fa6cc05ee20 tx=0x7fa6bc009060).stop 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6d1e00700 1 -- 172.21.15.100:0/650750085 shutdown_connections 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6d1e00700 1 --2- 172.21.15.100:0/650750085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc157290 0x7fa6cc092110 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6d1e00700 1 -- 172.21.15.100:0/650750085 >> 172.21.15.100:0/650750085 conn(0x7fa6cc05e9d0 msgr2=0x7fa6cc091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6d1e00700 1 -- 172.21.15.100:0/650750085 shutdown_connections 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.414+0000 7fa6d1e00700 1 -- 172.21.15.100:0/650750085 wait complete. 2024-01-22T05:40:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.416+0000 7fa6d1e00700 1 Processor -- start 2024-01-22T05:40:33.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.416+0000 7fa6d1e00700 1 -- start start 2024-01-22T05:40:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6d1e00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc092600 0x7fa6cc095160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6d1e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6cc0c5b80 0x7fa6cc0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6d1e00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6cc157290 0x7fa6cc0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6d1e00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0c8700 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6d1e00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0937e0 con 0x7fa6cc092600 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6d1e00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc093ac0 con 0x7fa6cc157290 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6cc0c5b80 0x7fa6cc0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6cc0c5b80 0x7fa6cc0c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36916/0 (socket says 172.21.15.100:36916) 2024-01-22T05:40:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 -- 172.21.15.100:0/4057165561 learned_addr learned my addr 172.21.15.100:0/4057165561 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6caa00700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc092600 0x7fa6cc095160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6cb400700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6cc157290 0x7fa6cc0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 -- 172.21.15.100:0/4057165561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6cc157290 msgr2=0x7fa6cc0c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6cc157290 0x7fa6cc0c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 -- 172.21.15.100:0/4057165561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc092600 msgr2=0x7fa6cc095160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6cc092600 0x7fa6cc095160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.418+0000 7fa6ca000700 1 -- 172.21.15.100:0/4057165561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0092a0 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.419+0000 7fa6ca000700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6cc0c5b80 0x7fa6cc0c7d20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fa6b400c560 tx=0x7fa6b4007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.419+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400ce70 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.419+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b40072e0 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.419+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4007660 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.419+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc093da0 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.419+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc094360 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.420+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6cc05fdb0 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.421+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa6b40059b0 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6c2000700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa6a405f150 0x7fa6a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fa6b4079580 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6c2000700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7fa6a40656d0 0x7fa6a4067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6caa00700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa6a405f150 0x7fa6a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 --> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6a40681d0 con 0x7fa6a40656d0 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6b407ba80 con 0x7fa6cc0c5b80 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6cb400700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7fa6a40656d0 0x7fa6a4067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6caa00700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa6a405f150 0x7fa6a4061610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fa6bc00d260 tx=0x7fa6bc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.422+0000 7fa6cb400700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7fa6a40656d0 0x7fa6a4067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.423+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== osd.0 v2:172.21.15.100:6808/71172 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fa6a40681d0 con 0x7fa6a40656d0 2024-01-22T05:40:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.437+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 --> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa6cc064c90 con 0x7fa6a40656d0 2024-01-22T05:40:33.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.437+0000 7fa6c2000700 1 -- 172.21.15.100:0/4057165561 <== osd.0 v2:172.21.15.100:6808/71172 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa6cc064c90 con 0x7fa6a40656d0 2024-01-22T05:40:33.437 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:33.438 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:33.438 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:33.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7fa6a40656d0 msgr2=0x7fa6a4067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6808/71172,v1:172.21.15.100:6809/71172] conn(0x7fa6a40656d0 0x7fa6a4067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa6a405f150 msgr2=0x7fa6a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa6a405f150 0x7fa6a4061610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fa6bc00d260 tx=0x7fa6bc016000).stop 2024-01-22T05:40:33.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6cc0c5b80 msgr2=0x7fa6cc0c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 --2- 172.21.15.100:0/4057165561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6cc0c5b80 0x7fa6cc0c7d20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fa6b400c560 tx=0x7fa6b4007d20).stop 2024-01-22T05:40:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6cb400700 1 -- 172.21.15.100:0/4057165561 reap_dead start 2024-01-22T05:40:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 shutdown_connections 2024-01-22T05:40:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 >> 172.21.15.100:0/4057165561 conn(0x7fa6cc05e9d0 msgr2=0x7fa6cc067b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 shutdown_connections 2024-01-22T05:40:33.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.438+0000 7fa6d1e00700 1 -- 172.21.15.100:0/4057165561 wait complete. 2024-01-22T05:40:33.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-22T05:40:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.638+0000 7fd23b400700 1 Processor -- start 2024-01-22T05:40:33.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.638+0000 7fd23b400700 1 -- start start 2024-01-22T05:40:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.639+0000 7fd23b400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd234157290 0x7fd234092110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.639+0000 7fd23b400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd2340c5b80 0x7fd2340c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.639+0000 7fd23b400700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd234065000 con 0x7fd234092600 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.639+0000 7fd23b400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2340643f0 con 0x7fd234157290 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.639+0000 7fd23b400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2340646d0 con 0x7fd2340c5b80 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd234157290 0x7fd234092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd234157290 0x7fd234092110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36922/0 (socket says 172.21.15.100:36922) 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 -- 172.21.15.100:0/3053327338 learned_addr learned my addr 172.21.15.100:0/3053327338 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd239400700 1 --2- 172.21.15.100:0/3053327338 >> v2:172.21.15.169:3300/0 conn(0x7fd2340c5b80 0x7fd2340c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 -- 172.21.15.100:0/3053327338 >> v2:172.21.15.169:3300/0 conn(0x7fd2340c5b80 msgr2=0x7fd2340c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 --2- 172.21.15.100:0/3053327338 >> v2:172.21.15.169:3300/0 conn(0x7fd2340c5b80 0x7fd2340c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 -- 172.21.15.100:0/3053327338 >> v1:172.21.15.169:6789/0 conn(0x7fd234092600 legacy=0x7fd2340c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 -- 172.21.15.100:0/3053327338 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340649b0 con 0x7fd234157290 2024-01-22T05:40:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd238a00700 1 --2- 172.21.15.100:0/3053327338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd234157290 0x7fd234092110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd2340bf1f0 tx=0x7fd2240090f0).ready entity=mon.0 client_cookie=43a1385a8c71e5a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.640+0000 7fd233400700 1 -- 172.21.15.100:0/3053327338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400b520 con 0x7fd234157290 2024-01-22T05:40:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd233400700 1 -- 172.21.15.100:0/3053327338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22400b680 con 0x7fd234157290 2024-01-22T05:40:33.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd233400700 1 -- 172.21.15.100:0/3053327338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400ba00 con 0x7fd234157290 2024-01-22T05:40:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 -- 172.21.15.100:0/3053327338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd234157290 msgr2=0x7fd234092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 --2- 172.21.15.100:0/3053327338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd234157290 0x7fd234092110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd2340bf1f0 tx=0x7fd2240090f0).stop 2024-01-22T05:40:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 -- 172.21.15.100:0/3053327338 shutdown_connections 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 --2- 172.21.15.100:0/3053327338 >> v2:172.21.15.169:3300/0 conn(0x7fd2340c5b80 0x7fd2340c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 --2- 172.21.15.100:0/3053327338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd234157290 0x7fd234092110 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 -- 172.21.15.100:0/3053327338 >> 172.21.15.100:0/3053327338 conn(0x7fd23405e9d0 msgr2=0x7fd234091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 -- 172.21.15.100:0/3053327338 shutdown_connections 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.641+0000 7fd23b400700 1 -- 172.21.15.100:0/3053327338 wait complete. 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.643+0000 7fd23b400700 1 Processor -- start 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.643+0000 7fd23b400700 1 -- start start 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd23b400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd234092600 0x7fd234167200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd23b400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2340c5b80 0x7fd2340acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd23b400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd234157290 0x7fd2340ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd23b400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340ad500 con 0x7fd2340c5b80 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd23b400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234164370 con 0x7fd234157290 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd23b400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2341676f0 con 0x7fd234092600 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd233e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2340c5b80 0x7fd2340acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd233e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2340c5b80 0x7fd2340acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36938/0 (socket says 172.21.15.100:36938) 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd233e00700 1 -- 172.21.15.100:0/1566755014 learned_addr learned my addr 172.21.15.100:0/1566755014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:33.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd239400700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd234157290 0x7fd2340ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.644+0000 7fd238a00700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd234092600 0x7fd234167200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd233e00700 1 -- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd234092600 msgr2=0x7fd234167200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd233e00700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd234092600 0x7fd234167200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd233e00700 1 -- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd234157290 msgr2=0x7fd2340ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd233e00700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd234157290 0x7fd2340ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd233e00700 1 -- 172.21.15.100:0/1566755014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224009370 con 0x7fd2340c5b80 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd233e00700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2340c5b80 0x7fd2340acb20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fd21c00c4c0 tx=0x7fd21c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:33.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd22be00700 1 -- 172.21.15.100:0/1566755014 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00ce70 con 0x7fd2340c5b80 2024-01-22T05:40:33.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd22be00700 1 -- 172.21.15.100:0/1566755014 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c001e90 con 0x7fd2340c5b80 2024-01-22T05:40:33.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd22be00700 1 -- 172.21.15.100:0/1566755014 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c007250 con 0x7fd2340c5b80 2024-01-22T05:40:33.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd234164580 con 0x7fd2340c5b80 2024-01-22T05:40:33.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.645+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd234164b40 con 0x7fd2340c5b80 2024-01-22T05:40:33.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.646+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23405fdb0 con 0x7fd2340c5b80 2024-01-22T05:40:33.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.647+0000 7fd22be00700 1 -- 172.21.15.100:0/1566755014 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd21c0066a0 con 0x7fd2340c5b80 2024-01-22T05:40:33.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.648+0000 7fd22be00700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd20c05f150 0x7fd20c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:33.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.648+0000 7fd22be00700 1 -- 172.21.15.100:0/1566755014 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd21c079720 con 0x7fd2340c5b80 2024-01-22T05:40:33.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.648+0000 7fd238a00700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd20c05f150 0x7fd20c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:33.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.649+0000 7fd238a00700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd20c05f150 0x7fd20c061610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd224009130 tx=0x7fd224017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:33.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.652+0000 7fd22be00700 1 -- 172.21.15.100:0/1566755014 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd21c04acf0 con 0x7fd2340c5b80 2024-01-22T05:40:33.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.821+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd234063450 con 0x7fd20c05f150 2024-01-22T05:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.822+0000 7fd22be00700 1 -- 172.21.15.100:0/1566755014 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd224000c70 con 0x7fd20c05f150 2024-01-22T05:40:33.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd20c05f150 msgr2=0x7fd20c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd20c05f150 0x7fd20c061610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd224009130 tx=0x7fd224017000).stop 2024-01-22T05:40:33.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2340c5b80 msgr2=0x7fd2340acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:33.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2340c5b80 0x7fd2340acb20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fd21c00c4c0 tx=0x7fd21c007e00).stop 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 shutdown_connections 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fd20c05f150 0x7fd20c061610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd234157290 0x7fd2340ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd234092600 0x7fd234167200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 --2- 172.21.15.100:0/1566755014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2340c5b80 0x7fd2340acb20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 >> 172.21.15.100:0/1566755014 conn(0x7fd23405e9d0 msgr2=0x7fd2340c1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 shutdown_connections 2024-01-22T05:40:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:33.824+0000 7fd23b400700 1 -- 172.21.15.100:0/1566755014 wait complete. 2024-01-22T05:40:33.826 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2024-01-22T05:40:33.841 INFO:tasks.ceph:Scrubbing osd.1 2024-01-22T05:40:33.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.029+0000 7f9d23600700 1 Processor -- start 2024-01-22T05:40:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.030+0000 7f9d23600700 1 -- start start 2024-01-22T05:40:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.031+0000 7f9d23600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c5340 0x7f9d1c064c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.031+0000 7f9d23600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0c7060 con 0x7f9d1c0c6c00 2024-01-22T05:40:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.031+0000 7f9d23600700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0c6820 con 0x7f9d1c0c5e30 2024-01-22T05:40:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.031+0000 7f9d23600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0c62e0 con 0x7f9d1c0c5340 2024-01-22T05:40:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.031+0000 7f9d1be00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9d1c0c6c00 0x7f9d1c0c5720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37378/0 (socket says 172.21.15.100:37378) 2024-01-22T05:40:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.031+0000 7f9d1be00700 1 -- 172.21.15.100:0/1242417790 learned_addr learned my addr 172.21.15.100:0/1242417790 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:34.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.031+0000 7f9d20c00700 1 --2- 172.21.15.100:0/1242417790 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c5340 0x7f9d1c064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d1b400700 1 -- 172.21.15.100:0/1242417790 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690337680 0 0) 0x7f9d04001110 con 0x7f9d1c0c6c00 2024-01-22T05:40:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d1b400700 1 -- 172.21.15.100:0/1242417790 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cfc0033f0 con 0x7f9d1c0c6c00 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d20c00700 1 -- 172.21.15.100:0/1242417790 >> v1:172.21.15.169:6789/0 conn(0x7f9d1c0c5e30 legacy=0x7f9d1c0631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d1b400700 1 -- 172.21.15.100:0/1242417790 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374172185 0 0) 0x7f9d1c0c6820 con 0x7f9d1c0c5e30 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d20c00700 1 -- 172.21.15.100:0/1242417790 >> v1:172.21.15.100:6789/0 conn(0x7f9d1c0c6c00 legacy=0x7f9d1c0c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d20c00700 1 -- 172.21.15.100:0/1242417790 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0c64d0 con 0x7f9d1c0c5340 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d20c00700 1 --2- 172.21.15.100:0/1242417790 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c5340 0x7f9d1c064c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9d0c009790 tx=0x7f9d0c009060).ready entity=mon.2 client_cookie=36fe0e8966e14bf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d1b400700 1 -- 172.21.15.100:0/1242417790 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00f510 con 0x7f9d1c0c5340 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d1b400700 1 -- 172.21.15.100:0/1242417790 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c00f670 con 0x7f9d1c0c5340 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.032+0000 7f9d1b400700 1 -- 172.21.15.100:0/1242417790 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00f9f0 con 0x7f9d1c0c5340 2024-01-22T05:40:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.033+0000 7f9d23600700 1 -- 172.21.15.100:0/1242417790 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c5340 msgr2=0x7f9d1c064c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.033+0000 7f9d23600700 1 --2- 172.21.15.100:0/1242417790 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c5340 0x7f9d1c064c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9d0c009790 tx=0x7f9d0c009060).stop 2024-01-22T05:40:34.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.033+0000 7f9d23600700 1 -- 172.21.15.100:0/1242417790 shutdown_connections 2024-01-22T05:40:34.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.033+0000 7f9d23600700 1 --2- 172.21.15.100:0/1242417790 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c5340 0x7f9d1c064c30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.033+0000 7f9d23600700 1 -- 172.21.15.100:0/1242417790 >> 172.21.15.100:0/1242417790 conn(0x7f9d1c0c3ca0 msgr2=0x7f9d1c0c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:34.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.033+0000 7f9d23600700 1 -- 172.21.15.100:0/1242417790 shutdown_connections 2024-01-22T05:40:34.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.033+0000 7f9d23600700 1 -- 172.21.15.100:0/1242417790 wait complete. 2024-01-22T05:40:34.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.034+0000 7f9d23600700 1 Processor -- start 2024-01-22T05:40:34.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.034+0000 7f9d23600700 1 -- start start 2024-01-22T05:40:34.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.035+0000 7f9d23600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c0c5340 0x7f9d1c150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.035+0000 7f9d23600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d1c0c5e30 0x7f9d1c0a8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.035+0000 7f9d23600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c6c00 0x7f9d1c0a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.035+0000 7f9d23600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0a7bd0 con 0x7f9d1c0c5340 2024-01-22T05:40:34.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.035+0000 7f9d23600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c164be0 con 0x7f9d1c0c5e30 2024-01-22T05:40:34.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.035+0000 7f9d23600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0a7580 con 0x7f9d1c0c6c00 2024-01-22T05:40:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d20c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c0c5340 0x7f9d1c150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d1be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d1c0c5e30 0x7f9d1c0a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d1be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d1c0c5e30 0x7f9d1c0a8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:52822/0 (socket says 172.21.15.100:52822) 2024-01-22T05:40:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d1be00700 1 -- 172.21.15.100:0/3207114748 learned_addr learned my addr 172.21.15.100:0/3207114748 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d21600700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c6c00 0x7f9d1c0a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d20c00700 1 -- 172.21.15.100:0/3207114748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c6c00 msgr2=0x7f9d1c0a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d20c00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9d1c0c6c00 0x7f9d1c0a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d20c00700 1 -- 172.21.15.100:0/3207114748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d1c0c5e30 msgr2=0x7f9d1c0a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d20c00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d1c0c5e30 0x7f9d1c0a8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d20c00700 1 -- 172.21.15.100:0/3207114748 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0092a0 con 0x7f9d1c0c5340 2024-01-22T05:40:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d1be00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d1c0c5e30 0x7f9d1c0a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.036+0000 7f9d20c00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c0c5340 0x7f9d1c150f40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f9d0c014000 tx=0x7f9d0c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.037+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c023430 con 0x7f9d1c0c5340 2024-01-22T05:40:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.037+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c01e070 con 0x7f9d1c0c5340 2024-01-22T05:40:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.037+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c0a7860 con 0x7f9d1c0c5340 2024-01-22T05:40:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.037+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0237e0 con 0x7f9d1c0c5340 2024-01-22T05:40:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.037+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c0a5140 con 0x7f9d1c0c5340 2024-01-22T05:40:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.038+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d1c0a7400 con 0x7f9d1c0c5340 2024-01-22T05:40:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.038+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9d0c020030 con 0x7f9d1c0c5340 2024-01-22T05:40:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.039+0000 7f9d13e00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cf405f150 0x7f9cf4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.039+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f9d0c07aef0 con 0x7f9d1c0c5340 2024-01-22T05:40:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.039+0000 7f9d1be00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cf405f150 0x7f9cf4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.040+0000 7f9d13e00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f9cf40656d0 0x7f9cf4067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.040+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 --> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9cf40681d0 con 0x7f9cf40656d0 2024-01-22T05:40:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.040+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d0c07d450 con 0x7f9d1c0c5340 2024-01-22T05:40:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.040+0000 7f9d21600700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f9cf40656d0 0x7f9cf4067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.040+0000 7f9d1be00700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cf405f150 0x7f9cf4061610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f9d1c1537a0 tx=0x7f9d04001230).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.040+0000 7f9d21600700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f9cf40656d0 0x7f9cf4067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.041+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== osd.1 v2:172.21.15.100:6800/71171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f9cf40681d0 con 0x7f9cf40656d0 2024-01-22T05:40:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 --> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d1c0a7d10 con 0x7f9cf40656d0 2024-01-22T05:40:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d13e00700 1 -- 172.21.15.100:0/3207114748 <== osd.1 v2:172.21.15.100:6800/71171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9d14002d60 con 0x7f9cf40656d0 2024-01-22T05:40:34.055 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:34.055 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:34.055 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f9cf40656d0 msgr2=0x7f9cf4067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d23600700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6800/71171,v1:172.21.15.100:6801/71171] conn(0x7f9cf40656d0 0x7f9cf4067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cf405f150 msgr2=0x7f9cf4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d23600700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f9cf405f150 0x7f9cf4061610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f9d1c1537a0 tx=0x7f9d04001230).stop 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c0c5340 msgr2=0x7f9d1c150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d23600700 1 --2- 172.21.15.100:0/3207114748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c0c5340 0x7f9d1c150f40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f9d0c014000 tx=0x7f9d0c017000).stop 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.055+0000 7f9d21600700 1 -- 172.21.15.100:0/3207114748 reap_dead start 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.056+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 shutdown_connections 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.056+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 >> 172.21.15.100:0/3207114748 conn(0x7f9d1c0c3ca0 msgr2=0x7f9d1c065150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.056+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 shutdown_connections 2024-01-22T05:40:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.056+0000 7f9d23600700 1 -- 172.21.15.100:0/3207114748 wait complete. 2024-01-22T05:40:34.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-22T05:40:34.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.256+0000 7f3b7be00700 1 Processor -- start 2024-01-22T05:40:34.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.256+0000 7f3b7be00700 1 -- start start 2024-01-22T05:40:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.257+0000 7f3b7be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74150ae0 0x7f3b74150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.257+0000 7f3b7be00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3b740c25c0 0x7f3b740c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.257+0000 7f3b7be00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740660a0 con 0x7f3b741521d0 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.257+0000 7f3b7be00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74065bd0 con 0x7f3b740c25c0 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.257+0000 7f3b7be00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74151d40 con 0x7f3b74150ae0 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3b740c25c0 0x7f3b740c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3b740c25c0 0x7f3b740c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36956/0 (socket says 172.21.15.100:36956) 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 -- 172.21.15.100:0/2771585222 learned_addr learned my addr 172.21.15.100:0/2771585222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79400700 1 --2- 172.21.15.100:0/2771585222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74150ae0 0x7f3b74150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 -- 172.21.15.100:0/2771585222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74150ae0 msgr2=0x7f3b74150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 --2- 172.21.15.100:0/2771585222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74150ae0 0x7f3b74150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 -- 172.21.15.100:0/2771585222 >> v1:172.21.15.169:6789/0 conn(0x7f3b741521d0 legacy=0x7f3b740654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 -- 172.21.15.100:0/2771585222 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74065dc0 con 0x7f3b740c25c0 2024-01-22T05:40:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b79e00700 1 --2- 172.21.15.100:0/2771585222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b740c25c0 0x7f3b740c55f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f3b6c00d1a0 tx=0x7f3b6c00ba50).ready entity=mon.0 client_cookie=e42fcd86ec00f893 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.258+0000 7f3b73e00700 1 -- 172.21.15.100:0/2771585222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c010070 con 0x7f3b740c25c0 2024-01-22T05:40:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b73e00700 1 -- 172.21.15.100:0/2771585222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00b0d0 con 0x7f3b740c25c0 2024-01-22T05:40:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b73e00700 1 -- 172.21.15.100:0/2771585222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00b450 con 0x7f3b740c25c0 2024-01-22T05:40:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 -- 172.21.15.100:0/2771585222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b740c25c0 msgr2=0x7f3b740c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 --2- 172.21.15.100:0/2771585222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b740c25c0 0x7f3b740c55f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f3b6c00d1a0 tx=0x7f3b6c00ba50).stop 2024-01-22T05:40:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 -- 172.21.15.100:0/2771585222 shutdown_connections 2024-01-22T05:40:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 --2- 172.21.15.100:0/2771585222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b740c25c0 0x7f3b740c55f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 --2- 172.21.15.100:0/2771585222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b74150ae0 0x7f3b74150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 -- 172.21.15.100:0/2771585222 >> 172.21.15.100:0/2771585222 conn(0x7f3b740630c0 msgr2=0x7f3b740c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 -- 172.21.15.100:0/2771585222 shutdown_connections 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.259+0000 7f3b7be00700 1 -- 172.21.15.100:0/2771585222 wait complete. 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.261+0000 7f3b7be00700 1 Processor -- start 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.261+0000 7f3b7be00700 1 -- start start 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b7be00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b740c25c0 0x7f3b7413b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b7be00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b74150ae0 0x7f3b740ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b7be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b741521d0 0x7f3b740641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b7be00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7413f980 con 0x7f3b74150ae0 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b7be00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7413ed70 con 0x7f3b741521d0 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b7be00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7413f050 con 0x7f3b740c25c0 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b74150ae0 0x7f3b740ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b74150ae0 0x7f3b740ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36966/0 (socket says 172.21.15.100:36966) 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b79400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b740c25c0 0x7f3b7413b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 -- 172.21.15.100:0/3517323550 learned_addr learned my addr 172.21.15.100:0/3517323550 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b79e00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b741521d0 0x7f3b740641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 -- 172.21.15.100:0/3517323550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b740c25c0 msgr2=0x7f3b7413b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b740c25c0 0x7f3b7413b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 -- 172.21.15.100:0/3517323550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b741521d0 msgr2=0x7f3b740641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b741521d0 0x7f3b740641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.262+0000 7f3b78a00700 1 -- 172.21.15.100:0/3517323550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c00bcf0 con 0x7f3b74150ae0 2024-01-22T05:40:34.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.263+0000 7f3b78a00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b74150ae0 0x7f3b740ab2c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f3b5c00c440 tx=0x7f3b5c007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.263+0000 7f3b70c00700 1 -- 172.21.15.100:0/3517323550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c007020 con 0x7f3b74150ae0 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.263+0000 7f3b70c00700 1 -- 172.21.15.100:0/3517323550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c007180 con 0x7f3b74150ae0 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.263+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7413f330 con 0x7f3b74150ae0 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.263+0000 7f3b70c00700 1 -- 172.21.15.100:0/3517323550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c007520 con 0x7f3b74150ae0 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.263+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b740ab7b0 con 0x7f3b74150ae0 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.264+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7413faf0 con 0x7f3b74150ae0 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.265+0000 7f3b70c00700 1 -- 172.21.15.100:0/3517323550 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3b5c0068b0 con 0x7f3b74150ae0 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.265+0000 7f3b70c00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3b4c05f150 0x7f3b4c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.265+0000 7f3b70c00700 1 -- 172.21.15.100:0/3517323550 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f3b5c079110 con 0x7f3b74150ae0 2024-01-22T05:40:34.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.266+0000 7f3b79400700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3b4c05f150 0x7f3b4c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.266+0000 7f3b79400700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3b4c05f150 0x7f3b4c061610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3b6400bbc0 tx=0x7f3b64008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.270+0000 7f3b70c00700 1 -- 172.21.15.100:0/3517323550 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3b5c047b00 con 0x7f3b74150ae0 2024-01-22T05:40:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.446+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b740c2430 con 0x7f3b4c05f150 2024-01-22T05:40:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.446+0000 7f3b70c00700 1 -- 172.21.15.100:0/3517323550 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b740c2430 con 0x7f3b4c05f150 2024-01-22T05:40:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3b4c05f150 msgr2=0x7f3b4c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3b4c05f150 0x7f3b4c061610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3b6400bbc0 tx=0x7f3b64008040).stop 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b74150ae0 msgr2=0x7f3b740ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b74150ae0 0x7f3b740ab2c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f3b5c00c440 tx=0x7f3b5c007d40).stop 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 shutdown_connections 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f3b4c05f150 0x7f3b4c061610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b741521d0 0x7f3b740641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b740c25c0 0x7f3b7413b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 --2- 172.21.15.100:0/3517323550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b74150ae0 0x7f3b740ab2c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 >> 172.21.15.100:0/3517323550 conn(0x7f3b740630c0 msgr2=0x7f3b74152690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 shutdown_connections 2024-01-22T05:40:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.448+0000 7f3b7be00700 1 -- 172.21.15.100:0/3517323550 wait complete. 2024-01-22T05:40:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2024-01-22T05:40:34.466 INFO:tasks.ceph:Scrubbing osd.2 2024-01-22T05:40:34.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.652+0000 7f950b000700 1 Processor -- start 2024-01-22T05:40:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.652+0000 7f950b000700 1 -- start start 2024-01-22T05:40:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f950b000700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f950405e900 0x7f95040aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f950b000700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95040c74b0 con 0x7f95040c1940 2024-01-22T05:40:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f950b000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9504158660 con 0x7f95040a9f60 2024-01-22T05:40:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f950b000700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9504158940 con 0x7f950405e900 2024-01-22T05:40:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f9509000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f95040c1940 0x7f9504098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37382/0 (socket says 172.21.15.100:37382) 2024-01-22T05:40:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f9509000700 1 -- 172.21.15.100:0/3816711137 learned_addr learned my addr 172.21.15.100:0/3816711137 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f9503400700 1 --2- 172.21.15.100:0/3816711137 >> v2:172.21.15.100:3300/0 conn(0x7f950405e900 0x7f95040aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f9502a00700 1 -- 172.21.15.100:0/3816711137 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206226714 0 0) 0x7f95040c74b0 con 0x7f95040c1940 2024-01-22T05:40:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.654+0000 7f9502a00700 1 -- 172.21.15.100:0/3816711137 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e40033f0 con 0x7f95040c1940 2024-01-22T05:40:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.655+0000 7f9503400700 1 -- 172.21.15.100:0/3816711137 >> v1:172.21.15.169:6789/0 conn(0x7f95040a9f60 legacy=0x7f950405e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.655+0000 7f9503400700 1 -- 172.21.15.100:0/3816711137 >> v1:172.21.15.100:6789/0 conn(0x7f95040c1940 legacy=0x7f9504098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.655+0000 7f9503400700 1 -- 172.21.15.100:0/3816711137 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040c7140 con 0x7f950405e900 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.655+0000 7f9503400700 1 --2- 172.21.15.100:0/3816711137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950405e900 0x7f95040aa340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f94ec009760 tx=0x7f94ec009060).ready entity=mon.0 client_cookie=5f00aa3ccd4fd4ae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.655+0000 7f9502a00700 1 -- 172.21.15.100:0/3816711137 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00f510 con 0x7f950405e900 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.655+0000 7f9502a00700 1 -- 172.21.15.100:0/3816711137 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00f670 con 0x7f950405e900 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.655+0000 7f9502a00700 1 -- 172.21.15.100:0/3816711137 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00f9f0 con 0x7f950405e900 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.656+0000 7f950b000700 1 -- 172.21.15.100:0/3816711137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950405e900 msgr2=0x7f95040aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.656+0000 7f950b000700 1 --2- 172.21.15.100:0/3816711137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950405e900 0x7f95040aa340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f94ec009760 tx=0x7f94ec009060).stop 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.656+0000 7f950b000700 1 -- 172.21.15.100:0/3816711137 shutdown_connections 2024-01-22T05:40:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.656+0000 7f950b000700 1 --2- 172.21.15.100:0/3816711137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950405e900 0x7f95040aa340 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.656+0000 7f950b000700 1 -- 172.21.15.100:0/3816711137 >> 172.21.15.100:0/3816711137 conn(0x7f95040cada0 msgr2=0x7f95040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.656+0000 7f950b000700 1 -- 172.21.15.100:0/3816711137 shutdown_connections 2024-01-22T05:40:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.656+0000 7f950b000700 1 -- 172.21.15.100:0/3816711137 wait complete. 2024-01-22T05:40:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.657+0000 7f950b000700 1 Processor -- start 2024-01-22T05:40:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.657+0000 7f950b000700 1 -- start start 2024-01-22T05:40:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.658+0000 7f950b000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f950405e900 0x7f95040c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.658+0000 7f950b000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95040a9f60 0x7f9504152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.658+0000 7f950b000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95040c1940 0x7f95040cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.658+0000 7f950b000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040c3690 con 0x7f95040c1940 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.658+0000 7f950b000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9504165670 con 0x7f95040a9f60 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.658+0000 7f950b000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040c2d60 con 0x7f950405e900 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.658+0000 7f9509000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95040c1940 0x7f95040cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95040c1940 0x7f95040cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36984/0 (socket says 172.21.15.100:36984) 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 -- 172.21.15.100:0/710801501 learned_addr learned my addr 172.21.15.100:0/710801501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9503e00700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f950405e900 0x7f95040c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9503400700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95040a9f60 0x7f9504152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 -- 172.21.15.100:0/710801501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f950405e900 msgr2=0x7f95040c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f950405e900 0x7f95040c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 -- 172.21.15.100:0/710801501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95040a9f60 msgr2=0x7f9504152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95040a9f60 0x7f9504152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 -- 172.21.15.100:0/710801501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0092a0 con 0x7f95040c1940 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f9509000700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95040c1940 0x7f95040cb180 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f94fc005ad0 tx=0x7f94fc0015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc005d30 con 0x7f95040c1940 2024-01-22T05:40:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc005e90 con 0x7f95040c1940 2024-01-22T05:40:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95040c3040 con 0x7f95040c1940 2024-01-22T05:40:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.659+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc007320 con 0x7f95040c1940 2024-01-22T05:40:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.660+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9504152f90 con 0x7f95040c1940 2024-01-22T05:40:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.660+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95041531e0 con 0x7f95040c1940 2024-01-22T05:40:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.661+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f94fc007710 con 0x7f95040c1940 2024-01-22T05:40:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.662+0000 7f94fb400700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f94dc05f150 0x7f94dc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.662+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f94fc079f90 con 0x7f95040c1940 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.662+0000 7f94fb400700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f94dc0656d0 0x7f94dc067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.662+0000 7f9503e00700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f94dc05f150 0x7f94dc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.662+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 --> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94dc0681d0 con 0x7f94dc0656d0 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.662+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94fc07c4f0 con 0x7f95040c1940 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.662+0000 7f9503400700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f94dc0656d0 0x7f94dc067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.663+0000 7f9503e00700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f94dc05f150 0x7f94dc061610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f95040c4d50 tx=0x7f94f4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.663+0000 7f9503400700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f94dc0656d0 0x7f94dc067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.664+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== osd.2 v2:172.21.15.100:6816/71181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f94dc0681d0 con 0x7f94dc0656d0 2024-01-22T05:40:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.677+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 --> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f950405fdb0 con 0x7f94dc0656d0 2024-01-22T05:40:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.677+0000 7f94fb400700 1 -- 172.21.15.100:0/710801501 <== osd.2 v2:172.21.15.100:6816/71181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f950405fdb0 con 0x7f94dc0656d0 2024-01-22T05:40:34.678 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:34.678 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:34.678 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:34.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f94dc0656d0 msgr2=0x7f94dc067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6816/71181,v1:172.21.15.100:6819/71181] conn(0x7f94dc0656d0 0x7f94dc067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f94dc05f150 msgr2=0x7f94dc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f94dc05f150 0x7f94dc061610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f95040c4d50 tx=0x7f94f4009040).stop 2024-01-22T05:40:34.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95040c1940 msgr2=0x7f95040cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 --2- 172.21.15.100:0/710801501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95040c1940 0x7f95040cb180 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f94fc005ad0 tx=0x7f94fc0015b0).stop 2024-01-22T05:40:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f9509000700 1 -- 172.21.15.100:0/710801501 reap_dead start 2024-01-22T05:40:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 shutdown_connections 2024-01-22T05:40:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 >> 172.21.15.100:0/710801501 conn(0x7f95040cada0 msgr2=0x7f95040ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 shutdown_connections 2024-01-22T05:40:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.678+0000 7f950b000700 1 -- 172.21.15.100:0/710801501 wait complete. 2024-01-22T05:40:34.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-22T05:40:34.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.879+0000 7f7299a00700 1 Processor -- start 2024-01-22T05:40:34.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.879+0000 7f7299a00700 1 -- start start 2024-01-22T05:40:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7299a00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f72940c9c10 0x7f729415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7299a00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72940c1a40 con 0x7f7294157d80 2024-01-22T05:40:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7299a00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72940cbd30 con 0x7f7294154260 2024-01-22T05:40:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7299a00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72940c1110 con 0x7f72940c9c10 2024-01-22T05:40:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7293400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f72940c9c10 0x7f729415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7292000700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7294157d80 0x7f7294158200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37396/0 (socket says 172.21.15.100:37396) 2024-01-22T05:40:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7292000700 1 -- 172.21.15.100:0/2089522994 learned_addr learned my addr 172.21.15.100:0/2089522994 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:34.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7293400700 1 -- 172.21.15.100:0/2089522994 >> v1:172.21.15.169:6789/0 conn(0x7f7294154260 legacy=0x7f72940cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7293400700 1 -- 172.21.15.100:0/2089522994 >> v1:172.21.15.100:6789/0 conn(0x7f7294157d80 legacy=0x7f7294158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7293400700 1 -- 172.21.15.100:0/2089522994 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940c13f0 con 0x7f72940c9c10 2024-01-22T05:40:34.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.881+0000 7f7291600700 1 -- 172.21.15.100:0/2089522994 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898697016 0 0) 0x7f72940c1a40 con 0x7f7294157d80 2024-01-22T05:40:34.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7293400700 1 --2- 172.21.15.100:0/2089522994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72940c9c10 0x7f729415f0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f728c009e60 tx=0x7f728c009780).ready entity=mon.0 client_cookie=9b8bb80c75940435 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7291600700 1 -- 172.21.15.100:0/2089522994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c00e070 con 0x7f72940c9c10 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7291600700 1 -- 172.21.15.100:0/2089522994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c00bc30 con 0x7f72940c9c10 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7291600700 1 -- 172.21.15.100:0/2089522994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c012410 con 0x7f72940c9c10 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7299a00700 1 -- 172.21.15.100:0/2089522994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72940c9c10 msgr2=0x7f729415f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7299a00700 1 --2- 172.21.15.100:0/2089522994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72940c9c10 0x7f729415f0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f728c009e60 tx=0x7f728c009780).stop 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7299a00700 1 -- 172.21.15.100:0/2089522994 shutdown_connections 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7299a00700 1 --2- 172.21.15.100:0/2089522994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72940c9c10 0x7f729415f0c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.882+0000 7f7299a00700 1 -- 172.21.15.100:0/2089522994 >> 172.21.15.100:0/2089522994 conn(0x7f729405e9d0 msgr2=0x7f72940cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:34.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.883+0000 7f7299a00700 1 -- 172.21.15.100:0/2089522994 shutdown_connections 2024-01-22T05:40:34.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.883+0000 7f7299a00700 1 -- 172.21.15.100:0/2089522994 wait complete. 2024-01-22T05:40:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.884+0000 7f7299a00700 1 Processor -- start 2024-01-22T05:40:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.884+0000 7f7299a00700 1 -- start start 2024-01-22T05:40:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7299a00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72940c9c10 0x7f72941555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7299a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7294154260 0x7f7294151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7299a00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7294157d80 0x7f729414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7299a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294152340 con 0x7f7294154260 2024-01-22T05:40:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7299a00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72941514f0 con 0x7f72940c9c10 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7299a00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7294155c50 con 0x7f7294157d80 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7292000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7294154260 0x7f7294151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7292000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7294154260 0x7f7294151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36992/0 (socket says 172.21.15.100:36992) 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.885+0000 7f7292000700 1 -- 172.21.15.100:0/3300308642 learned_addr learned my addr 172.21.15.100:0/3300308642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7293400700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7294157d80 0x7f729414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7292a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72940c9c10 0x7f72941555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7292000700 1 -- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7294157d80 msgr2=0x7f729414c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7292000700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7294157d80 0x7f729414c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7292000700 1 -- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72940c9c10 msgr2=0x7f72941555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7292000700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72940c9c10 0x7f72941555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7292000700 1 -- 172.21.15.100:0/3300308642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c009a20 con 0x7f7294154260 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7292000700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7294154260 0x7f7294151000 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f727c00c490 tx=0x7f727c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f728a000700 1 -- 172.21.15.100:0/3300308642 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0072e0 con 0x7f7294154260 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f728a000700 1 -- 172.21.15.100:0/3300308642 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c007440 con 0x7f7294154260 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f728a000700 1 -- 172.21.15.100:0/3300308642 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0057a0 con 0x7f7294154260 2024-01-22T05:40:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7294155f30 con 0x7f7294154260 2024-01-22T05:40:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.886+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72941564f0 con 0x7f7294154260 2024-01-22T05:40:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.888+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729405fdb0 con 0x7f7294154260 2024-01-22T05:40:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.888+0000 7f728a000700 1 -- 172.21.15.100:0/3300308642 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f727c005bd0 con 0x7f7294154260 2024-01-22T05:40:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.889+0000 7f728a000700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f726c05f150 0x7f726c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.889+0000 7f728a000700 1 -- 172.21.15.100:0/3300308642 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f727c079740 con 0x7f7294154260 2024-01-22T05:40:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.889+0000 7f7292a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f726c05f150 0x7f726c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.890+0000 7f7292a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f726c05f150 0x7f726c061610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7284003710 tx=0x7f7284009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:34.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:34.893+0000 7f728a000700 1 -- 172.21.15.100:0/3300308642 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f727c04ac50 con 0x7f7294154260 2024-01-22T05:40:35.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.062+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7294084940 con 0x7f726c05f150 2024-01-22T05:40:35.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.062+0000 7f728a000700 1 -- 172.21.15.100:0/3300308642 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7294084940 con 0x7f726c05f150 2024-01-22T05:40:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f726c05f150 msgr2=0x7f726c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f726c05f150 0x7f726c061610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7284003710 tx=0x7f7284009040).stop 2024-01-22T05:40:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7294154260 msgr2=0x7f7294151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7294154260 0x7f7294151000 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f727c00c490 tx=0x7f727c007e40).stop 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 shutdown_connections 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f726c05f150 0x7f726c061610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72940c9c10 0x7f72941555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7294157d80 0x7f729414c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 --2- 172.21.15.100:0/3300308642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7294154260 0x7f7294151000 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 >> 172.21.15.100:0/3300308642 conn(0x7f729405e9d0 msgr2=0x7f72940630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 shutdown_connections 2024-01-22T05:40:35.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.064+0000 7f7299a00700 1 -- 172.21.15.100:0/3300308642 wait complete. 2024-01-22T05:40:35.066 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2024-01-22T05:40:35.081 INFO:tasks.ceph:Scrubbing osd.3 2024-01-22T05:40:35.081 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.270+0000 7fa5ef600700 1 Processor -- start 2024-01-22T05:40:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.270+0000 7fa5ef600700 1 -- start start 2024-01-22T05:40:35.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ef600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa5e8138440 0x7fa5e80681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ef600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138820 0x7fa5e80686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ef600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa5e80c5120 0x7fa5e80c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ef600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e8064e30 con 0x7fa5e80c5120 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ef600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e8068bc0 con 0x7fa5e8138440 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ef600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e8064520 con 0x7fa5e8138820 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ed600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa5e80c5120 0x7fa5e80c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ed600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa5e80c5120 0x7fa5e80c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37006/0 (socket says 172.21.15.100:37006) 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.271+0000 7fa5ed600700 1 -- 172.21.15.100:0/1558643859 learned_addr learned my addr 172.21.15.100:0/1558643859 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ecc00700 1 --2- 172.21.15.100:0/1558643859 >> v2:172.21.15.169:3300/0 conn(0x7fa5e8138440 0x7fa5e80681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5e7e00700 1 --2- 172.21.15.100:0/1558643859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138820 0x7fa5e80686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ed600700 1 -- 172.21.15.100:0/1558643859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138820 msgr2=0x7fa5e80686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:35.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ed600700 1 --2- 172.21.15.100:0/1558643859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138820 0x7fa5e80686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ed600700 1 -- 172.21.15.100:0/1558643859 >> v2:172.21.15.169:3300/0 conn(0x7fa5e8138440 msgr2=0x7fa5e80681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:35.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ed600700 1 --2- 172.21.15.100:0/1558643859 >> v2:172.21.15.169:3300/0 conn(0x7fa5e8138440 0x7fa5e80681e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ed600700 1 -- 172.21.15.100:0/1558643859 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80c5e50 con 0x7fa5e80c5120 2024-01-22T05:40:35.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ecc00700 1 --2- 172.21.15.100:0/1558643859 >> v2:172.21.15.169:3300/0 conn(0x7fa5e8138440 0x7fa5e80681e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:35.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5ed600700 1 --2- 172.21.15.100:0/1558643859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e80c5120 0x7fa5e80c5580 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fa5e80679c0 tx=0x7fa5e0009840).ready entity=mon.0 client_cookie=eb62e238245bcfc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5e7400700 1 -- 172.21.15.100:0/1558643859 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000e070 con 0x7fa5e80c5120 2024-01-22T05:40:35.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5e7400700 1 -- 172.21.15.100:0/1558643859 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000ba50 con 0x7fa5e80c5120 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.272+0000 7fa5e7400700 1 -- 172.21.15.100:0/1558643859 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000bdd0 con 0x7fa5e80c5120 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 -- 172.21.15.100:0/1558643859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e80c5120 msgr2=0x7fa5e80c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 --2- 172.21.15.100:0/1558643859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e80c5120 0x7fa5e80c5580 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fa5e80679c0 tx=0x7fa5e0009840).stop 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 -- 172.21.15.100:0/1558643859 shutdown_connections 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 --2- 172.21.15.100:0/1558643859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e80c5120 0x7fa5e80c5580 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 --2- 172.21.15.100:0/1558643859 >> v2:172.21.15.169:3300/0 conn(0x7fa5e8138440 0x7fa5e80681e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 --2- 172.21.15.100:0/1558643859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138820 0x7fa5e80686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 -- 172.21.15.100:0/1558643859 >> 172.21.15.100:0/1558643859 conn(0x7fa5e80630c0 msgr2=0x7fa5e80c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 -- 172.21.15.100:0/1558643859 shutdown_connections 2024-01-22T05:40:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.273+0000 7fa5ef600700 1 -- 172.21.15.100:0/1558643859 wait complete. 2024-01-22T05:40:35.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.274+0000 7fa5ef600700 1 Processor -- start 2024-01-22T05:40:35.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.275+0000 7fa5ef600700 1 -- start start 2024-01-22T05:40:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.275+0000 7fa5ef600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e80c5120 0x7fa5e80a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.275+0000 7fa5ef600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138440 0x7fa5e81508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ef600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e8138820 0x7fa5e80abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ef600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e81620b0 con 0x7fa5e8138820 2024-01-22T05:40:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ef600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80a85f0 con 0x7fa5e80c5120 2024-01-22T05:40:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ef600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e8150db0 con 0x7fa5e8138440 2024-01-22T05:40:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e8138820 0x7fa5e80abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e8138820 0x7fa5e80abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37014/0 (socket says 172.21.15.100:37014) 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 -- 172.21.15.100:0/2099740127 learned_addr learned my addr 172.21.15.100:0/2099740127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5e7e00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138440 0x7fa5e81508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ecc00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e80c5120 0x7fa5e80a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 -- 172.21.15.100:0/2099740127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138440 msgr2=0x7fa5e81508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e8138440 0x7fa5e81508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 -- 172.21.15.100:0/2099740127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e80c5120 msgr2=0x7fa5e80a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e80c5120 0x7fa5e80a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 -- 172.21.15.100:0/2099740127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0009ae0 con 0x7fa5e8138820 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ecc00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e80c5120 0x7fa5e80a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.276+0000 7fa5ed600700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e8138820 0x7fa5e80abf20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fa5e0009fd0 tx=0x7fa5e0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.277+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00032f0 con 0x7fa5e8138820 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.277+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00092e0 con 0x7fa5e8138820 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.277+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e80bdf70 con 0x7fa5e8138820 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.277+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e001e680 con 0x7fa5e8138820 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.277+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e80be530 con 0x7fa5e8138820 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.277+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5e805fdb0 con 0x7fa5e8138820 2024-01-22T05:40:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.278+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa5e0003040 con 0x7fa5e8138820 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.279+0000 7fa5dfe00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa5c005f150 0x7fa5c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.279+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fa5e007b3e0 con 0x7fa5e8138820 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.279+0000 7fa5ecc00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa5c005f150 0x7fa5c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.279+0000 7fa5dfe00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7fa5c00656d0 0x7fa5c0067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.279+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 --> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5c00681d0 con 0x7fa5c00656d0 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.279+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e007d940 con 0x7fa5e8138820 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.280+0000 7fa5e7e00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7fa5c00656d0 0x7fa5c0067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.280+0000 7fa5ecc00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa5c005f150 0x7fa5c0061610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa5d8006fd0 tx=0x7fa5d8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.280+0000 7fa5e7e00700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7fa5c00656d0 0x7fa5c0067b50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.281+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== osd.3 v2:172.21.15.100:6817/71188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fa5c00681d0 con 0x7fa5c00656d0 2024-01-22T05:40:35.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 --> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5e8064770 con 0x7fa5c00656d0 2024-01-22T05:40:35.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5dfe00700 1 -- 172.21.15.100:0/2099740127 <== osd.3 v2:172.21.15.100:6817/71188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa5e8064770 con 0x7fa5c00656d0 2024-01-22T05:40:35.295 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:35.295 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:35.295 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:35.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7fa5c00656d0 msgr2=0x7fa5c0067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ef600700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6817/71188,v1:172.21.15.100:6818/71188] conn(0x7fa5c00656d0 0x7fa5c0067b50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa5c005f150 msgr2=0x7fa5c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ef600700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fa5c005f150 0x7fa5c0061610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa5d8006fd0 tx=0x7fa5d8008040).stop 2024-01-22T05:40:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e8138820 msgr2=0x7fa5e80abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ef600700 1 --2- 172.21.15.100:0/2099740127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5e8138820 0x7fa5e80abf20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fa5e0009fd0 tx=0x7fa5e0009840).stop 2024-01-22T05:40:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.295+0000 7fa5ed600700 1 -- 172.21.15.100:0/2099740127 reap_dead start 2024-01-22T05:40:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.296+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 shutdown_connections 2024-01-22T05:40:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.296+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 >> 172.21.15.100:0/2099740127 conn(0x7fa5e80630c0 msgr2=0x7fa5e80bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.296+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 shutdown_connections 2024-01-22T05:40:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.296+0000 7fa5ef600700 1 -- 172.21.15.100:0/2099740127 wait complete. 2024-01-22T05:40:35.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-22T05:40:35.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.499+0000 7f4346800700 1 Processor -- start 2024-01-22T05:40:35.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.499+0000 7f4346800700 1 -- start start 2024-01-22T05:40:35.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f4346800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f43400aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f4346800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f434005e900 0x7f43400ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f4346800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400c74b0 con 0x7f43400c1940 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f4346800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43400cab90 con 0x7f434005e900 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f4346800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4340158660 con 0x7f43400a9f60 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f433fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f434005e900 0x7f43400ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f433ea00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f43400c1940 0x7f434005e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37412/0 (socket says 172.21.15.100:37412) 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f433fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f434005e900 0x7f43400ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37018/0 (socket says 172.21.15.100:37018) 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.500+0000 7f433ea00700 1 -- 172.21.15.100:0/664541723 learned_addr learned my addr 172.21.15.100:0/664541723 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433f400700 1 --2- 172.21.15.100:0/664541723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f43400aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433fe00700 1 -- 172.21.15.100:0/664541723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 msgr2=0x7f43400aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:35.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433fe00700 1 --2- 172.21.15.100:0/664541723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f43400aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433fe00700 1 -- 172.21.15.100:0/664541723 >> v1:172.21.15.100:6789/0 conn(0x7f43400c1940 legacy=0x7f434005e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433fe00700 1 -- 172.21.15.100:0/664541723 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340158940 con 0x7f434005e900 2024-01-22T05:40:35.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433fe00700 1 --2- 172.21.15.100:0/664541723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ca6a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f4338009e60 tx=0x7f4338009780).ready entity=mon.0 client_cookie=47f6f26dab716c91 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433e000700 1 -- 172.21.15.100:0/664541723 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800e070 con 0x7f434005e900 2024-01-22T05:40:35.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433e000700 1 -- 172.21.15.100:0/664541723 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433800bc30 con 0x7f434005e900 2024-01-22T05:40:35.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.501+0000 7f433e000700 1 -- 172.21.15.100:0/664541723 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338012410 con 0x7f434005e900 2024-01-22T05:40:35.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 -- 172.21.15.100:0/664541723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 msgr2=0x7f43400ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 --2- 172.21.15.100:0/664541723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ca6a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f4338009e60 tx=0x7f4338009780).stop 2024-01-22T05:40:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 -- 172.21.15.100:0/664541723 shutdown_connections 2024-01-22T05:40:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 --2- 172.21.15.100:0/664541723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ca6a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 --2- 172.21.15.100:0/664541723 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f43400aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 -- 172.21.15.100:0/664541723 >> 172.21.15.100:0/664541723 conn(0x7f43400cada0 msgr2=0x7f43400cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 -- 172.21.15.100:0/664541723 shutdown_connections 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.502+0000 7f4346800700 1 -- 172.21.15.100:0/664541723 wait complete. 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.503+0000 7f4346800700 1 Processor -- start 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.504+0000 7f4346800700 1 -- start start 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f4346800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f4346800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f4340151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f4346800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43400c1940 0x7f43400cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f4346800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400acf80 con 0x7f434005e900 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f4346800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400abc90 con 0x7f43400c1940 2024-01-22T05:40:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f4346800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400acaf0 con 0x7f43400a9f60 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37028/0 (socket says 172.21.15.100:37028) 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 -- 172.21.15.100:0/1973558151 learned_addr learned my addr 172.21.15.100:0/1973558151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433ea00700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f4340151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433fe00700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43400c1940 0x7f43400cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 -- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 msgr2=0x7f4340151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f4340151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 -- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43400c1940 msgr2=0x7f43400cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43400c1940 0x7f43400cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 -- 172.21.15.100:0/1973558151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4338009a20 con 0x7f434005e900 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433fe00700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43400c1940 0x7f43400cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.505+0000 7f433f400700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ab230 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f433000d8c0 tx=0x7f4330008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.506+0000 7f4336a00700 1 -- 172.21.15.100:0/1973558151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300095b0 con 0x7f434005e900 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.506+0000 7f4336a00700 1 -- 172.21.15.100:0/1973558151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330009710 con 0x7f434005e900 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.506+0000 7f4336a00700 1 -- 172.21.15.100:0/1973558151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330009a90 con 0x7f434005e900 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.506+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43400abee0 con 0x7f434005e900 2024-01-22T05:40:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.506+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43400ac780 con 0x7f434005e900 2024-01-22T05:40:35.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.507+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434005fdb0 con 0x7f434005e900 2024-01-22T05:40:35.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.507+0000 7f4336a00700 1 -- 172.21.15.100:0/1973558151 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4330013480 con 0x7f434005e900 2024-01-22T05:40:35.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.508+0000 7f4336a00700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f431805f150 0x7f4318061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.509+0000 7f4336a00700 1 -- 172.21.15.100:0/1973558151 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4330079d80 con 0x7f434005e900 2024-01-22T05:40:35.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.509+0000 7f433ea00700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f431805f150 0x7f4318061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.509+0000 7f433ea00700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f431805f150 0x7f4318061610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f43400c5240 tx=0x7f4328009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.513+0000 7f4336a00700 1 -- 172.21.15.100:0/1973558151 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f433004b230 con 0x7f434005e900 2024-01-22T05:40:35.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.682+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f43401582d0 con 0x7f431805f150 2024-01-22T05:40:35.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.683+0000 7f4336a00700 1 -- 172.21.15.100:0/1973558151 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43401582d0 con 0x7f431805f150 2024-01-22T05:40:35.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.684+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f431805f150 msgr2=0x7f4318061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.684+0000 7f4346800700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f431805f150 0x7f4318061610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f43400c5240 tx=0x7f4328009040).stop 2024-01-22T05:40:35.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 msgr2=0x7f43400ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ab230 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f433000d8c0 tx=0x7f4330008040).stop 2024-01-22T05:40:35.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 shutdown_connections 2024-01-22T05:40:35.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f431805f150 0x7f4318061610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43400c1940 0x7f43400cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f434005e900 0x7f43400ab230 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 --2- 172.21.15.100:0/1973558151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43400a9f60 0x7f4340151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 >> 172.21.15.100:0/1973558151 conn(0x7f43400cada0 msgr2=0x7f43400c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:35.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 shutdown_connections 2024-01-22T05:40:35.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.685+0000 7f4346800700 1 -- 172.21.15.100:0/1973558151 wait complete. 2024-01-22T05:40:35.688 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2024-01-22T05:40:35.702 INFO:tasks.ceph:Scrubbing osd.4 2024-01-22T05:40:35.703 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.890+0000 7f15ea800700 1 Processor -- start 2024-01-22T05:40:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.890+0000 7f15ea800700 1 -- start start 2024-01-22T05:40:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.891+0000 7f15ea800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 0x7f15e415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.891+0000 7f15ea800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e4065000 con 0x7f15e4157290 2024-01-22T05:40:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15ea800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40c4250 con 0x7f15e4157670 2024-01-22T05:40:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15ea800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4092820 con 0x7f15e40c5b80 2024-01-22T05:40:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e3400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f15e4157290 0x7f15e4092110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37422/0 (socket says 172.21.15.100:37422) 2024-01-22T05:40:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e3400700 1 -- 172.21.15.100:0/4123954889 learned_addr learned my addr 172.21.15.100:0/4123954889 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e3e00700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 0x7f15e415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904827274 0 0) 0x7f15e4065000 con 0x7f15e4157290 2024-01-22T05:40:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c40033f0 con 0x7f15e4157290 2024-01-22T05:40:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542229367 0 0) 0x7f15e40c4250 con 0x7f15e4157670 2024-01-22T05:40:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e4065000 con 0x7f15e4157670 2024-01-22T05:40:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1894538809 0 0) 0x7f15c40033f0 con 0x7f15e4157290 2024-01-22T05:40:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 msgr2=0x7f15e415ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 0x7f15e415ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.892+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 >> v1:172.21.15.169:6789/0 conn(0x7f15e4157670 legacy=0x7f15e40c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40643f0 con 0x7f15e4157290 2024-01-22T05:40:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f15d4001470 con 0x7f15e4157290 2024-01-22T05:40:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 >> v1:172.21.15.100:6789/0 conn(0x7f15e4157290 legacy=0x7f15e4092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 0x7f15c4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c4003fb0 0x7f15c4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4004b80 0x7f15c4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4092820 con 0x7f15c4003fb0 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c400b990 con 0x7f15c4004b80 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c400bb50 con 0x7f15e40c5b80 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e3400700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 0x7f15c4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2a00700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c4003fb0 0x7f15c4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e3e00700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4004b80 0x7f15c4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2a00700 1 -- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 msgr2=0x7f15c4003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2a00700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 0x7f15c4003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2a00700 1 -- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4004b80 msgr2=0x7f15c4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.893+0000 7f15e2a00700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4004b80 0x7f15c4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15e2a00700 1 -- 172.21.15.100:0/4123954889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40033f0 con 0x7f15c4003fb0 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15e3400700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c5b80 0x7f15c4003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15e2a00700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c4003fb0 0x7f15c4004690 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f15cc001890 tx=0x7f15cc007bb0).ready entity=mon.0 client_cookie=832889b3a8317dd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc007020 con 0x7f15c4003fb0 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc007180 con 0x7f15c4003fb0 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15e2000700 1 -- 172.21.15.100:0/4123954889 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc007500 con 0x7f15c4003fb0 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15ea800700 1 -- 172.21.15.100:0/4123954889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c4003fb0 msgr2=0x7f15c4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15ea800700 1 --2- 172.21.15.100:0/4123954889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c4003fb0 0x7f15c4004690 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f15cc001890 tx=0x7f15cc007bb0).stop 2024-01-22T05:40:35.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15e3e00700 1 -- 172.21.15.100:0/4123954889 reap_dead start 2024-01-22T05:40:35.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.894+0000 7f15ea800700 1 -- 172.21.15.100:0/4123954889 shutdown_connections 2024-01-22T05:40:35.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.895+0000 7f15ea800700 1 -- 172.21.15.100:0/4123954889 >> 172.21.15.100:0/4123954889 conn(0x7f15e405e9d0 msgr2=0x7f15e4091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:35.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.895+0000 7f15ea800700 1 -- 172.21.15.100:0/4123954889 shutdown_connections 2024-01-22T05:40:35.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.895+0000 7f15ea800700 1 -- 172.21.15.100:0/4123954889 wait complete. 2024-01-22T05:40:35.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.896+0000 7f15ea800700 1 Processor -- start 2024-01-22T05:40:35.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.896+0000 7f15ea800700 1 -- start start 2024-01-22T05:40:35.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15ea800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4003fb0 0x7f15e4155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15ea800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40ae5c0 0x7f15e40c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15ea800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c19c0 0x7f15e40c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15ea800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c1380 con 0x7f15e40ae5c0 2024-01-22T05:40:35.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15ea800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c2330 con 0x7f15c4003fb0 2024-01-22T05:40:35.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15ea800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c0770 con 0x7f15e40c19c0 2024-01-22T05:40:35.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15e2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40ae5c0 0x7f15e40c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15e2a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40ae5c0 0x7f15e40c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37044/0 (socket says 172.21.15.100:37044) 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.897+0000 7f15e2a00700 1 -- 172.21.15.100:0/3383972336 learned_addr learned my addr 172.21.15.100:0/3383972336 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e2a00700 1 -- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c19c0 msgr2=0x7f15e40c1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e3e00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c19c0 0x7f15e40c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e2a00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15e40c19c0 0x7f15e40c1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e3400700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4003fb0 0x7f15e4155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e2a00700 1 -- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4003fb0 msgr2=0x7f15e4155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e2a00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4003fb0 0x7f15e4155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e2a00700 1 -- 172.21.15.100:0/3383972336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40c0a50 con 0x7f15e40ae5c0 2024-01-22T05:40:35.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e3400700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c4003fb0 0x7f15e4155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15e2a00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40ae5c0 0x7f15e40c4a50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f15cc006b60 tx=0x7f15cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc01e480 con 0x7f15e40ae5c0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc01e5e0 con 0x7f15e40ae5c0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc01e9a0 con 0x7f15e40ae5c0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e40c0d30 con 0x7f15e40ae5c0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.898+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e40c4f40 con 0x7f15e40ae5c0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.900+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15e405fdb0 con 0x7f15e40ae5c0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.900+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f15cc012400 con 0x7f15e40ae5c0 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.901+0000 7f15daa00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f15bc05f150 0x7f15bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.901+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f15cc07ad10 con 0x7f15e40ae5c0 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.901+0000 7f15daa00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7f15bc0656d0 0x7f15bc067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.901+0000 7f15e3400700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f15bc05f150 0x7f15bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.901+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 --> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15bc0681d0 con 0x7f15bc0656d0 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.901+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15cc07e020 con 0x7f15e40ae5c0 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.902+0000 7f15e3e00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7f15bc0656d0 0x7f15bc067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.902+0000 7f15e3400700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f15bc05f150 0x7f15bc061610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f15d40010e0 tx=0x7f15d4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.902+0000 7f15e3e00700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7f15bc0656d0 0x7f15bc067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:35.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.903+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== osd.4 v2:172.21.15.169:6800/71444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f15bc0681d0 con 0x7f15bc0656d0 2024-01-22T05:40:35.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.917+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 --> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15e40646d0 con 0x7f15bc0656d0 2024-01-22T05:40:35.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.917+0000 7f15daa00700 1 -- 172.21.15.100:0/3383972336 <== osd.4 v2:172.21.15.169:6800/71444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f15e40646d0 con 0x7f15bc0656d0 2024-01-22T05:40:35.918 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:35.918 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:35.918 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:35.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7f15bc0656d0 msgr2=0x7f15bc067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.169:6800/71444,v1:172.21.15.169:6801/71444] conn(0x7f15bc0656d0 0x7f15bc067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:35.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f15bc05f150 msgr2=0x7f15bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f15bc05f150 0x7f15bc061610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f15d40010e0 tx=0x7f15d4009040).stop 2024-01-22T05:40:35.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40ae5c0 msgr2=0x7f15e40c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 --2- 172.21.15.100:0/3383972336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40ae5c0 0x7f15e40c4a50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f15cc006b60 tx=0x7f15cc016000).stop 2024-01-22T05:40:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15e3e00700 1 -- 172.21.15.100:0/3383972336 reap_dead start 2024-01-22T05:40:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 shutdown_connections 2024-01-22T05:40:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 >> 172.21.15.100:0/3383972336 conn(0x7f15e405e9d0 msgr2=0x7f15e4091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 shutdown_connections 2024-01-22T05:40:35.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:35.918+0000 7f15ea800700 1 -- 172.21.15.100:0/3383972336 wait complete. 2024-01-22T05:40:35.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-22T05:40:36.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.119+0000 7f0144400700 1 Processor -- start 2024-01-22T05:40:36.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.119+0000 7f0144400700 1 -- start start 2024-01-22T05:40:36.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0144400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f013c157670 0x7f013c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0144400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 0x7f013c0c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0144400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0c5e10 con 0x7f013c157290 2024-01-22T05:40:36.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0144400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c065000 con 0x7f013c157670 2024-01-22T05:40:36.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0144400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c092820 con 0x7f013c0c5960 2024-01-22T05:40:36.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0141a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f013c157290 0x7f013c092110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37430/0 (socket says 172.21.15.100:37430) 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0141a00700 1 -- 172.21.15.100:0/3083313348 learned_addr learned my addr 172.21.15.100:0/3083313348 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0141000700 1 --2- 172.21.15.100:0/3083313348 >> v2:172.21.15.169:3300/0 conn(0x7f013c157670 0x7f013c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f0142400700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 0x7f013c0c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301175609 0 0) 0x7f012c001110 con 0x7f013c157290 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.121+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f011c0033f0 con 0x7f013c157290 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519306423 0 0) 0x7f011c0033f0 con 0x7f013c157290 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 msgr2=0x7f013c0c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 0x7f013c0c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 >> v2:172.21.15.169:3300/0 conn(0x7f013c157670 msgr2=0x7f013c0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 --2- 172.21.15.100:0/3083313348 >> v2:172.21.15.169:3300/0 conn(0x7f013c157670 0x7f013c0c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0643f0 con 0x7f013c157290 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2828371310 0 0) 0x7f012c001600 con 0x7f013c157290 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 >> v1:172.21.15.100:6789/0 conn(0x7f013c157290 legacy=0x7f013c092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 0x7f011c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c003e10 0x7f011c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c004b80 0x7f011c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c065000 con 0x7f011c004b80 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c092820 con 0x7f011c003e10 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c00b8e0 con 0x7f013c0c5960 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0142400700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c004b80 0x7f011c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0141a00700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 0x7f011c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0141000700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c003e10 0x7f011c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0142400700 1 -- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 msgr2=0x7f011c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0142400700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c5960 0x7f011c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0142400700 1 -- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c003e10 msgr2=0x7f011c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0142400700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c003e10 0x7f011c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.122+0000 7f0142400700 1 -- 172.21.15.100:0/3083313348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0033f0 con 0x7f011c004b80 2024-01-22T05:40:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f0142400700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c004b80 0x7f011c005000 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f013400e240 tx=0x7f013400b040).ready entity=mon.0 client_cookie=c9d2a1d19fb45a91 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134009ac0 con 0x7f011c004b80 2024-01-22T05:40:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400f040 con 0x7f011c004b80 2024-01-22T05:40:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f013be00700 1 -- 172.21.15.100:0/3083313348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400ed00 con 0x7f011c004b80 2024-01-22T05:40:36.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f0144400700 1 -- 172.21.15.100:0/3083313348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c004b80 msgr2=0x7f011c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f0144400700 1 --2- 172.21.15.100:0/3083313348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f011c004b80 0x7f011c005000 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f013400e240 tx=0x7f013400b040).stop 2024-01-22T05:40:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f0142400700 1 -- 172.21.15.100:0/3083313348 reap_dead start 2024-01-22T05:40:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f0144400700 1 -- 172.21.15.100:0/3083313348 shutdown_connections 2024-01-22T05:40:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.123+0000 7f0144400700 1 -- 172.21.15.100:0/3083313348 >> 172.21.15.100:0/3083313348 conn(0x7f013c05e9d0 msgr2=0x7f013c091a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.124+0000 7f0144400700 1 -- 172.21.15.100:0/3083313348 shutdown_connections 2024-01-22T05:40:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.124+0000 7f0144400700 1 -- 172.21.15.100:0/3083313348 wait complete. 2024-01-22T05:40:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.125+0000 7f0144400700 1 Processor -- start 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.125+0000 7f0144400700 1 -- start start 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0144400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c004b80 0x7f013c159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0144400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c9560 0x7f013c14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0144400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f013c0c1b40 0x7f013c0c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0144400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c168770 con 0x7f013c0c1b40 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0144400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c159ce0 con 0x7f011c004b80 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0144400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c1682e0 con 0x7f013c0c9560 2024-01-22T05:40:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0142400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f013c0c1b40 0x7f013c0c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0142400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f013c0c1b40 0x7f013c0c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37064/0 (socket says 172.21.15.100:37064) 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.126+0000 7f0142400700 1 -- 172.21.15.100:0/2646936743 learned_addr learned my addr 172.21.15.100:0/2646936743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0141000700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c9560 0x7f013c14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0141a00700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c004b80 0x7f013c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0142400700 1 -- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c9560 msgr2=0x7f013c14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0142400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c9560 0x7f013c14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0142400700 1 -- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c004b80 msgr2=0x7f013c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0142400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c004b80 0x7f013c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0142400700 1 -- 172.21.15.100:0/2646936743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c14cdf0 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0142400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f013c0c1b40 0x7f013c0c1fc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f013400e830 tx=0x7f013401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0138c00700 1 -- 172.21.15.100:0/2646936743 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340138f0 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0138c00700 1 -- 172.21.15.100:0/2646936743 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134013a50 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c0c99e0 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0138c00700 1 -- 172.21.15.100:0/2646936743 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134013e10 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.127+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c0c7a10 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.129+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c05fdb0 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.129+0000 7f0138c00700 1 -- 172.21.15.100:0/2646936743 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0134003040 con 0x7f013c0c1b40 2024-01-22T05:40:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.130+0000 7f0138c00700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f011405f150 0x7f0114061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.130+0000 7f0138c00700 1 -- 172.21.15.100:0/2646936743 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f013407ace0 con 0x7f013c0c1b40 2024-01-22T05:40:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.130+0000 7f0141a00700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f011405f150 0x7f0114061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.131+0000 7f0141a00700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f011405f150 0x7f0114061610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f012c001ed0 tx=0x7f012c007900).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.134+0000 7f0138c00700 1 -- 172.21.15.100:0/2646936743 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f013404c2b0 con 0x7f013c0c1b40 2024-01-22T05:40:36.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.305+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f013c0646d0 con 0x7f011405f150 2024-01-22T05:40:36.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.306+0000 7f0138c00700 1 -- 172.21.15.100:0/2646936743 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f013c0646d0 con 0x7f011405f150 2024-01-22T05:40:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f011405f150 msgr2=0x7f0114061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f011405f150 0x7f0114061610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f012c001ed0 tx=0x7f012c007900).stop 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f013c0c1b40 msgr2=0x7f013c0c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f013c0c1b40 0x7f013c0c1fc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f013400e830 tx=0x7f013401a000).stop 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 shutdown_connections 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f011405f150 0x7f0114061610 secure :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0x7f012c001ed0 tx=0x7f012c007900).stop 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f011c004b80 0x7f013c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f013c0c1b40 0x7f013c0c1fc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.307+0000 7f0144400700 1 --2- 172.21.15.100:0/2646936743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f013c0c9560 0x7f013c14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.308+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 >> 172.21.15.100:0/2646936743 conn(0x7f013c05e9d0 msgr2=0x7f013c0aae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.308+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 shutdown_connections 2024-01-22T05:40:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.308+0000 7f0144400700 1 -- 172.21.15.100:0/2646936743 wait complete. 2024-01-22T05:40:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2024-01-22T05:40:36.325 INFO:tasks.ceph:Scrubbing osd.5 2024-01-22T05:40:36.325 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:36.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.512+0000 7f8473c00700 1 Processor -- start 2024-01-22T05:40:36.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.512+0000 7f8473c00700 1 -- start start 2024-01-22T05:40:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f8473c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f846c0c0e10 0x7f846c0aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f8473c00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c0c74b0 con 0x7f846c05e900 2024-01-22T05:40:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f8473c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c158660 con 0x7f846c0a9f60 2024-01-22T05:40:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f8473c00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c158940 con 0x7f846c0c0e10 2024-01-22T05:40:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f846be00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f846c05e900 0x7f846c098150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37434/0 (socket says 172.21.15.100:37434) 2024-01-22T05:40:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f846be00700 1 -- 172.21.15.100:0/3842544916 learned_addr learned my addr 172.21.15.100:0/3842544916 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f8471c00700 1 --2- 172.21.15.100:0/3842544916 >> v2:172.21.15.169:3300/0 conn(0x7f846c0c0e10 0x7f846c0aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005241494 0 0) 0x7f846c0c74b0 con 0x7f846c05e900 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f844c0033f0 con 0x7f846c05e900 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944334646 0 0) 0x7f846c158660 con 0x7f846c0a9f60 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.514+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f846c0c74b0 con 0x7f846c0a9f60 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1458811051 0 0) 0x7f844c0033f0 con 0x7f846c05e900 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f8471c00700 1 -- 172.21.15.100:0/3842544916 >> v1:172.21.15.169:6789/0 conn(0x7f846c0a9f60 legacy=0x7f846c05e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f8471c00700 1 -- 172.21.15.100:0/3842544916 >> v1:172.21.15.100:6789/0 conn(0x7f846c05e900 legacy=0x7f846c098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f8471c00700 1 -- 172.21.15.100:0/3842544916 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c0c7140 con 0x7f846c0c0e10 2024-01-22T05:40:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f8471c00700 1 --2- 172.21.15.100:0/3842544916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0c0e10 0x7f846c0aa340 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f8464009de0 tx=0x7f8464009780).ready entity=mon.1 client_cookie=6e7b69aa16c042b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846400e070 con 0x7f846c0c0e10 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846400b7a0 con 0x7f846c0c0e10 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.515+0000 7f846b400700 1 -- 172.21.15.100:0/3842544916 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454001470 con 0x7f846c0c0e10 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.516+0000 7f8473c00700 1 -- 172.21.15.100:0/3842544916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0c0e10 msgr2=0x7f846c0aa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.516+0000 7f8473c00700 1 --2- 172.21.15.100:0/3842544916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0c0e10 0x7f846c0aa340 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f8464009de0 tx=0x7f8464009780).stop 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.516+0000 7f8473c00700 1 -- 172.21.15.100:0/3842544916 shutdown_connections 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.516+0000 7f8473c00700 1 --2- 172.21.15.100:0/3842544916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0c0e10 0x7f846c0aa340 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.516+0000 7f8473c00700 1 -- 172.21.15.100:0/3842544916 >> 172.21.15.100:0/3842544916 conn(0x7f846c0cada0 msgr2=0x7f846c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.516+0000 7f8473c00700 1 -- 172.21.15.100:0/3842544916 shutdown_connections 2024-01-22T05:40:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.516+0000 7f8473c00700 1 -- 172.21.15.100:0/3842544916 wait complete. 2024-01-22T05:40:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.518+0000 7f8473c00700 1 Processor -- start 2024-01-22T05:40:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.518+0000 7f8473c00700 1 -- start start 2024-01-22T05:40:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.519+0000 7f8473c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f846c05e900 0x7f846c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.519+0000 7f8473c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0a9f60 0x7f846c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.519+0000 7f8473c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c0c0e10 0x7f846c0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.519+0000 7f8473c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c1a50 con 0x7f846c0c0e10 2024-01-22T05:40:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.519+0000 7f8473c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0c34f0 con 0x7f846c0a9f60 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.519+0000 7f8473c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c153020 con 0x7f846c05e900 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c0c0e10 0x7f846c0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c0c0e10 0x7f846c0abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37076/0 (socket says 172.21.15.100:37076) 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f846be00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0a9f60 0x7f846c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 -- 172.21.15.100:0/3302802532 learned_addr learned my addr 172.21.15.100:0/3302802532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471200700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f846c05e900 0x7f846c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 -- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f846c05e900 msgr2=0x7f846c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f846c05e900 0x7f846c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 -- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0a9f60 msgr2=0x7f846c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0a9f60 0x7f846c152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 -- 172.21.15.100:0/3302802532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8464009a20 con 0x7f846c0c0e10 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f846be00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f846c0a9f60 0x7f846c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.520+0000 7f8471c00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c0c0e10 0x7f846c0abed0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f846c0c8880 tx=0x7f8464009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.521+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464021070 con 0x7f846c0c0e10 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.521+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8464013d20 con 0x7f846c0c0e10 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.521+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c0aaf10 con 0x7f846c0c0e10 2024-01-22T05:40:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.521+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c0013f0 con 0x7f846c0c0e10 2024-01-22T05:40:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.521+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c0c3a40 con 0x7f846c0c0e10 2024-01-22T05:40:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.522+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f846c0c3350 con 0x7f846c0c0e10 2024-01-22T05:40:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.523+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8464003020 con 0x7f846c0c0e10 2024-01-22T05:40:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.523+0000 7f8463e00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f844405f150 0x7f8444061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.523+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f846407be70 con 0x7f846c0c0e10 2024-01-22T05:40:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.524+0000 7f8471200700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f844405f150 0x7f8444061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.524+0000 7f8463e00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7f84440656d0 0x7f8444067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.524+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 --> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84440681d0 con 0x7f84440656d0 2024-01-22T05:40:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.524+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f846407c220 con 0x7f846c0c0e10 2024-01-22T05:40:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.524+0000 7f8471200700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f844405f150 0x7f8444061610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f845c003170 tx=0x7f845c00a2b0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.524+0000 7f846be00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7f84440656d0 0x7f8444067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.525+0000 7f846be00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7f84440656d0 0x7f8444067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.525+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== osd.5 v2:172.21.15.169:6808/71446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f84440681d0 con 0x7f84440656d0 2024-01-22T05:40:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.539+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 --> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f846c0cbd60 con 0x7f84440656d0 2024-01-22T05:40:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8463e00700 1 -- 172.21.15.100:0/3302802532 <== osd.5 v2:172.21.15.169:6808/71446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f846c0cbd60 con 0x7f84440656d0 2024-01-22T05:40:36.540 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:36.540 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:36.540 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7f84440656d0 msgr2=0x7f8444067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.169:6808/71446,v1:172.21.15.169:6809/71446] conn(0x7f84440656d0 0x7f8444067b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f844405f150 msgr2=0x7f8444061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f844405f150 0x7f8444061610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f845c003170 tx=0x7f845c00a2b0).stop 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c0c0e10 msgr2=0x7f846c0abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 --2- 172.21.15.100:0/3302802532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c0c0e10 0x7f846c0abed0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f846c0c8880 tx=0x7f8464009780).stop 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8471c00700 1 -- 172.21.15.100:0/3302802532 reap_dead start 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 shutdown_connections 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.540+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 >> 172.21.15.100:0/3302802532 conn(0x7f846c0cada0 msgr2=0x7f846c153890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.541+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 shutdown_connections 2024-01-22T05:40:36.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.541+0000 7f8473c00700 1 -- 172.21.15.100:0/3302802532 wait complete. 2024-01-22T05:40:36.556 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-22T05:40:36.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.740+0000 7fc1eb600700 1 Processor -- start 2024-01-22T05:40:36.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.740+0000 7fc1eb600700 1 -- start start 2024-01-22T05:40:36.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.741+0000 7fc1eb600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc1e40a9f60 0x7fc1e40aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.741+0000 7fc1eb600700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc1e40c1940 0x7fc1e40ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1eb600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 0x7fc1e405e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1eb600700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40c74b0 con 0x7fc1e40c1940 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1eb600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40cab90 con 0x7fc1e40a9f60 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1eb600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e405eb70 con 0x7fc1e405e1f0 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc1e40c1940 0x7fc1e40ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc1e40c1940 0x7fc1e40ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37090/0 (socket says 172.21.15.100:37090) 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 -- 172.21.15.100:0/504846088 learned_addr learned my addr 172.21.15.100:0/504846088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e8c00700 1 --2- 172.21.15.100:0/504846088 >> v2:172.21.15.169:3300/0 conn(0x7fc1e40a9f60 0x7fc1e40aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e9600700 1 --2- 172.21.15.100:0/504846088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 0x7fc1e405e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 -- 172.21.15.100:0/504846088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 msgr2=0x7fc1e405e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 --2- 172.21.15.100:0/504846088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 0x7fc1e405e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 -- 172.21.15.100:0/504846088 >> v2:172.21.15.169:3300/0 conn(0x7fc1e40a9f60 msgr2=0x7fc1e40aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 --2- 172.21.15.100:0/504846088 >> v2:172.21.15.169:3300/0 conn(0x7fc1e40a9f60 0x7fc1e40aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.742+0000 7fc1e3e00700 1 -- 172.21.15.100:0/504846088 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4158660 con 0x7fc1e40c1940 2024-01-22T05:40:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1e3e00700 1 --2- 172.21.15.100:0/504846088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40ca6a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fc1e40c8850 tx=0x7fc1cc0090f0).ready entity=mon.0 client_cookie=6a24351ab5a59e47 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1e3400700 1 -- 172.21.15.100:0/504846088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00f510 con 0x7fc1e40c1940 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1e3400700 1 -- 172.21.15.100:0/504846088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc00f670 con 0x7fc1e40c1940 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1e3400700 1 -- 172.21.15.100:0/504846088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00f9f0 con 0x7fc1e40c1940 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 -- 172.21.15.100:0/504846088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 msgr2=0x7fc1e40ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 --2- 172.21.15.100:0/504846088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40ca6a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fc1e40c8850 tx=0x7fc1cc0090f0).stop 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 -- 172.21.15.100:0/504846088 shutdown_connections 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 --2- 172.21.15.100:0/504846088 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 0x7fc1e405e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 --2- 172.21.15.100:0/504846088 >> v2:172.21.15.169:3300/0 conn(0x7fc1e40a9f60 0x7fc1e40aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 --2- 172.21.15.100:0/504846088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40ca6a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 -- 172.21.15.100:0/504846088 >> 172.21.15.100:0/504846088 conn(0x7fc1e40cada0 msgr2=0x7fc1e40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:36.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.743+0000 7fc1eb600700 1 -- 172.21.15.100:0/504846088 shutdown_connections 2024-01-22T05:40:36.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.744+0000 7fc1eb600700 1 -- 172.21.15.100:0/504846088 wait complete. 2024-01-22T05:40:36.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.745+0000 7fc1eb600700 1 Processor -- start 2024-01-22T05:40:36.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.746+0000 7fc1eb600700 1 -- start start 2024-01-22T05:40:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1eb600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 0x7fc1e4147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1eb600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1e40a9f60 0x7fc1e40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1eb600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1eb600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c2e30 con 0x7fc1e40c1940 2024-01-22T05:40:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1eb600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c2220 con 0x7fc1e40a9f60 2024-01-22T05:40:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1eb600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c2500 con 0x7fc1e405e1f0 2024-01-22T05:40:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1e9600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1e9600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37102/0 (socket says 172.21.15.100:37102) 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.747+0000 7fc1e9600700 1 -- 172.21.15.100:0/915018898 learned_addr learned my addr 172.21.15.100:0/915018898 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1e9600700 1 -- 172.21.15.100:0/915018898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 msgr2=0x7fc1e4147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1e9600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 0x7fc1e4147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1e9600700 1 -- 172.21.15.100:0/915018898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1e40a9f60 msgr2=0x7fc1e40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1e9600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1e40a9f60 0x7fc1e40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1e9600700 1 -- 172.21.15.100:0/915018898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc009370 con 0x7fc1e40c1940 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1e9600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40add50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fc1dc009df0 tx=0x7fc1dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1dbe00700 1 -- 172.21.15.100:0/915018898 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00cb50 con 0x7fc1e40c1940 2024-01-22T05:40:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1dbe00700 1 -- 172.21.15.100:0/915018898 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc00f040 con 0x7fc1e40c1940 2024-01-22T05:40:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e40c27e0 con 0x7fc1e40c1940 2024-01-22T05:40:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1dbe00700 1 -- 172.21.15.100:0/915018898 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00cec0 con 0x7fc1e40c1940 2024-01-22T05:40:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.748+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e40c1e40 con 0x7fc1e40c1940 2024-01-22T05:40:36.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.749+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e405fdb0 con 0x7fc1e40c1940 2024-01-22T05:40:36.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.750+0000 7fc1dbe00700 1 -- 172.21.15.100:0/915018898 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc1dc013610 con 0x7fc1e40c1940 2024-01-22T05:40:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.751+0000 7fc1dbe00700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc1bc05f150 0x7fc1bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.751+0000 7fc1dbe00700 1 -- 172.21.15.100:0/915018898 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fc1dc07a7e0 con 0x7fc1e40c1940 2024-01-22T05:40:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.751+0000 7fc1e8c00700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc1bc05f150 0x7fc1bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.752+0000 7fc1e8c00700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc1bc05f150 0x7fc1bc061610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc1d4009900 tx=0x7fc1d4009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.756+0000 7fc1dbe00700 1 -- 172.21.15.100:0/915018898 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc1dc04bcf0 con 0x7fc1e40c1940 2024-01-22T05:40:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.925+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e40c2f70 con 0x7fc1bc05f150 2024-01-22T05:40:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.925+0000 7fc1dbe00700 1 -- 172.21.15.100:0/915018898 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc1e40c2f70 con 0x7fc1bc05f150 2024-01-22T05:40:36.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc1bc05f150 msgr2=0x7fc1bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc1bc05f150 0x7fc1bc061610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc1d4009900 tx=0x7fc1d4009060).stop 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 msgr2=0x7fc1e40add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40add50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fc1dc009df0 tx=0x7fc1dc00b040).stop 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 shutdown_connections 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fc1bc05f150 0x7fc1bc061610 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1e40c1940 0x7fc1e40add50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1e405e1f0 0x7fc1e4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 --2- 172.21.15.100:0/915018898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1e40a9f60 0x7fc1e40ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 >> 172.21.15.100:0/915018898 conn(0x7fc1e40cada0 msgr2=0x7fc1e4153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 shutdown_connections 2024-01-22T05:40:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:36.927+0000 7fc1eb600700 1 -- 172.21.15.100:0/915018898 wait complete. 2024-01-22T05:40:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2024-01-22T05:40:36.944 INFO:tasks.ceph:Scrubbing osd.6 2024-01-22T05:40:36.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:37.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.131+0000 7f3848600700 1 Processor -- start 2024-01-22T05:40:37.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.131+0000 7f3848600700 1 -- start start 2024-01-22T05:40:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3848600700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f38400a9f60 0x7f38400aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3848600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f384005e900 0x7f38400ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3848600700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38400c74b0 con 0x7f38400c1940 2024-01-22T05:40:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3848600700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38400cab90 con 0x7f38400a9f60 2024-01-22T05:40:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3848600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3840158660 con 0x7f384005e900 2024-01-22T05:40:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3845200700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f38400c1940 0x7f384005e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37438/0 (socket says 172.21.15.100:37438) 2024-01-22T05:40:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3845200700 1 -- 172.21.15.100:0/2306697226 learned_addr learned my addr 172.21.15.100:0/2306697226 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3846600700 1 --2- 172.21.15.100:0/2306697226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f384005e900 0x7f38400ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.132+0000 7f3845c00700 1 --2- 172.21.15.100:0/2306697226 >> v2:172.21.15.169:3300/0 conn(0x7f38400a9f60 0x7f38400aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f383fe00700 1 -- 172.21.15.100:0/2306697226 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337144126 0 0) 0x7f38400c74b0 con 0x7f38400c1940 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f383fe00700 1 -- 172.21.15.100:0/2306697226 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38200033f0 con 0x7f38400c1940 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f3846600700 1 -- 172.21.15.100:0/2306697226 >> v2:172.21.15.169:3300/0 conn(0x7f38400a9f60 msgr2=0x7f38400aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f3846600700 1 --2- 172.21.15.100:0/2306697226 >> v2:172.21.15.169:3300/0 conn(0x7f38400a9f60 0x7f38400aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f3846600700 1 -- 172.21.15.100:0/2306697226 >> v1:172.21.15.100:6789/0 conn(0x7f38400c1940 legacy=0x7f384005e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f3846600700 1 -- 172.21.15.100:0/2306697226 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840158940 con 0x7f384005e900 2024-01-22T05:40:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f3846600700 1 --2- 172.21.15.100:0/2306697226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f384005e900 0x7f38400ca6a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3838009e60 tx=0x7f3838009780).ready entity=mon.2 client_cookie=77eba19dbdd254ed server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f383fe00700 1 -- 172.21.15.100:0/2306697226 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800e070 con 0x7f384005e900 2024-01-22T05:40:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f383fe00700 1 -- 172.21.15.100:0/2306697226 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383800bab0 con 0x7f384005e900 2024-01-22T05:40:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.133+0000 7f383fe00700 1 -- 172.21.15.100:0/2306697226 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800be30 con 0x7f384005e900 2024-01-22T05:40:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 -- 172.21.15.100:0/2306697226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f384005e900 msgr2=0x7f38400ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 --2- 172.21.15.100:0/2306697226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f384005e900 0x7f38400ca6a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3838009e60 tx=0x7f3838009780).stop 2024-01-22T05:40:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 -- 172.21.15.100:0/2306697226 shutdown_connections 2024-01-22T05:40:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 --2- 172.21.15.100:0/2306697226 >> v2:172.21.15.169:3300/0 conn(0x7f38400a9f60 0x7f38400aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 --2- 172.21.15.100:0/2306697226 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f384005e900 0x7f38400ca6a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 -- 172.21.15.100:0/2306697226 >> 172.21.15.100:0/2306697226 conn(0x7f38400cada0 msgr2=0x7f38400cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 -- 172.21.15.100:0/2306697226 shutdown_connections 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.134+0000 7f3848600700 1 -- 172.21.15.100:0/2306697226 wait complete. 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.135+0000 7f3848600700 1 Processor -- start 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.136+0000 7f3848600700 1 -- start start 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.136+0000 7f3848600700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f384005e900 0x7f38400c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.136+0000 7f3848600700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38400a9f60 0x7f3840168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.136+0000 7f3848600700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38400c1940 0x7f38401518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3848600700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400c4530 con 0x7f384005e900 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3848600700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400c3a80 con 0x7f38400a9f60 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3848600700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3840158eb0 con 0x7f38400c1940 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f384005e900 0x7f38400c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f384005e900 0x7f38400c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37112/0 (socket says 172.21.15.100:37112) 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 -- 172.21.15.100:0/744018976 learned_addr learned my addr 172.21.15.100:0/744018976 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3846600700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38400c1940 0x7f38401518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845200700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38400a9f60 0x7f3840168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 -- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38400c1940 msgr2=0x7f38401518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38400c1940 0x7f38401518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 -- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38400a9f60 msgr2=0x7f3840168010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38400a9f60 0x7f3840168010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 -- 172.21.15.100:0/744018976 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838009a20 con 0x7f384005e900 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f3845c00700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f384005e900 0x7f38400c3590 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f383000e930 tx=0x7f3830009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.137+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383000eed0 con 0x7f384005e900 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.138+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383000c850 con 0x7f384005e900 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.138+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383000cbd0 con 0x7f384005e900 2024-01-22T05:40:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.138+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3840168500 con 0x7f384005e900 2024-01-22T05:40:37.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.138+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38400c3f70 con 0x7f384005e900 2024-01-22T05:40:37.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.139+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f384005fdb0 con 0x7f384005e900 2024-01-22T05:40:37.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.140+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f383001b400 con 0x7f384005e900 2024-01-22T05:40:37.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.140+0000 7f383cc00700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f381805f150 0x7f3818061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.140+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f383007a560 con 0x7f384005e900 2024-01-22T05:40:37.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.141+0000 7f3845200700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f381805f150 0x7f3818061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.141+0000 7f383cc00700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7f3818065560 0x7f38180679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.141+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 --> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3818068060 con 0x7f3818065560 2024-01-22T05:40:37.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.141+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f383007cac0 con 0x7f384005e900 2024-01-22T05:40:37.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.141+0000 7f3845200700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f381805f150 0x7f3818061610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3840098580 tx=0x7f3828009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.141+0000 7f3846600700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7f3818065560 0x7f38180679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.142+0000 7f3846600700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7f3818065560 0x7f38180679e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.143+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== osd.6 v2:172.21.15.169:6823/71469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f3818068060 con 0x7f3818065560 2024-01-22T05:40:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.156+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 --> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3840159190 con 0x7f3818065560 2024-01-22T05:40:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f383cc00700 1 -- 172.21.15.100:0/744018976 <== osd.6 v2:172.21.15.169:6823/71469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3840159190 con 0x7f3818065560 2024-01-22T05:40:37.157 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:37.157 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:37.157 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7f3818065560 msgr2=0x7f38180679e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f3848600700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.169:6823/71469,v1:172.21.15.169:6825/71469] conn(0x7f3818065560 0x7f38180679e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f381805f150 msgr2=0x7f3818061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f3848600700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f381805f150 0x7f3818061610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3840098580 tx=0x7f3828009040).stop 2024-01-22T05:40:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f384005e900 msgr2=0x7f38400c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f3848600700 1 --2- 172.21.15.100:0/744018976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f384005e900 0x7f38400c3590 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f383000e930 tx=0x7f3830009060).stop 2024-01-22T05:40:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.157+0000 7f3846600700 1 -- 172.21.15.100:0/744018976 reap_dead start 2024-01-22T05:40:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.158+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 shutdown_connections 2024-01-22T05:40:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.158+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 >> 172.21.15.100:0/744018976 conn(0x7f38400cada0 msgr2=0x7f38400ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.158+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 shutdown_connections 2024-01-22T05:40:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.158+0000 7f3848600700 1 -- 172.21.15.100:0/744018976 wait complete. 2024-01-22T05:40:37.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-22T05:40:37.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.359+0000 7fdfd5000700 1 Processor -- start 2024-01-22T05:40:37.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.360+0000 7fdfd5000700 1 -- start start 2024-01-22T05:40:37.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.361+0000 7fdfd5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd0150ae0 0x7fdfd0150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.361+0000 7fdfd5000700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdfd01521d0 0x7fdfd00654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.362+0000 7fdfd5000700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd00660a0 con 0x7fdfd00c25c0 2024-01-22T05:40:37.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.362+0000 7fdfd5000700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd0151d40 con 0x7fdfd01521d0 2024-01-22T05:40:37.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.362+0000 7fdfd5000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0065dc0 con 0x7fdfd0150ae0 2024-01-22T05:40:37.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.362+0000 7fdfcde00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd0150ae0 0x7fdfd0150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.362+0000 7fdfcd400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdfd01521d0 0x7fdfd00654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.362+0000 7fdfce800700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fdfd00c25c0 0x7fdfd00c55f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.100:48308/0 (socket says 172.21.15.100:48308) 2024-01-22T05:40:37.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.362+0000 7fdfce800700 1 -- 172.21.15.100:0/4013402122 learned_addr learned my addr 172.21.15.100:0/4013402122 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:37.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcca00700 1 -- 172.21.15.100:0/4013402122 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907047150 0 0) 0x7fdfd00660a0 con 0x7fdfd00c25c0 2024-01-22T05:40:37.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcca00700 1 -- 172.21.15.100:0/4013402122 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb00033f0 con 0x7fdfd00c25c0 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcde00700 1 -- 172.21.15.100:0/4013402122 >> v2:172.21.15.169:3300/0 conn(0x7fdfd01521d0 msgr2=0x7fdfd00654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcde00700 1 --2- 172.21.15.100:0/4013402122 >> v2:172.21.15.169:3300/0 conn(0x7fdfd01521d0 0x7fdfd00654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcde00700 1 -- 172.21.15.100:0/4013402122 >> v1:172.21.15.169:6789/0 conn(0x7fdfd00c25c0 legacy=0x7fdfd00c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcde00700 1 -- 172.21.15.100:0/4013402122 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd01516f0 con 0x7fdfd0150ae0 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcde00700 1 --2- 172.21.15.100:0/4013402122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd0150ae0 0x7fdfd0150ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fdfc0009760 tx=0x7fdfc0009060).ready entity=mon.2 client_cookie=7b6d2a988a5c206e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcca00700 1 -- 172.21.15.100:0/4013402122 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000d4a0 con 0x7fdfd0150ae0 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcca00700 1 -- 172.21.15.100:0/4013402122 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc000d600 con 0x7fdfd0150ae0 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.363+0000 7fdfcca00700 1 -- 172.21.15.100:0/4013402122 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000d980 con 0x7fdfd0150ae0 2024-01-22T05:40:37.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 -- 172.21.15.100:0/4013402122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd0150ae0 msgr2=0x7fdfd0150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 --2- 172.21.15.100:0/4013402122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd0150ae0 0x7fdfd0150ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fdfc0009760 tx=0x7fdfc0009060).stop 2024-01-22T05:40:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 -- 172.21.15.100:0/4013402122 shutdown_connections 2024-01-22T05:40:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 --2- 172.21.15.100:0/4013402122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd0150ae0 0x7fdfd0150ec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 --2- 172.21.15.100:0/4013402122 >> v2:172.21.15.169:3300/0 conn(0x7fdfd01521d0 0x7fdfd00654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 -- 172.21.15.100:0/4013402122 >> 172.21.15.100:0/4013402122 conn(0x7fdfd00630c0 msgr2=0x7fdfd00c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 -- 172.21.15.100:0/4013402122 shutdown_connections 2024-01-22T05:40:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.364+0000 7fdfd5000700 1 -- 172.21.15.100:0/4013402122 wait complete. 2024-01-22T05:40:37.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.365+0000 7fdfd5000700 1 Processor -- start 2024-01-22T05:40:37.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.366+0000 7fdfd5000700 1 -- start start 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.366+0000 7fdfd5000700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd00c25c0 0x7fdfd00ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.366+0000 7fdfd5000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfd0150ae0 0x7fdfd00aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.366+0000 7fdfd5000700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd01521d0 0x7fdfd00c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.366+0000 7fdfd5000700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0148870 con 0x7fdfd0150ae0 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.366+0000 7fdfd5000700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00c6050 con 0x7fdfd01521d0 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.366+0000 7fdfd5000700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0148220 con 0x7fdfd00c25c0 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcd400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfd0150ae0 0x7fdfd00aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcde00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd00c25c0 0x7fdfd00ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcd400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfd0150ae0 0x7fdfd00aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37120/0 (socket says 172.21.15.100:37120) 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcd400700 1 -- 172.21.15.100:0/435515691 learned_addr learned my addr 172.21.15.100:0/435515691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfce800700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd01521d0 0x7fdfd00c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcde00700 1 -- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd01521d0 msgr2=0x7fdfd00c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcde00700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd01521d0 0x7fdfd00c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcde00700 1 -- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfd0150ae0 msgr2=0x7fdfd00aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcde00700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfd0150ae0 0x7fdfd00aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcde00700 1 -- 172.21.15.100:0/435515691 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00092a0 con 0x7fdfd00c25c0 2024-01-22T05:40:37.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcd400700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfd0150ae0 0x7fdfd00aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-22T05:40:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.367+0000 7fdfcde00700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd00c25c0 0x7fdfd00ac3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fdfc0013000 tx=0x7fdfc0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.368+0000 7fdfc5600700 1 -- 172.21.15.100:0/435515691 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000dd30 con 0x7fdfd00c25c0 2024-01-22T05:40:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.368+0000 7fdfc5600700 1 -- 172.21.15.100:0/435515691 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc000de90 con 0x7fdfd00c25c0 2024-01-22T05:40:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.368+0000 7fdfc5600700 1 -- 172.21.15.100:0/435515691 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000d9a0 con 0x7fdfd00c25c0 2024-01-22T05:40:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.368+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd0148500 con 0x7fdfd00c25c0 2024-01-22T05:40:37.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.368+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd0147ef0 con 0x7fdfd00c25c0 2024-01-22T05:40:37.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.369+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd005fdb0 con 0x7fdfd00c25c0 2024-01-22T05:40:37.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.369+0000 7fdfc5600700 1 -- 172.21.15.100:0/435515691 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdfc001d640 con 0x7fdfd00c25c0 2024-01-22T05:40:37.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.370+0000 7fdfc5600700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdfa805f150 0x7fdfa8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.370+0000 7fdfc5600700 1 -- 172.21.15.100:0/435515691 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fdfc007b580 con 0x7fdfd00c25c0 2024-01-22T05:40:37.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.370+0000 7fdfcd400700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdfa805f150 0x7fdfa8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.371+0000 7fdfcd400700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdfa805f150 0x7fdfa8061610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fdfd00c41d0 tx=0x7fdfb8009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.376+0000 7fdfc5600700 1 -- 172.21.15.100:0/435515691 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdfc004ca90 con 0x7fdfd00c25c0 2024-01-22T05:40:37.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.544+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfd01519d0 con 0x7fdfa805f150 2024-01-22T05:40:37.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.545+0000 7fdfc5600700 1 -- 172.21.15.100:0/435515691 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdfd01519d0 con 0x7fdfa805f150 2024-01-22T05:40:37.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdfa805f150 msgr2=0x7fdfa8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdfa805f150 0x7fdfa8061610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fdfd00c41d0 tx=0x7fdfb8009060).stop 2024-01-22T05:40:37.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd00c25c0 msgr2=0x7fdfd00ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd00c25c0 0x7fdfd00ac3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fdfc0013000 tx=0x7fdfc0016000).stop 2024-01-22T05:40:37.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 shutdown_connections 2024-01-22T05:40:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7fdfa805f150 0x7fdfa8061610 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd01521d0 0x7fdfd00c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfd00c25c0 0x7fdfd00ac3e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 --2- 172.21.15.100:0/435515691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfd0150ae0 0x7fdfd00aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 >> 172.21.15.100:0/435515691 conn(0x7fdfd00630c0 msgr2=0x7fdfd0153400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 shutdown_connections 2024-01-22T05:40:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.547+0000 7fdfd5000700 1 -- 172.21.15.100:0/435515691 wait complete. 2024-01-22T05:40:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2024-01-22T05:40:37.565 INFO:tasks.ceph:Scrubbing osd.7 2024-01-22T05:40:37.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-22T05:40:37.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.752+0000 7f6b5aa00700 1 Processor -- start 2024-01-22T05:40:37.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.753+0000 7f6b5aa00700 1 -- start start 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b5aa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b540688f0 0x7f6b540c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b5aa00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6b54138820 0x7f6b540c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b5aa00700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b54064520 con 0x7f6b54138440 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b5aa00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b54064e30 con 0x7f6b540688f0 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b5aa00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b540c5e50 con 0x7f6b54138820 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b53400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b540688f0 0x7f6b540c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b53e00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6b54138440 0x7f6b540681e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37448/0 (socket says 172.21.15.100:37448) 2024-01-22T05:40:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.754+0000 7f6b53e00700 1 -- 172.21.15.100:0/3657196618 learned_addr learned my addr 172.21.15.100:0/3657196618 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b58a00700 1 --2- 172.21.15.100:0/3657196618 >> v2:172.21.15.169:3300/0 conn(0x7f6b54138820 0x7f6b540c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b53400700 1 -- 172.21.15.100:0/3657196618 >> v2:172.21.15.169:3300/0 conn(0x7f6b54138820 msgr2=0x7f6b540c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b53400700 1 --2- 172.21.15.100:0/3657196618 >> v2:172.21.15.169:3300/0 conn(0x7f6b54138820 0x7f6b540c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b53400700 1 -- 172.21.15.100:0/3657196618 >> v1:172.21.15.100:6789/0 conn(0x7f6b54138440 legacy=0x7f6b540681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b53400700 1 -- 172.21.15.100:0/3657196618 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54064770 con 0x7f6b540688f0 2024-01-22T05:40:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b52a00700 1 -- 172.21.15.100:0/3657196618 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486836416 0 0) 0x7f6b54064520 con 0x7f6b54138440 2024-01-22T05:40:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b53400700 1 --2- 172.21.15.100:0/3657196618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b540c5120 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6b540a96b0 tx=0x7f6b3c009060).ready entity=mon.0 client_cookie=94568be02a9a7273 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b52a00700 1 -- 172.21.15.100:0/3657196618 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0090d0 con 0x7f6b540688f0 2024-01-22T05:40:37.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b52a00700 1 -- 172.21.15.100:0/3657196618 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00b580 con 0x7f6b540688f0 2024-01-22T05:40:37.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.755+0000 7f6b52a00700 1 -- 172.21.15.100:0/3657196618 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00b900 con 0x7f6b540688f0 2024-01-22T05:40:37.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 -- 172.21.15.100:0/3657196618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 msgr2=0x7f6b540c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 --2- 172.21.15.100:0/3657196618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b540c5120 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6b540a96b0 tx=0x7f6b3c009060).stop 2024-01-22T05:40:37.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 -- 172.21.15.100:0/3657196618 shutdown_connections 2024-01-22T05:40:37.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 --2- 172.21.15.100:0/3657196618 >> v2:172.21.15.169:3300/0 conn(0x7f6b54138820 0x7f6b540c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 --2- 172.21.15.100:0/3657196618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b540c5120 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 -- 172.21.15.100:0/3657196618 >> 172.21.15.100:0/3657196618 conn(0x7f6b540630c0 msgr2=0x7f6b540c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:37.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 -- 172.21.15.100:0/3657196618 shutdown_connections 2024-01-22T05:40:37.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.756+0000 7f6b5aa00700 1 -- 172.21.15.100:0/3657196618 wait complete. 2024-01-22T05:40:37.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.757+0000 7f6b5aa00700 1 Processor -- start 2024-01-22T05:40:37.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.758+0000 7f6b5aa00700 1 -- start start 2024-01-22T05:40:37.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.758+0000 7f6b5aa00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b5414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.758+0000 7f6b5aa00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b54138440 0x7f6b540bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.758+0000 7f6b5aa00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b54138820 0x7f6b5414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b5aa00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540a6380 con 0x7f6b540688f0 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b5aa00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540bc130 con 0x7f6b54138440 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b5aa00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540bc410 con 0x7f6b54138820 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b5414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b5414f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37150/0 (socket says 172.21.15.100:37150) 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 -- 172.21.15.100:0/1781623897 learned_addr learned my addr 172.21.15.100:0/1781623897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53400700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b54138440 0x7f6b540bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b58a00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b54138820 0x7f6b5414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 -- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b54138820 msgr2=0x7f6b5414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b54138820 0x7f6b5414ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 -- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b54138440 msgr2=0x7f6b540bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b54138440 0x7f6b540bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 -- 172.21.15.100:0/1781623897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0092a0 con 0x7f6b540688f0 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.759+0000 7f6b53e00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b5414f9b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f6b4400c4e0 tx=0x7f6b44007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.760+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440072e0 con 0x7f6b540688f0 2024-01-22T05:40:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.760+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44007440 con 0x7f6b540688f0 2024-01-22T05:40:37.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.760+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440057a0 con 0x7f6b540688f0 2024-01-22T05:40:37.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.760+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b540bc6f0 con 0x7f6b540688f0 2024-01-22T05:40:37.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.760+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b540bbdd0 con 0x7f6b540688f0 2024-01-22T05:40:37.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.760+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b5405fdb0 con 0x7f6b540688f0 2024-01-22T05:40:37.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.761+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6b44005bd0 con 0x7f6b540688f0 2024-01-22T05:40:37.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.762+0000 7f6b4b400700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2c05f150 0x7f6b2c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.762+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f6b440798f0 con 0x7f6b540688f0 2024-01-22T05:40:37.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.762+0000 7f6b4b400700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f6b2c0656d0 0x7f6b2c067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.762+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 --> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b2c0681d0 con 0x7f6b2c0656d0 2024-01-22T05:40:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.762+0000 7f6b53400700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2c05f150 0x7f6b2c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.762+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b4407e220 con 0x7f6b540688f0 2024-01-22T05:40:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.763+0000 7f6b58a00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f6b2c0656d0 0x7f6b2c067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.763+0000 7f6b53400700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2c05f150 0x7f6b2c061610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6b54068cf0 tx=0x7f6b3c017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.763+0000 7f6b58a00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f6b2c0656d0 0x7f6b2c067b50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.764+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== osd.7 v2:172.21.15.169:6816/71472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6b2c0681d0 con 0x7f6b2c0656d0 2024-01-22T05:40:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.778+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 --> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6b540a64c0 con 0x7f6b2c0656d0 2024-01-22T05:40:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b4b400700 1 -- 172.21.15.100:0/1781623897 <== osd.7 v2:172.21.15.169:6816/71472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6b4c007430 con 0x7f6b2c0656d0 2024-01-22T05:40:37.779 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-22T05:40:37.779 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-22T05:40:37.779 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-22T05:40:37.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f6b2c0656d0 msgr2=0x7f6b2c067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.169:6816/71472,v1:172.21.15.169:6817/71472] conn(0x7f6b2c0656d0 0x7f6b2c067b50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2c05f150 msgr2=0x7f6b2c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f6b2c05f150 0x7f6b2c061610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6b54068cf0 tx=0x7f6b3c017000).stop 2024-01-22T05:40:37.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 msgr2=0x7f6b5414f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 --2- 172.21.15.100:0/1781623897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b540688f0 0x7f6b5414f9b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f6b4400c4e0 tx=0x7f6b44007c70).stop 2024-01-22T05:40:37.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b58a00700 1 -- 172.21.15.100:0/1781623897 reap_dead start 2024-01-22T05:40:37.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 shutdown_connections 2024-01-22T05:40:37.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 >> 172.21.15.100:0/1781623897 conn(0x7f6b540630c0 msgr2=0x7f6b54137600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:37.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.779+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 shutdown_connections 2024-01-22T05:40:37.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.780+0000 7f6b5aa00700 1 -- 172.21.15.100:0/1781623897 wait complete. 2024-01-22T05:40:37.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-22T05:40:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.979+0000 7f2594c00700 1 Processor -- start 2024-01-22T05:40:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.979+0000 7f2594c00700 1 -- start start 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.980+0000 7f2594c00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2590150ae0 0x7f2590150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.980+0000 7f2594c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25900c25c0 0x7f25900c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.980+0000 7f2594c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25900660a0 con 0x7f25901521d0 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.980+0000 7f2594c00700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2590065bd0 con 0x7f2590150ae0 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.980+0000 7f2594c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2590151d40 con 0x7f25900c25c0 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2590150ae0 0x7f2590150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2590150ae0 0x7f2590150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37156/0 (socket says 172.21.15.100:37156) 2024-01-22T05:40:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 -- 172.21.15.100:0/3669906707 learned_addr learned my addr 172.21.15.100:0/3669906707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258e800700 1 --2- 172.21.15.100:0/3669906707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25900c25c0 0x7f25900c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 -- 172.21.15.100:0/3669906707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25900c25c0 msgr2=0x7f25900c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 --2- 172.21.15.100:0/3669906707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25900c25c0 0x7f25900c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 -- 172.21.15.100:0/3669906707 >> v1:172.21.15.169:6789/0 conn(0x7f25901521d0 legacy=0x7f25900654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 -- 172.21.15.100:0/3669906707 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590065dc0 con 0x7f2590150ae0 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.981+0000 7f258de00700 1 --2- 172.21.15.100:0/3669906707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2590150ae0 0x7f2590150ec0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f2580006fd0 tx=0x7f25800090f0).ready entity=mon.0 client_cookie=4e37d3f42d9a775c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f258ca00700 1 -- 172.21.15.100:0/3669906707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000b600 con 0x7f2590150ae0 2024-01-22T05:40:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f258ca00700 1 -- 172.21.15.100:0/3669906707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258000b760 con 0x7f2590150ae0 2024-01-22T05:40:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f258ca00700 1 -- 172.21.15.100:0/3669906707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000bae0 con 0x7f2590150ae0 2024-01-22T05:40:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 -- 172.21.15.100:0/3669906707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2590150ae0 msgr2=0x7f2590150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 --2- 172.21.15.100:0/3669906707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2590150ae0 0x7f2590150ec0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f2580006fd0 tx=0x7f25800090f0).stop 2024-01-22T05:40:37.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 -- 172.21.15.100:0/3669906707 shutdown_connections 2024-01-22T05:40:37.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 --2- 172.21.15.100:0/3669906707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2590150ae0 0x7f2590150ec0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 --2- 172.21.15.100:0/3669906707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25900c25c0 0x7f25900c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 -- 172.21.15.100:0/3669906707 >> 172.21.15.100:0/3669906707 conn(0x7f25900630c0 msgr2=0x7f25900c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 -- 172.21.15.100:0/3669906707 shutdown_connections 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.982+0000 7f2594c00700 1 -- 172.21.15.100:0/3669906707 wait complete. 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.984+0000 7f2594c00700 1 Processor -- start 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.984+0000 7f2594c00700 1 -- start start 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f2594c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25900c25c0 0x7f25901478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f2594c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2590150ae0 0x7f25900bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f2594c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25901521d0 0x7f25900bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f2594c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2590149110 con 0x7f25900c25c0 2024-01-22T05:40:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f2594c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25901646c0 con 0x7f2590150ae0 2024-01-22T05:40:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f2594c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25900bc2c0 con 0x7f25901521d0 2024-01-22T05:40:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f258de00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25900c25c0 0x7f25901478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f258de00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25900c25c0 0x7f25901478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37160/0 (socket says 172.21.15.100:37160) 2024-01-22T05:40:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f258de00700 1 -- 172.21.15.100:0/980948758 learned_addr learned my addr 172.21.15.100:0/980948758 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f258e800700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25901521d0 0x7f25900bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f258d400700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2590150ae0 0x7f25900bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f258de00700 1 -- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25901521d0 msgr2=0x7f25900bbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.985+0000 7f258de00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25901521d0 0x7f25900bbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f258de00700 1 -- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2590150ae0 msgr2=0x7f25900bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f258de00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2590150ae0 0x7f25900bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f258de00700 1 -- 172.21.15.100:0/980948758 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580009370 con 0x7f25900c25c0 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f258de00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25900c25c0 0x7f25901478c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f25900bd920 tx=0x7f2580017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f2585600700 1 -- 172.21.15.100:0/980948758 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000bea0 con 0x7f25900c25c0 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f2585600700 1 -- 172.21.15.100:0/980948758 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258000b8d0 con 0x7f25900c25c0 2024-01-22T05:40:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f2585600700 1 -- 172.21.15.100:0/980948758 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258001c670 con 0x7f25900c25c0 2024-01-22T05:40:37.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2590148e30 con 0x7f25900c25c0 2024-01-22T05:40:37.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.986+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25901497b0 con 0x7f25900c25c0 2024-01-22T05:40:37.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.987+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259005fdb0 con 0x7f25900c25c0 2024-01-22T05:40:37.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.988+0000 7f2585600700 1 -- 172.21.15.100:0/980948758 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f258001ca20 con 0x7f25900c25c0 2024-01-22T05:40:37.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.989+0000 7f2585600700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f256805f150 0x7f2568061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:37.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.989+0000 7f2585600700 1 -- 172.21.15.100:0/980948758 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f258007bcf0 con 0x7f25900c25c0 2024-01-22T05:40:37.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.989+0000 7f258d400700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f256805f150 0x7f2568061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:37.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.989+0000 7f258d400700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f256805f150 0x7f2568061610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f25900bc4b0 tx=0x7f2578007d40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:37.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:37.993+0000 7f2585600700 1 -- 172.21.15.100:0/980948758 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2580080070 con 0x7f25900c25c0 2024-01-22T05:40:38.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.162+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f25901516f0 con 0x7f256805f150 2024-01-22T05:40:38.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.162+0000 7f2585600700 1 -- 172.21.15.100:0/980948758 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25901516f0 con 0x7f256805f150 2024-01-22T05:40:38.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f256805f150 msgr2=0x7f2568061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f256805f150 0x7f2568061610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f25900bc4b0 tx=0x7f2578007d40).stop 2024-01-22T05:40:38.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25900c25c0 msgr2=0x7f25901478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25900c25c0 0x7f25901478c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f25900bd920 tx=0x7f2580017000).stop 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 shutdown_connections 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f256805f150 0x7f2568061610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25901521d0 0x7f25900bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25900c25c0 0x7f25901478c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 --2- 172.21.15.100:0/980948758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2590150ae0 0x7f25900bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 >> 172.21.15.100:0/980948758 conn(0x7f25900630c0 msgr2=0x7f259014ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:38.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 shutdown_connections 2024-01-22T05:40:38.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.164+0000 7f2594c00700 1 -- 172.21.15.100:0/980948758 wait complete. 2024-01-22T05:40:38.166 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2024-01-22T05:40:38.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:40:38.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.366+0000 7f1597400700 1 Processor -- start 2024-01-22T05:40:38.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.366+0000 7f1597400700 1 -- start start 2024-01-22T05:40:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.367+0000 7f1597400700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15900c64b0 0x7f1590154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.367+0000 7f1597400700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15900aa3f0 0x7f15900c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.367+0000 7f1597400700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15900c1530 con 0x7f1590154060 2024-01-22T05:40:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.367+0000 7f1597400700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15900cbb60 con 0x7f15900c64b0 2024-01-22T05:40:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.367+0000 7f1597400700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15900cb880 con 0x7f15900aa3f0 2024-01-22T05:40:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.367+0000 7f158fe00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15900c64b0 0x7f1590154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.367+0000 7f1594a00700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1590154060 0x7f15900c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37452/0 (socket says 172.21.15.100:37452) 2024-01-22T05:40:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f1594a00700 1 -- 172.21.15.100:0/2863312507 learned_addr learned my addr 172.21.15.100:0/2863312507 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f1595400700 1 --2- 172.21.15.100:0/2863312507 >> v2:172.21.15.169:3300/0 conn(0x7f15900aa3f0 0x7f15900c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158fe00700 1 -- 172.21.15.100:0/2863312507 >> v2:172.21.15.169:3300/0 conn(0x7f15900aa3f0 msgr2=0x7f15900c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158fe00700 1 --2- 172.21.15.100:0/2863312507 >> v2:172.21.15.169:3300/0 conn(0x7f15900aa3f0 0x7f15900c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158fe00700 1 -- 172.21.15.100:0/2863312507 >> v1:172.21.15.100:6789/0 conn(0x7f1590154060 legacy=0x7f15900c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158fe00700 1 -- 172.21.15.100:0/2863312507 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900c17d0 con 0x7f15900c64b0 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158fe00700 1 --2- 172.21.15.100:0/2863312507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900c64b0 0x7f1590154440 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f15900c5aa0 tx=0x7f1578009060).ready entity=mon.0 client_cookie=41ad319e9c75bd48 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158f400700 1 -- 172.21.15.100:0/2863312507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157800b580 con 0x7f15900c64b0 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158f400700 1 -- 172.21.15.100:0/2863312507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157800b6e0 con 0x7f15900c64b0 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.368+0000 7f158f400700 1 -- 172.21.15.100:0/2863312507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157800ba60 con 0x7f15900c64b0 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 -- 172.21.15.100:0/2863312507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900c64b0 msgr2=0x7f1590154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 --2- 172.21.15.100:0/2863312507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900c64b0 0x7f1590154440 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f15900c5aa0 tx=0x7f1578009060).stop 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 -- 172.21.15.100:0/2863312507 shutdown_connections 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 --2- 172.21.15.100:0/2863312507 >> v2:172.21.15.169:3300/0 conn(0x7f15900aa3f0 0x7f15900c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 --2- 172.21.15.100:0/2863312507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900c64b0 0x7f1590154440 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 -- 172.21.15.100:0/2863312507 >> 172.21.15.100:0/2863312507 conn(0x7f159005e9d0 msgr2=0x7f15900cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 -- 172.21.15.100:0/2863312507 shutdown_connections 2024-01-22T05:40:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.369+0000 7f1597400700 1 -- 172.21.15.100:0/2863312507 wait complete. 2024-01-22T05:40:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.371+0000 7f1597400700 1 Processor -- start 2024-01-22T05:40:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.371+0000 7f1597400700 1 -- start start 2024-01-22T05:40:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1597400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900aa3f0 0x7f15900add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1597400700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15900c64b0 0x7f15900aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1597400700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1590154060 0x7f15901515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1597400700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900aad60 con 0x7f15900aa3f0 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1597400700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590151eb0 con 0x7f1590154060 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1597400700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1590151ae0 con 0x7f15900c64b0 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900aa3f0 0x7f15900add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900aa3f0 0x7f15900add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37178/0 (socket says 172.21.15.100:37178) 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 -- 172.21.15.100:0/3952980777 learned_addr learned my addr 172.21.15.100:0/3952980777 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 -- 172.21.15.100:0/3952980777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15900c64b0 msgr2=0x7f15900aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15900c64b0 0x7f15900aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 -- 172.21.15.100:0/3952980777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1590154060 msgr2=0x7f15901515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1590154060 0x7f15901515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 -- 172.21.15.100:0/3952980777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780092a0 con 0x7f15900aa3f0 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.372+0000 7f1594a00700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900aa3f0 0x7f15900add20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f158000c410 tx=0x7f1580007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.373+0000 7f1587e00700 1 -- 172.21.15.100:0/3952980777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800072e0 con 0x7f15900aa3f0 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.373+0000 7f1587e00700 1 -- 172.21.15.100:0/3952980777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580007440 con 0x7f15900aa3f0 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.373+0000 7f1587e00700 1 -- 172.21.15.100:0/3952980777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800057a0 con 0x7f15900aa3f0 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.373+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15900ae370 con 0x7f15900aa3f0 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.373+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15900ae930 con 0x7f15900aa3f0 2024-01-22T05:40:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.374+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159005fdb0 con 0x7f15900aa3f0 2024-01-22T05:40:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.374+0000 7f1587e00700 1 -- 172.21.15.100:0/3952980777 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1580005b10 con 0x7f15900aa3f0 2024-01-22T05:40:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.376+0000 7f1587e00700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f156805f150 0x7f1568061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.376+0000 7f1587e00700 1 -- 172.21.15.100:0/3952980777 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f15800796b0 con 0x7f15900aa3f0 2024-01-22T05:40:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.376+0000 7f158fe00700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f156805f150 0x7f1568061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.376+0000 7f158fe00700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f156805f150 0x7f1568061610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f15900c68b0 tx=0x7f1578017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:38.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.380+0000 7f1587e00700 1 -- 172.21.15.100:0/3952980777 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f158004abc0 con 0x7f15900aa3f0 2024-01-22T05:40:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.546+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f159006abb0 con 0x7f156805f150 2024-01-22T05:40:38.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.549+0000 7f1587e00700 1 -- 172.21.15.100:0/3952980777 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71038 (secure 0 0 0) 0x7f159006abb0 con 0x7f156805f150 2024-01-22T05:40:38.550 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:38.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f156805f150 msgr2=0x7f1568061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f156805f150 0x7f1568061610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f15900c68b0 tx=0x7f1578017000).stop 2024-01-22T05:40:38.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900aa3f0 msgr2=0x7f15900add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:38.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900aa3f0 0x7f15900add20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f158000c410 tx=0x7f1580007e50).stop 2024-01-22T05:40:38.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 shutdown_connections 2024-01-22T05:40:38.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f156805f150 0x7f1568061610 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1590154060 0x7f15901515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:38.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15900aa3f0 0x7f15900add20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:38.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 --2- 172.21.15.100:0/3952980777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15900c64b0 0x7f15900aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-22T05:40:38.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 >> 172.21.15.100:0/3952980777 conn(0x7f159005e9d0 msgr2=0x7f15900a8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:38.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 shutdown_connections 2024-01-22T05:40:38.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:38.552+0000 7f1597400700 1 -- 172.21.15.100:0/3952980777 wait complete. 2024-01-22T05:40:38.554 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:40:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-01-22T05:40:37.167677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381920,"kb_used_data":5152,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752592800,"statfs":{"total":773094113280,"available":770655027200,"internally_reserved":0,"allocated":5275648,"data_stored":2319480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11844,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.125790"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.762734+0000","last_change":"2024-01-22T05:37:54.031466+0000","last_active":"2024-01-22T05:40:27.762734+0000","last_peered":"2024-01-22T05:40:27.762734+0000","last_clean":"2024-01-22T05:40:27.762734+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:40:27.762734+0000","last_undegraded":"2024-01-22T05:40:27.762734+0000","last_fullsized":"2024-01-22T05:40:27.762734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.294656+0000","last_change":"2024-01-22T05:37:54.034021+0000","last_active":"2024-01-22T05:40:27.294656+0000","last_peered":"2024-01-22T05:40:27.294656+0000","last_clean":"2024-01-22T05:40:27.294656+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:40:27.294656+0000","last_undegraded":"2024-01-22T05:40:27.294656+0000","last_fullsized":"2024-01-22T05:40:27.294656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.762671+0000","last_change":"2024-01-22T05:37:53.210009+0000","last_active":"2024-01-22T05:40:27.762671+0000","last_peered":"2024-01-22T05:40:27.762671+0000","last_clean":"2024-01-22T05:40:27.762671+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:40:27.762671+0000","last_undegraded":"2024-01-22T05:40:27.762671+0000","last_fullsized":"2024-01-22T05:40:27.762671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.762104+0000","last_change":"2024-01-22T05:37:53.209720+0000","last_active":"2024-01-22T05:40:27.762104+0000","last_peered":"2024-01-22T05:40:27.762104+0000","last_clean":"2024-01-22T05:40:27.762104+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:40:27.762104+0000","last_undegraded":"2024-01-22T05:40:27.762104+0000","last_fullsized":"2024-01-22T05:40:27.762104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:35.751204+0000","last_change":"2024-01-22T05:40:35.751204+0000","last_active":"2024-01-22T05:40:35.751204+0000","last_peered":"2024-01-22T05:40:35.751204+0000","last_clean":"2024-01-22T05:40:35.751204+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:40:35.751204+0000","last_undegraded":"2024-01-22T05:40:35.751204+0000","last_fullsized":"2024-01-22T05:40:35.751204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:35.751123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:35.751123+0000","last_clean_scrub_stamp":"2024-01-22T05:40:35.751123+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.762375+0000","last_change":"2024-01-22T05:37:53.478043+0000","last_active":"2024-01-22T05:40:27.762375+0000","last_peered":"2024-01-22T05:40:27.762375+0000","last_clean":"2024-01-22T05:40:27.762375+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:40:27.762375+0000","last_undegraded":"2024-01-22T05:40:27.762375+0000","last_fullsized":"2024-01-22T05:40:27.762375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.294825+0000","last_change":"2024-01-22T05:37:53.204820+0000","last_active":"2024-01-22T05:40:27.294825+0000","last_peered":"2024-01-22T05:40:27.294825+0000","last_clean":"2024-01-22T05:40:27.294825+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:40:27.294825+0000","last_undegraded":"2024-01-22T05:40:27.294825+0000","last_fullsized":"2024-01-22T05:40:27.294825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-22T05:40:27.762133+0000","last_change":"2024-01-22T05:37:53.210151+0000","last_active":"2024-01-22T05:40:27.762133+0000","last_peered":"2024-01-22T05:40:27.762133+0000","last_clean":"2024-01-22T05:40:27.762133+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:40:27.762133+0000","last_undegraded":"2024-01-22T05:40:27.762133+0000","last_fullsized":"2024-01-22T05:40:27.762133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-22T05:40:25.238560+0000","last_change":"2024-01-22T05:37:53.207609+0000","last_active":"2024-01-22T05:40:25.238560+0000","last_peered":"2024-01-22T05:40:25.238560+0000","last_clean":"2024-01-22T05:40:25.238560+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:40:25.238560+0000","last_undegraded":"2024-01-22T05:40:25.238560+0000","last_fullsized":"2024-01-22T05:40:25.238560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:37:52.187458+0000","last_clean_scrub_stamp":"2024-01-22T05:37:52.187458+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.53800000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70699999999999996}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.622},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.629}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98199999999999998,"5min":1.008,"15min":1.008},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0589999999999999,"5min":1.625,"15min":1.625},"last":0.747},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64600000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.95799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.64200000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93200000000000005,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.371,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91800000000000004,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.82799999999999996,"5min":3.589,"15min":3.589},"last":0.90900000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88200000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94699999999999995,"5min":1.228,"15min":1.228},"last":0.79000000000000004}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.41399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.68200000000000005},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.753}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94399999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86099999999999999,"5min":1.135,"15min":1.135},"last":0.90300000000000002}]},{"osd":7,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.48999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.125,"15min":1.125},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.97999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.46500000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.52900000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.59099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.498,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.88500000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":1.038,"15min":1.038},"last":0.69499999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.54000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.875,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.97999999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.91900000000000004,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93300000000000005,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.435},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1080000000000001,"5min":1.355,"15min":1.355},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.23,"15min":1.23},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.75},"min":{"1min":0.57299999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1910000000000001,"5min":1.851,"15min":1.851},"last":0.45900000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.145,"5min":3.145,"15min":3.145},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.72499999999999998,"15min":0.69899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.58399999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.43099999999999999,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.316,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53300000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73399999999999999,"5min":1.403,"15min":1.403},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.503,"15min":0.504},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65300000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.88800000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.94399999999999995,"5min":1.655,"15min":1.655},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91200000000000003,"5min":1.004,"15min":1.004},"last":0.68100000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0129999999999999,"5min":1.595,"15min":1.595},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.87,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":1.536,"15min":1.536},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.63300000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0609999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.629}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64800000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39700000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.441,"15min":0.439},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.56299999999999994,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48699999999999999}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.57399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.43099999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.52200000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.82299999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.44800000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":0.996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.90800000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.79900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.52800000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.29099999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60699999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.496,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95699999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.745,"15min":0.748},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0269999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95799999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":0.81899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.006,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93300000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.026,"5min":1.137,"15min":1.137},"last":0.65200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77200000000000002,"5min":1.266,"15min":1.266},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.53000000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82299999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":1.071,"15min":1.071},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.82199999999999995,"5min":1.113,"15min":1.113},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90200000000000002,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.73699999999999999}]},{"osd":4,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.748}]},{"osd":7,"last update":"Mon Jan 22 05:39:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:40:38.573 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.573 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.573 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.574 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.574 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.574 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.574 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.574 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-22T05:37:52.187458+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=37, tm_sec=52, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T05:40:38.574 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-22T05:40:57.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:40:57.516 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:40:58.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T05:40:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.768+0000 7f44c2c00700 1 Processor -- start 2024-01-22T05:40:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.768+0000 7f44c2c00700 1 -- start start 2024-01-22T05:40:58.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.769+0000 7f44c2c00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44bc153ee0 0x7f44bc0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:58.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.769+0000 7f44c2c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc0c7d30 0x7f44bc0be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.769+0000 7f44c2c00700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0928b0 con 0x7f44bc1542c0 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.769+0000 7f44c2c00700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0bef90 con 0x7f44bc153ee0 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.769+0000 7f44c2c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0bf270 con 0x7f44bc0c7d30 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc0c7d30 0x7f44bc0be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44bbe00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44bc153ee0 0x7f44bc0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc0c7d30 0x7f44bc0be9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.100:58648/0 (socket says 172.21.15.100:58648) 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 -- 172.21.15.100:0/23079400 learned_addr learned my addr 172.21.15.100:0/23079400 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44bbe00700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44bc153ee0 0x7f44bc0c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.100:53286/0 (socket says 172.21.15.100:53286) 2024-01-22T05:40:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 -- 172.21.15.100:0/23079400 >> v2:172.21.15.169:3300/0 conn(0x7f44bc153ee0 msgr2=0x7f44bc0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 --2- 172.21.15.100:0/23079400 >> v2:172.21.15.169:3300/0 conn(0x7f44bc153ee0 0x7f44bc0c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 -- 172.21.15.100:0/23079400 >> v1:172.21.15.169:6789/0 conn(0x7f44bc1542c0 legacy=0x7f44bc0be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 -- 172.21.15.100:0/23079400 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0bfba0 con 0x7f44bc0c7d30 2024-01-22T05:40:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44c0c00700 1 --2- 172.21.15.100:0/23079400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc0c7d30 0x7f44bc0be9e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f44b4009f20 tx=0x7f44b4009840).ready entity=mon.2 client_cookie=25cc58d37e8691b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.770+0000 7f44baa00700 1 -- 172.21.15.100:0/23079400 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400e070 con 0x7f44bc0c7d30 2024-01-22T05:40:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44baa00700 1 -- 172.21.15.100:0/23079400 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b400b9d0 con 0x7f44bc0c7d30 2024-01-22T05:40:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44baa00700 1 -- 172.21.15.100:0/23079400 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400bd50 con 0x7f44bc0c7d30 2024-01-22T05:40:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 -- 172.21.15.100:0/23079400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc0c7d30 msgr2=0x7f44bc0be9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 --2- 172.21.15.100:0/23079400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc0c7d30 0x7f44bc0be9e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f44b4009f20 tx=0x7f44b4009840).stop 2024-01-22T05:40:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 -- 172.21.15.100:0/23079400 shutdown_connections 2024-01-22T05:40:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 --2- 172.21.15.100:0/23079400 >> v2:172.21.15.169:3300/0 conn(0x7f44bc153ee0 0x7f44bc0c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 --2- 172.21.15.100:0/23079400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc0c7d30 0x7f44bc0be9e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 -- 172.21.15.100:0/23079400 >> 172.21.15.100:0/23079400 conn(0x7f44bc091a00 msgr2=0x7f44bc091e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:58.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 -- 172.21.15.100:0/23079400 shutdown_connections 2024-01-22T05:40:58.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.771+0000 7f44c2c00700 1 -- 172.21.15.100:0/23079400 wait complete. 2024-01-22T05:40:58.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.773+0000 7f44c2c00700 1 Processor -- start 2024-01-22T05:40:58.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.773+0000 7f44c2c00700 1 -- start start 2024-01-22T05:40:58.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44c2c00700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44bc0c7d30 0x7f44bc14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:58.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44c2c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44bc153ee0 0x7f44bc1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:58.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44c2c00700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc1542c0 0x7f44bc067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:58.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44c2c00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc14e180 con 0x7f44bc153ee0 2024-01-22T05:40:58.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44c2c00700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0acb90 con 0x7f44bc0c7d30 2024-01-22T05:40:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44c2c00700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0abf80 con 0x7f44bc1542c0 2024-01-22T05:40:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44bb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44bc153ee0 0x7f44bc1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44bb400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44bc153ee0 0x7f44bc1564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45562/0 (socket says 172.21.15.100:45562) 2024-01-22T05:40:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44bb400700 1 -- 172.21.15.100:0/3543775080 learned_addr learned my addr 172.21.15.100:0/3543775080 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44bbe00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44bc0c7d30 0x7f44bc14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.774+0000 7f44c0c00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc1542c0 0x7f44bc067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44bb400700 1 -- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc1542c0 msgr2=0x7f44bc067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44bb400700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc1542c0 0x7f44bc067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44bb400700 1 -- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44bc0c7d30 msgr2=0x7f44bc14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44bb400700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44bc0c7d30 0x7f44bc14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44bb400700 1 -- 172.21.15.100:0/3543775080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4009ae0 con 0x7f44bc153ee0 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44bb400700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44bc153ee0 0x7f44bc1564a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f44a400c4c0 tx=0x7f44a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44b3400700 1 -- 172.21.15.100:0/3543775080 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400ce70 con 0x7f44bc153ee0 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44b3400700 1 -- 172.21.15.100:0/3543775080 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4001e90 con 0x7f44bc153ee0 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc0ac260 con 0x7f44bc153ee0 2024-01-22T05:40:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44b3400700 1 -- 172.21.15.100:0/3543775080 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4007250 con 0x7f44bc153ee0 2024-01-22T05:40:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.775+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc0ac820 con 0x7f44bc153ee0 2024-01-22T05:40:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.776+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc05fdb0 con 0x7f44bc153ee0 2024-01-22T05:40:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.777+0000 7f44b3400700 1 -- 172.21.15.100:0/3543775080 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f44a40066a0 con 0x7f44bc153ee0 2024-01-22T05:40:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.778+0000 7f44b3400700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f449405f150 0x7f4494061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.778+0000 7f44b3400700 1 -- 172.21.15.100:0/3543775080 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f44a40797b0 con 0x7f44bc153ee0 2024-01-22T05:40:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.778+0000 7f44bbe00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f449405f150 0x7f4494061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.779+0000 7f44bbe00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f449405f150 0x7f4494061610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f44ac006fd0 tx=0x7f44ac006f40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.782+0000 7f44b3400700 1 -- 172.21.15.100:0/3543775080 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f44a404ad80 con 0x7f44bc153ee0 2024-01-22T05:40:58.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.947+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 --> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44bc0accd0 con 0x7f449405f150 2024-01-22T05:40:58.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.950+0000 7f44b3400700 1 -- 172.21.15.100:0/3543775080 <== mgr.4110 v2:172.21.15.100:6832/70830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71025 (secure 0 0 0) 0x7f44bc0accd0 con 0x7f449405f150 2024-01-22T05:40:58.953 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.952+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f449405f150 msgr2=0x7f4494061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.952+0000 7f44c2c00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f449405f150 0x7f4494061610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f44ac006fd0 tx=0x7f44ac006f40).stop 2024-01-22T05:40:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.952+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44bc153ee0 msgr2=0x7f44bc1564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.952+0000 7f44c2c00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44bc153ee0 0x7f44bc1564a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f44a400c4c0 tx=0x7f44a4007e00).stop 2024-01-22T05:40:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 shutdown_connections 2024-01-22T05:40:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f449405f150 0x7f4494061610 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44bc0c7d30 0x7f44bc14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44bc1542c0 0x7f44bc067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 --2- 172.21.15.100:0/3543775080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44bc153ee0 0x7f44bc1564a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:58.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 >> 172.21.15.100:0/3543775080 conn(0x7f44bc091a00 msgr2=0x7f44bc14f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:58.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 shutdown_connections 2024-01-22T05:40:58.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:58.953+0000 7f44c2c00700 1 -- 172.21.15.100:0/3543775080 wait complete. 2024-01-22T05:40:58.956 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-22T05:40:58.972 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-01-22T05:40:57.171969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381920,"kb_used_data":5152,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752592800,"statfs":{"total":773094113280,"available":770655027200,"internally_reserved":0,"allocated":5275648,"data_stored":2319480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11844,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.125790"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:52.294052+0000","last_change":"2024-01-22T05:40:52.294052+0000","last_active":"2024-01-22T05:40:52.294052+0000","last_peered":"2024-01-22T05:40:52.294052+0000","last_clean":"2024-01-22T05:40:52.294052+0000","last_became_active":"2024-01-22T05:37:54.031194+0000","last_became_peered":"2024-01-22T05:37:54.031194+0000","last_unstale":"2024-01-22T05:40:52.294052+0000","last_undegraded":"2024-01-22T05:40:52.294052+0000","last_fullsized":"2024-01-22T05:40:52.294052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:52.293941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:52.293941+0000","last_clean_scrub_stamp":"2024-01-22T05:40:52.293941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:37.417544+0000","last_change":"2024-01-22T05:40:37.417544+0000","last_active":"2024-01-22T05:40:37.417544+0000","last_peered":"2024-01-22T05:40:37.417544+0000","last_clean":"2024-01-22T05:40:37.417544+0000","last_became_active":"2024-01-22T05:37:54.033658+0000","last_became_peered":"2024-01-22T05:37:54.033658+0000","last_unstale":"2024-01-22T05:40:37.417544+0000","last_undegraded":"2024-01-22T05:40:37.417544+0000","last_fullsized":"2024-01-22T05:40:37.417544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:37.417430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:37.417430+0000","last_clean_scrub_stamp":"2024-01-22T05:40:37.417430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:50.362919+0000","last_change":"2024-01-22T05:40:50.362919+0000","last_active":"2024-01-22T05:40:50.362919+0000","last_peered":"2024-01-22T05:40:50.362919+0000","last_clean":"2024-01-22T05:40:50.362919+0000","last_became_active":"2024-01-22T05:37:53.209595+0000","last_became_peered":"2024-01-22T05:37:53.209595+0000","last_unstale":"2024-01-22T05:40:50.362919+0000","last_undegraded":"2024-01-22T05:40:50.362919+0000","last_fullsized":"2024-01-22T05:40:50.362919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:50.362800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:50.362800+0000","last_clean_scrub_stamp":"2024-01-22T05:40:50.362800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:36.406808+0000","last_change":"2024-01-22T05:40:36.406808+0000","last_active":"2024-01-22T05:40:36.406808+0000","last_peered":"2024-01-22T05:40:36.406808+0000","last_clean":"2024-01-22T05:40:36.406808+0000","last_became_active":"2024-01-22T05:37:53.209362+0000","last_became_peered":"2024-01-22T05:37:53.209362+0000","last_unstale":"2024-01-22T05:40:36.406808+0000","last_undegraded":"2024-01-22T05:40:36.406808+0000","last_fullsized":"2024-01-22T05:40:36.406808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:36.406723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:36.406723+0000","last_clean_scrub_stamp":"2024-01-22T05:40:36.406723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:35.751204+0000","last_change":"2024-01-22T05:40:35.751204+0000","last_active":"2024-01-22T05:40:35.751204+0000","last_peered":"2024-01-22T05:40:35.751204+0000","last_clean":"2024-01-22T05:40:35.751204+0000","last_became_active":"2024-01-22T05:37:52.197428+0000","last_became_peered":"2024-01-22T05:37:52.197428+0000","last_unstale":"2024-01-22T05:40:35.751204+0000","last_undegraded":"2024-01-22T05:40:35.751204+0000","last_fullsized":"2024-01-22T05:40:35.751204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:35.751123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:35.751123+0000","last_clean_scrub_stamp":"2024-01-22T05:40:35.751123+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:42.426900+0000","last_change":"2024-01-22T05:40:42.426900+0000","last_active":"2024-01-22T05:40:42.426900+0000","last_peered":"2024-01-22T05:40:42.426900+0000","last_clean":"2024-01-22T05:40:42.426900+0000","last_became_active":"2024-01-22T05:37:53.477724+0000","last_became_peered":"2024-01-22T05:37:53.477724+0000","last_unstale":"2024-01-22T05:40:42.426900+0000","last_undegraded":"2024-01-22T05:40:42.426900+0000","last_fullsized":"2024-01-22T05:40:42.426900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:42.426786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:42.426786+0000","last_clean_scrub_stamp":"2024-01-22T05:40:42.426786+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:38.168334+0000","last_change":"2024-01-22T05:40:38.168334+0000","last_active":"2024-01-22T05:40:38.168334+0000","last_peered":"2024-01-22T05:40:38.168334+0000","last_clean":"2024-01-22T05:40:38.168334+0000","last_became_active":"2024-01-22T05:37:53.204443+0000","last_became_peered":"2024-01-22T05:37:53.204443+0000","last_unstale":"2024-01-22T05:40:38.168334+0000","last_undegraded":"2024-01-22T05:40:38.168334+0000","last_fullsized":"2024-01-22T05:40:38.168334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:38.168219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:38.168219+0000","last_clean_scrub_stamp":"2024-01-22T05:40:38.168219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:39.435716+0000","last_change":"2024-01-22T05:40:39.435716+0000","last_active":"2024-01-22T05:40:39.435716+0000","last_peered":"2024-01-22T05:40:39.435716+0000","last_clean":"2024-01-22T05:40:39.435716+0000","last_became_active":"2024-01-22T05:37:53.209838+0000","last_became_peered":"2024-01-22T05:37:53.209838+0000","last_unstale":"2024-01-22T05:40:39.435716+0000","last_undegraded":"2024-01-22T05:40:39.435716+0000","last_fullsized":"2024-01-22T05:40:39.435716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:39.435606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:39.435606+0000","last_clean_scrub_stamp":"2024-01-22T05:40:39.435606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-22T05:40:38.073334+0000","last_change":"2024-01-22T05:40:38.073334+0000","last_active":"2024-01-22T05:40:38.073334+0000","last_peered":"2024-01-22T05:40:38.073334+0000","last_clean":"2024-01-22T05:40:38.073334+0000","last_became_active":"2024-01-22T05:37:53.207154+0000","last_became_peered":"2024-01-22T05:37:53.207154+0000","last_unstale":"2024-01-22T05:40:38.073334+0000","last_undegraded":"2024-01-22T05:40:38.073334+0000","last_fullsized":"2024-01-22T05:40:38.073334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T05:40:38.073179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T05:40:38.073179+0000","last_clean_scrub_stamp":"2024-01-22T05:40:38.073179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:40:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.621,"15min":0.60699999999999998},"min":{"1min":0.48899999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Mon Jan 22 05:40:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.74199999999999999}]},{"osd":2,"last update":"Mon Jan 22 05:40:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.45200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.437,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97399999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71799999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:40:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.66400000000000003},"min":{"1min":0.55200000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.51800000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98299999999999998,"5min":1.077,"15min":1.077},"last":0.80500000000000005}]},{"osd":4,"last update":"Mon Jan 22 05:40:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.64500000000000002},"min":{"1min":0.41099999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96599999999999997,"5min":1.008,"15min":1.008},"last":0.505},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Jan 22 05:40:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.71399999999999997,"15min":0.73799999999999999},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93500000000000005,"5min":1.331,"15min":1.331},"last":0.60499999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:40:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.625,"15min":1.625},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70199999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.95799999999999996,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93200000000000005,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.439,"5min":0.371,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91800000000000004,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78900000000000003,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.82799999999999996,"5min":3.589,"15min":3.589},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88200000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.751},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94699999999999995,"5min":1.228,"15min":1.228},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.41399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67000000000000004,"15min":0.68200000000000005},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94399999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86099999999999999,"5min":1.135,"15min":1.135},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Jan 22 05:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.48999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":1.125,"15min":1.125},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.79200000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.495},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.46500000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.52900000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.59099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.498,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59599999999999997}]},{"osd":4,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.88500000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":1.038,"15min":1.038},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.751}]},{"osd":6,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.54000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.875,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Mon Jan 22 05:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.97999999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.91900000000000004,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.81000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93300000000000005,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1080000000000001,"5min":1.355,"15min":1.355},"last":0.84999999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.83799999999999997}]},{"osd":3,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.23,"15min":1.23},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.75},"min":{"1min":0.57299999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1910000000000001,"5min":1.851,"15min":1.851},"last":0.89100000000000001}]},{"osd":5,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.145,"5min":3.145,"15min":3.145},"last":0.878}]},{"osd":7,"last update":"Mon Jan 22 05:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.72499999999999998,"15min":0.69899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.754}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:40:55 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.44},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.626},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.41299999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Mon Jan 22 05:40:55 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48999999999999999,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51400000000000001}]},{"osd":3,"last update":"Mon Jan 22 05:40:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79800000000000004,"5min":1.403,"15min":1.403},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.78300000000000003,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:40:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.76900000000000002,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1160000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.876}]},{"osd":5,"last update":"Mon Jan 22 05:40:55 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1819999999999999,"5min":1.655,"15min":1.655},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75800000000000001,"15min":0.76000000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Mon Jan 22 05:40:55 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.58299999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0860000000000001,"5min":1.595,"15min":1.595},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.76000000000000001}]},{"osd":7,"last update":"Mon Jan 22 05:40:55 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.61499999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0269999999999999,"5min":1.536,"15min":1.536},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2230000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73799999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64800000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.502},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.441,"15min":0.439},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.56299999999999994,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56599999999999995}]},{"osd":3,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.57399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.52200000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.82299999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.84799999999999998}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.875},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.76200000000000001}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":0.996},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.90800000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.79900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.751},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.91000000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60699999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.496,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52200000000000002}]},{"osd":2,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95699999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.745,"15min":0.748},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0269999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95799999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.97799999999999998}]},{"osd":6,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":0.81899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.006,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.90400000000000003}]},{"osd":7,"last update":"Mon Jan 22 05:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93300000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.026,"5min":1.137,"15min":1.137},"last":1.04}]}]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":659456,"data_stored":289935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 05:40:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89100000000000001,"5min":1.266,"15min":1.266},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92800000000000005,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Jan 22 05:40:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.51600000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.51000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.86299999999999999,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Jan 22 05:40:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88900000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90800000000000003,"5min":1.071,"15min":1.071},"last":0.79900000000000004}]},{"osd":3,"last update":"Mon Jan 22 05:40:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.113,"15min":1.113},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.53700000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97599999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Jan 22 05:40:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68100000000000005,"15min":0.70699999999999996},"min":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.72299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.67800000000000005,"15min":0.68899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73599999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.71499999999999997}]},{"osd":6,"last update":"Mon Jan 22 05:40:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.53500000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.83799999999999997,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.751}]},{"osd":7,"last update":"Mon Jan 22 05:40:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.79900000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.88700000000000001,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.81899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T05:40:58.974 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-22T05:40:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.152+0000 7f1fef800700 1 Processor -- start 2024-01-22T05:40:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.153+0000 7f1fef800700 1 -- start start 2024-01-22T05:40:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fef800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe81521d0 0x7f1fe80654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fef800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1fe80c25c0 0x7f1fe80c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fef800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80660a0 con 0x7f1fe8150ae0 2024-01-22T05:40:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fef800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe8151d40 con 0x7f1fe80c25c0 2024-01-22T05:40:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fef800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8065dc0 con 0x7f1fe81521d0 2024-01-22T05:40:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fed800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1fe80c25c0 0x7f1fe80c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fed800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1fe80c25c0 0x7f1fe80c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45578/0 (socket says 172.21.15.100:45578) 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fed800700 1 -- 172.21.15.100:0/1389280291 learned_addr learned my addr 172.21.15.100:0/1389280291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fe7e00700 1 --2- 172.21.15.100:0/1389280291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe81521d0 0x7f1fe80654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.154+0000 7f1fed800700 1 -- 172.21.15.100:0/1389280291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe81521d0 msgr2=0x7f1fe80654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fed800700 1 --2- 172.21.15.100:0/1389280291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe81521d0 0x7f1fe80654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fed800700 1 -- 172.21.15.100:0/1389280291 >> v1:172.21.15.169:6789/0 conn(0x7f1fe8150ae0 legacy=0x7f1fe8150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fed800700 1 -- 172.21.15.100:0/1389280291 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe81516f0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fe7e00700 1 --2- 172.21.15.100:0/1389280291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe81521d0 0x7f1fe80654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-22T05:40:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fed800700 1 --2- 172.21.15.100:0/1389280291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c55f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f1fe0009f20 tx=0x7f1fe0009840).ready entity=mon.0 client_cookie=f3142adb15c63fc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fe7400700 1 -- 172.21.15.100:0/1389280291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000e070 con 0x7f1fe80c25c0 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fe7400700 1 -- 172.21.15.100:0/1389280291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe000ba40 con 0x7f1fe80c25c0 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fe7400700 1 -- 172.21.15.100:0/1389280291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000bdc0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fef800700 1 -- 172.21.15.100:0/1389280291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 msgr2=0x7f1fe80c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.155+0000 7f1fef800700 1 --2- 172.21.15.100:0/1389280291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c55f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f1fe0009f20 tx=0x7f1fe0009840).stop 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.156+0000 7f1fef800700 1 -- 172.21.15.100:0/1389280291 shutdown_connections 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.156+0000 7f1fef800700 1 --2- 172.21.15.100:0/1389280291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c55f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.156+0000 7f1fef800700 1 --2- 172.21.15.100:0/1389280291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe81521d0 0x7f1fe80654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.156+0000 7f1fef800700 1 -- 172.21.15.100:0/1389280291 >> 172.21.15.100:0/1389280291 conn(0x7f1fe80630c0 msgr2=0x7f1fe80c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:59.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.156+0000 7f1fef800700 1 -- 172.21.15.100:0/1389280291 shutdown_connections 2024-01-22T05:40:59.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.156+0000 7f1fef800700 1 -- 172.21.15.100:0/1389280291 wait complete. 2024-01-22T05:40:59.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.157+0000 7f1fef800700 1 Processor -- start 2024-01-22T05:40:59.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.157+0000 7f1fef800700 1 -- start start 2024-01-22T05:40:59.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fef800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fef800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe8150ae0 0x7f1fe8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fef800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fe81521d0 0x7f1fe81405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fef800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c3e40 con 0x7f1fe80c25c0 2024-01-22T05:40:59.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fef800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8159890 con 0x7f1fe81521d0 2024-01-22T05:40:59.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fef800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c40b0 con 0x7f1fe8150ae0 2024-01-22T05:40:59.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fece00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fece00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45592/0 (socket says 172.21.15.100:45592) 2024-01-22T05:40:59.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.158+0000 7f1fece00700 1 -- 172.21.15.100:0/3353746842 learned_addr learned my addr 172.21.15.100:0/3353746842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fe7e00700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe8150ae0 0x7f1fe8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fed800700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fe81521d0 0x7f1fe81405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fece00700 1 -- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe8150ae0 msgr2=0x7f1fe8156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fece00700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe8150ae0 0x7f1fe8156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fece00700 1 -- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fe81521d0 msgr2=0x7f1fe81405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fece00700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fe81521d0 0x7f1fe81405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fece00700 1 -- 172.21.15.100:0/3353746842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0009ae0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fece00700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c48b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f1fd800c440 tx=0x7f1fd8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800f470 con 0x7f1fe80c25c0 2024-01-22T05:40:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800f5f0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe80c4390 con 0x7f1fe80c25c0 2024-01-22T05:40:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800f9b0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.159+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe8159b70 con 0x7f1fe80c25c0 2024-01-22T05:40:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.160+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe805fdb0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.161+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1fd8012400 con 0x7f1fe80c25c0 2024-01-22T05:40:59.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.162+0000 7f1fdfe00700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1fc005f150 0x7f1fc0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.162+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f1fd8079390 con 0x7f1fe80c25c0 2024-01-22T05:40:59.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.162+0000 7f1fe7e00700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1fc005f150 0x7f1fc0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.163+0000 7f1fe7e00700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1fc005f150 0x7f1fc0061610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f1fe8168ae0 tx=0x7f1fd0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:59.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.166+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1fd8048b00 con 0x7f1fe80c25c0 2024-01-22T05:40:59.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.340+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1fe81519d0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.344+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1fd804a9b0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.344+0000 7f1fdfe00700 1 -- 172.21.15.100:0/3353746842 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1fd804e3e0 con 0x7f1fe80c25c0 2024-01-22T05:40:59.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.346+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1fc005f150 msgr2=0x7f1fc0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.346+0000 7f1fef800700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1fc005f150 0x7f1fc0061610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f1fe8168ae0 tx=0x7f1fd0008040).stop 2024-01-22T05:40:59.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 msgr2=0x7f1fe80c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c48b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f1fd800c440 tx=0x7f1fd8007de0).stop 2024-01-22T05:40:59.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 shutdown_connections 2024-01-22T05:40:59.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f1fc005f150 0x7f1fc0061610 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fe81521d0 0x7f1fe81405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80c25c0 0x7f1fe80c48b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 --2- 172.21.15.100:0/3353746842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fe8150ae0 0x7f1fe8156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 >> 172.21.15.100:0/3353746842 conn(0x7f1fe80630c0 msgr2=0x7f1fe81527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:59.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 shutdown_connections 2024-01-22T05:40:59.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.347+0000 7f1fef800700 1 -- 172.21.15.100:0/3353746842 wait complete. 2024-01-22T05:40:59.365 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T05:40:59.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T05:40:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.549+0000 7f78c1800700 1 Processor -- start 2024-01-22T05:40:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.549+0000 7f78c1800700 1 -- start start 2024-01-22T05:40:59.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.550+0000 7f78c1800700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f78bc154060 0x7f78bc154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.550+0000 7f78c1800700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0c1530 con 0x7f78bc0c64b0 2024-01-22T05:40:59.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.550+0000 7f78c1800700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0cb880 con 0x7f78bc0aa3f0 2024-01-22T05:40:59.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.550+0000 7f78c1800700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0cbb60 con 0x7f78bc154060 2024-01-22T05:40:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.550+0000 7f78baa00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f78bc154060 0x7f78bc154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.550+0000 7f78bb400700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f78bc0c64b0 0x7f78bc0c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49846/0 (socket says 172.21.15.100:49846) 2024-01-22T05:40:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.550+0000 7f78bb400700 1 -- 172.21.15.100:0/2019241474 learned_addr learned my addr 172.21.15.100:0/2019241474 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-22T05:40:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78baa00700 1 -- 172.21.15.100:0/2019241474 >> v1:172.21.15.169:6789/0 conn(0x7f78bc0aa3f0 legacy=0x7f78bc0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78baa00700 1 -- 172.21.15.100:0/2019241474 >> v1:172.21.15.100:6789/0 conn(0x7f78bc0c64b0 legacy=0x7f78bc0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78baa00700 1 -- 172.21.15.100:0/2019241474 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0c17d0 con 0x7f78bc154060 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78b9600700 1 -- 172.21.15.100:0/2019241474 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380252492 0 0) 0x7f78bc0c1530 con 0x7f78bc0c64b0 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78baa00700 1 --2- 172.21.15.100:0/2019241474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc154060 0x7f78bc154440 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f78ac009760 tx=0x7f78ac009060).ready entity=mon.0 client_cookie=936cb55bbe3ce35c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78b9600700 1 -- 172.21.15.100:0/2019241474 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00b580 con 0x7f78bc154060 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78b9600700 1 -- 172.21.15.100:0/2019241474 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f78ac00b6e0 con 0x7f78bc154060 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.551+0000 7f78b9600700 1 -- 172.21.15.100:0/2019241474 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00ba60 con 0x7f78bc154060 2024-01-22T05:40:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.552+0000 7f78c1800700 1 -- 172.21.15.100:0/2019241474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc154060 msgr2=0x7f78bc154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.552+0000 7f78c1800700 1 --2- 172.21.15.100:0/2019241474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc154060 0x7f78bc154440 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f78ac009760 tx=0x7f78ac009060).stop 2024-01-22T05:40:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.552+0000 7f78c1800700 1 -- 172.21.15.100:0/2019241474 shutdown_connections 2024-01-22T05:40:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.552+0000 7f78c1800700 1 --2- 172.21.15.100:0/2019241474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc154060 0x7f78bc154440 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.552+0000 7f78c1800700 1 -- 172.21.15.100:0/2019241474 >> 172.21.15.100:0/2019241474 conn(0x7f78bc05e9d0 msgr2=0x7f78bc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.552+0000 7f78c1800700 1 -- 172.21.15.100:0/2019241474 shutdown_connections 2024-01-22T05:40:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.552+0000 7f78c1800700 1 -- 172.21.15.100:0/2019241474 wait complete. 2024-01-22T05:40:59.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.553+0000 7f78c1800700 1 Processor -- start 2024-01-22T05:40:59.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.554+0000 7f78c1800700 1 -- start start 2024-01-22T05:40:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.554+0000 7f78c1800700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78bc0aa3f0 0x7f78bc0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.554+0000 7f78c1800700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc0c64b0 0x7f78bc1678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78c1800700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78bc154060 0x7f78bc0abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78c1800700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc168810 con 0x7f78bc0c64b0 2024-01-22T05:40:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78c1800700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0afb00 con 0x7f78bc0aa3f0 2024-01-22T05:40:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78c1800700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc167f70 con 0x7f78bc154060 2024-01-22T05:40:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc0c64b0 0x7f78bc1678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc0c64b0 0x7f78bc1678e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45608/0 (socket says 172.21.15.100:45608) 2024-01-22T05:40:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 -- 172.21.15.100:0/2185519613 learned_addr learned my addr 172.21.15.100:0/2185519613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-22T05:40:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78bb400700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78bc154060 0x7f78bc0abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78baa00700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78bc0aa3f0 0x7f78bc0aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 -- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78bc154060 msgr2=0x7f78bc0abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78bc154060 0x7f78bc0abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 -- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78bc0aa3f0 msgr2=0x7f78bc0aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78bc0aa3f0 0x7f78bc0aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 -- 172.21.15.100:0/2185519613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0092a0 con 0x7f78bc0c64b0 2024-01-22T05:40:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78baa00700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78bc0aa3f0 0x7f78bc0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78bb400700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78bc154060 0x7f78bc0abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T05:40:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.555+0000 7f78ba000700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc0c64b0 0x7f78bc1678e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f78a400c440 tx=0x7f78a4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.556+0000 7f78b2000700 1 -- 172.21.15.100:0/2185519613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4007020 con 0x7f78bc0c64b0 2024-01-22T05:40:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.556+0000 7f78b2000700 1 -- 172.21.15.100:0/2185519613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f78a4007180 con 0x7f78bc0c64b0 2024-01-22T05:40:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.556+0000 7f78b2000700 1 -- 172.21.15.100:0/2185519613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4007540 con 0x7f78bc0c64b0 2024-01-22T05:40:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.556+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc168250 con 0x7f78bc0c64b0 2024-01-22T05:40:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.556+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc0ac3b0 con 0x7f78bc0c64b0 2024-01-22T05:40:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.557+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0afc70 con 0x7f78bc0c64b0 2024-01-22T05:40:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.558+0000 7f78b2000700 1 -- 172.21.15.100:0/2185519613 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f78a40068b0 con 0x7f78bc0c64b0 2024-01-22T05:40:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.558+0000 7f78b2000700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f789405f150 0x7f7894061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-22T05:40:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.558+0000 7f78b2000700 1 -- 172.21.15.100:0/2185519613 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f78a40799c0 con 0x7f78bc0c64b0 2024-01-22T05:40:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.559+0000 7f78baa00700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f789405f150 0x7f7894061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-22T05:40:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.559+0000 7f78baa00700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f789405f150 0x7f7894061610 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f78ac00b340 tx=0x7f78ac009060).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T05:40:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.563+0000 7f78b2000700 1 -- 172.21.15.100:0/2185519613 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f78a404af50 con 0x7f78bc0c64b0 2024-01-22T05:40:59.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.772+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78bc05fdb0 con 0x7f78bc0c64b0 2024-01-22T05:40:59.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.772+0000 7f78b2000700 1 -- 172.21.15.100:0/2185519613 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f78a404e570 con 0x7f78bc0c64b0 2024-01-22T05:40:59.773 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-22T05:40:59.774 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4035127106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4035127106},{"type":"v1","addr":"172.21.15.169:6833","nonce":4035127106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2883555784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2883555784},{"type":"v1","addr":"172.21.15.169:6835","nonce":2883555784}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2387513263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2387513263},{"type":"v1","addr":"172.21.15.100:6836","nonce":2387513263}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5727,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/354654700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":354654700},{"type":"v1","addr":"172.21.15.100:6837","nonce":354654700}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2024-01-22T05:40:59.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f789405f150 msgr2=0x7f7894061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f789405f150 0x7f7894061610 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f78ac00b340 tx=0x7f78ac009060).stop 2024-01-22T05:40:59.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc0c64b0 msgr2=0x7f78bc1678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T05:40:59.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc0c64b0 0x7f78bc1678e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f78a400c440 tx=0x7f78a4007dd0).stop 2024-01-22T05:40:59.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 shutdown_connections 2024-01-22T05:40:59.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:6832/70830,v1:172.21.15.100:6833/70830] conn(0x7f789405f150 0x7f7894061610 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78bc0aa3f0 0x7f78bc0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f78bc154060 0x7f78bc0abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 --2- 172.21.15.100:0/2185519613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78bc0c64b0 0x7f78bc1678e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-22T05:40:59.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.774+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 >> 172.21.15.100:0/2185519613 conn(0x7f78bc05e9d0 msgr2=0x7f78bc150dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T05:40:59.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.775+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 shutdown_connections 2024-01-22T05:40:59.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-22T05:40:59.775+0000 7f78c1800700 1 -- 172.21.15.100:0/2185519613 wait complete. 2024-01-22T05:40:59.777 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-01-22T05:40:59.793 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-22T05:40:59.793 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-22T05:40:59.793 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T05:40:59.793 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:40:59.806 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T05:40:59.807 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T05:40:59.807 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:40:59.861 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T05:40:59.861 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T05:40:59.861 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:40:59.876 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T05:40:59.877 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-22T05:40:59.877 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:40:59.932 INFO:tasks.ceph.mds.d:Stopped 2024-01-22T05:40:59.932 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-22T05:40:59.933 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-22T05:40:59.933 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:40:59.975 INFO:tasks.ceph.osd.0:Stopped 2024-01-22T05:40:59.976 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-22T05:40:59.976 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.021 INFO:tasks.ceph.osd.1:Stopped 2024-01-22T05:41:00.022 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-22T05:41:00.022 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.066 INFO:tasks.ceph.osd.2:Stopped 2024-01-22T05:41:00.066 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-22T05:41:00.066 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.114 INFO:tasks.ceph.osd.3:Stopped 2024-01-22T05:41:00.114 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-22T05:41:00.114 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.155 INFO:tasks.ceph.osd.4:Stopped 2024-01-22T05:41:00.156 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-22T05:41:00.156 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.203 INFO:tasks.ceph.osd.5:Stopped 2024-01-22T05:41:00.203 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-22T05:41:00.203 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.253 INFO:tasks.ceph.osd.6:Stopped 2024-01-22T05:41:00.254 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-22T05:41:00.254 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.308 INFO:tasks.ceph.osd.7:Stopped 2024-01-22T05:41:00.309 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-22T05:41:00.309 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-22T05:41:00.309 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.369 INFO:tasks.ceph.mgr.y:Stopped 2024-01-22T05:41:00.369 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-22T05:41:00.369 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.425 INFO:tasks.ceph.mgr.x:Stopped 2024-01-22T05:41:00.425 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-22T05:41:00.425 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-22T05:41:00.426 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.446 INFO:tasks.ceph.mon.a:Stopped 2024-01-22T05:41:00.446 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-22T05:41:00.446 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.465 INFO:tasks.ceph.mon.b:Stopped 2024-01-22T05:41:00.465 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-22T05:41:00.465 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T05:41:00.525 INFO:tasks.ceph.mon.c:Stopped 2024-01-22T05:41:00.526 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-22T05:41:00.526 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-22T05:41:00.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:41:00.604 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-22T05:41:00.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:41:00.845 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-22T05:41:00.968 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:41:00.968 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-22T05:41:01.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:41:01.082 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-22T05:41:01.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:41:01.213 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-22T05:41:01.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:41:01.463 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-22T05:41:01.570 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:41:01.571 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-22T05:41:01.674 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:41:01.675 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-22T05:41:01.789 INFO:tasks.ceph:Archiving mon data... 2024-01-22T05:41:01.790 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/data/mon.a.tgz 2024-01-22T05:41:01.790 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-22T05:41:01.835 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.SjoCJ7mn05 2024-01-22T05:41:01.836 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SjoCJ7mn05 2024-01-22T05:41:02.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.SjoCJ7mn05 2024-01-22T05:41:02.200 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.SjoCJ7mn05 is 729KB 2024-01-22T05:41:02.304 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.SjoCJ7mn05 2024-01-22T05:41:02.347 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/data/mon.b.tgz 2024-01-22T05:41:02.348 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-01-22T05:41:02.393 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.6gJKUsf0im 2024-01-22T05:41:02.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6gJKUsf0im 2024-01-22T05:41:02.709 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.6gJKUsf0im 2024-01-22T05:41:02.824 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.6gJKUsf0im is 914KB 2024-01-22T05:41:02.929 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.6gJKUsf0im 2024-01-22T05:41:02.973 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/data/mon.c.tgz 2024-01-22T05:41:02.973 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-01-22T05:41:03.057 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.BdpWimOn78 2024-01-22T05:41:03.058 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BdpWimOn78 2024-01-22T05:41:03.358 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.BdpWimOn78 2024-01-22T05:41:03.470 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.BdpWimOn78 is 914KB 2024-01-22T05:41:03.577 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.BdpWimOn78 2024-01-22T05:41:03.621 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-22T05:41:03.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-22T05:41:03.626 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-22T05:41:03.728 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-01-22T05:41:03.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-22T05:41:03.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-22T05:41:03.810 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-22T05:41:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-22T05:41:03.993 INFO:tasks.ceph:Archiving crash dumps... 2024-01-22T05:41:03.995 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/remote/smithi100/crash 2024-01-22T05:41:03.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-22T05:41:04.062 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/remote/smithi169/crash 2024-01-22T05:41:04.063 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-22T05:41:04.131 INFO:tasks.ceph:Shutting down logrotate 2024-01-22T05:41:04.132 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:41:04.136 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T05:41:04.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-22T05:41:04.292 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-22T05:41:04.359 INFO:tasks.ceph:Compressing logs... 2024-01-22T05:41:04.359 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-22T05:41:04.363 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-22T05:41:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.79116.log 2024-01-22T05:41:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91029.log 2024-01-22T05:41:04.425 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.2.79116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83374.log 2024-01-22T05:41:04.426 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.2.79116.log.gz 2024-01-22T05:41:04.427 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91029.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91029.log.gz 2024-01-22T05:41:04.427 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90735.log 2024-01-22T05:41:04.428 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90211.log 2024-01-22T05:41:04.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83374.log.gz 2024-01-22T05:41:04.428 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81949.log 2024-01-22T05:41:04.429 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90735.log.gz 2024-01-22T05:41:04.429 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71170.log 2024-01-22T05:41:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90211.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90211.log.gz 2024-01-22T05:41:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70828.log 2024-01-22T05:41:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81949.log: gzip -5 --verbose -- 87.6%/var/log/ceph/ceph-client.admin.76607.log 2024-01-22T05:41:04.431 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81949.log.gz 2024-01-22T05:41:04.432 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-22T05:41:04.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.71170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71317.log 2024-01-22T05:41:04.432 INFO:teuthology.orchestra.run.smithi169.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71170.log.gz 2024-01-22T05:41:04.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70967.log 2024-01-22T05:41:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.71317.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.71317.log.gz 2024-01-22T05:41:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-22T05:41:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.70967.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.70967.log.gz 2024-01-22T05:41:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71268.log 2024-01-22T05:41:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71064.log 2024-01-22T05:41:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.71268.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71268.log.gz 2024-01-22T05:41:04.438 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.75596.log 2024-01-22T05:41:04.438 INFO:teuthology.orchestra.run.smithi169.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-22T05:41:04.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.71064.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 87.6% 2024-01-22T05:41:04.438 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71064.log.gz 2024-01-22T05:41:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.70828.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70828.log.gz 2024-01-22T05:41:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90686.log 2024-01-22T05:41:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76607.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76607.log.gz 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80149.log 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77391.log 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90686.log.gz 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87150.log 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80149.log.gz 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76950.log 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77391.log.gz 2024-01-22T05:41:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87150.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87150.log.gz 2024-01-22T05:41:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88128.log 2024-01-22T05:41:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76950.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.76950.log.gz 2024-01-22T05:41:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79757.log 2024-01-22T05:41:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.88128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81606.log 2024-01-22T05:41:04.441 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88128.log.gz 2024-01-22T05:41:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77781.log 2024-01-22T05:41:04.441 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79757.log.gz 2024-01-22T05:41:04.446 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81606.log: gzip -5 89.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.81606.log.gz/var/log/ceph/ceph-client.admin.75421.log 2024-01-22T05:41:04.446 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-22T05:41:04.446 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80296.log 2024-01-22T05:41:04.446 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77781.log.gz 2024-01-22T05:41:04.446 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75421.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75421.log.gz 2024-01-22T05:41:04.446 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90784.log 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81851.log 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80296.log.gz 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90784.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90784.log.gz 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76068.log 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83968.log 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81851.log.gz 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76068.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76068.log.gz 2024-01-22T05:41:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85794.log 2024-01-22T05:41:04.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.1.75596.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-22T05:41:04.448 INFO:teuthology.orchestra.run.smithi169.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.1.75596.log.gz 2024-01-22T05:41:04.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74933.log 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71120.log 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.74933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74933.log.gz 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.71120.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71120.log.gz 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-22T05:41:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-22T05:41:04.450 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.d.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-22T05:41:04.452 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.83968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71170.log 2024-01-22T05:41:04.452 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85794.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.83968.log.gz 2024-01-22T05:41:04.452 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose 87.8%-- -- replaced with /var/log/ceph/ceph-client.admin.85794.log.gz 2024-01-22T05:41:04.452 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80615.log 2024-01-22T05:41:04.452 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.71170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90162.log 2024-01-22T05:41:04.452 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71170.log.gz 2024-01-22T05:41:04.453 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80615.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80615.log.gz 2024-01-22T05:41:04.453 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81459.log 2024-01-22T05:41:04.453 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90162.log: gzip 88.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.90162.log.gz-- 2024-01-22T05:41:04.453 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91274.log 2024-01-22T05:41:04.453 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81222.log 2024-01-22T05:41:04.453 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81459.log.gz 2024-01-22T05:41:04.457 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82573.log 2024-01-22T05:41:04.457 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91274.log.gz 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90882.log 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81222.log.gz 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82573.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82573.log.gz 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86039.log 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90882.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90882.log.gz 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82524.log 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86039.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86039.log.gz 2024-01-22T05:41:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-22T05:41:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82524.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82524.log.gz 2024-01-22T05:41:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79708.log 2024-01-22T05:41:04.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.log: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-22T05:41:04.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-22T05:41:04.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-22T05:41:04.460 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71218.log 2024-01-22T05:41:04.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71016.log 2024-01-22T05:41:04.460 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.71218.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71218.log.gz 2024-01-22T05:41:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90333.log 2024-01-22T05:41:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79708.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79708.log.gz 2024-01-22T05:41:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81753.log 2024-01-22T05:41:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90333.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90333.log.gz 2024-01-22T05:41:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86856.log 2024-01-22T05:41:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81753.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81753.log.gz 2024-01-22T05:41:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-22T05:41:04.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.71016.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.71016.log.gz 2024-01-22T05:41:04.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75702.log 2024-01-22T05:41:04.465 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89702.log 2024-01-22T05:41:04.465 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86856.log.gz 2024-01-22T05:41:04.465 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89653.log 2024-01-22T05:41:04.465 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89702.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89702.log.gz 2024-01-22T05:41:04.465 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91225.log 2024-01-22T05:41:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76754.log 87.8% 2024-01-22T05:41:04.467 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89653.log.gz 2024-01-22T05:41:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91225.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91225.log.gz 2024-01-22T05:41:04.467 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.76292.log 2024-01-22T05:41:04.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.75702.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75702.log.gz 2024-01-22T05:41:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86756.log 2024-01-22T05:41:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87199.log 2024-01-22T05:41:04.468 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76754.log.gz 2024-01-22T05:41:04.469 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80811.log 2024-01-22T05:41:04.469 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86756.log.gz 2024-01-22T05:41:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87199.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87199.log.gz 2024-01-22T05:41:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74755.log 2024-01-22T05:41:04.471 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.3.76292.log: 89.3% -- replaced with /var/log/ceph/ceph-client.3.76292.log.gz 2024-01-22T05:41:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80811.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80811.log.gz 2024-01-22T05:41:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91602.log 2024-01-22T05:41:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.74755.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74755.log.gz 2024-01-22T05:41:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85329.log 2024-01-22T05:41:04.473 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91602.log: gzip -5 88.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.91602.log.gz/var/log/ceph/ceph-client.admin.85574.log 2024-01-22T05:41:04.473 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-22T05:41:04.474 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85329.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85329.log.gz 2024-01-22T05:41:04.474 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75090.log 2024-01-22T05:41:04.476 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85574.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85574.log.gz 2024-01-22T05:41:04.476 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85647.log 2024-01-22T05:41:04.476 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-22T05:41:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75090.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75090.log.gz 2024-01-22T05:41:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88707.log 2024-01-22T05:41:04.478 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76852.log 2024-01-22T05:41:04.478 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85647.log.gz 2024-01-22T05:41:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.88707.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88707.log.gz 2024-01-22T05:41:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82132.log 2024-01-22T05:41:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76852.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76852.log.gzgzip 2024-01-22T05:41:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.85182.log 2024-01-22T05:41:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82132.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82132.log.gz 2024-01-22T05:41:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85525.log 2024-01-22T05:41:04.482 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85182.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.85182.log.gz 2024-01-22T05:41:04.482 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90980.log 2024-01-22T05:41:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85525.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85525.log.gz 2024-01-22T05:41:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86254.log 2024-01-22T05:41:04.484 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90980.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-22T05:41:04.484 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90980.log.gz 2024-01-22T05:41:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86254.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86254.log.gz 2024-01-22T05:41:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76901.log 2024-01-22T05:41:04.486 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90833.log 2024-01-22T05:41:04.488 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76901.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-22T05:41:04.488 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76901.log.gz 2024-01-22T05:41:04.488 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84239.log 2024-01-22T05:41:04.489 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90833.log: gzip -5 --verbose 87.1%-- -- replaced with /var/log/ceph/ceph-client.admin.90833.log.gz/var/log/ceph/ceph-client.admin.80958.log 2024-01-22T05:41:04.489 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-22T05:41:04.490 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.84239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81056.log 2024-01-22T05:41:04.490 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84239.log.gz 2024-01-22T05:41:04.491 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80958.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80958.log.gz 2024-01-22T05:41:04.491 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80198.log 2024-01-22T05:41:04.492 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81271.log 2024-01-22T05:41:04.492 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81056.log.gz 2024-01-22T05:41:04.493 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80198.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80198.log.gz 2024-01-22T05:41:04.493 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76558.log 2024-01-22T05:41:04.494 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81271.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81271.log.gz 2024-01-22T05:41:04.494 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90284.log 2024-01-22T05:41:04.496 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76558.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76558.log.gzgzip 2024-01-22T05:41:04.496 INFO:teuthology.orchestra.run.smithi100.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.75237.log 2024-01-22T05:41:04.496 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90284.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90284.log.gz 2024-01-22T05:41:04.497 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77293.log 2024-01-22T05:41:04.497 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75237.log: 91.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-22T05:41:04.497 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75237.log.gz 2024-01-22T05:41:04.498 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77636.log 2024-01-22T05:41:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81704.log 2024-01-22T05:41:04.499 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77293.log.gz 2024-01-22T05:41:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86352.log 2024-01-22T05:41:04.500 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77636.log.gz 2024-01-22T05:41:04.501 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75627.log 2024-01-22T05:41:04.501 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81704.log.gz 2024-01-22T05:41:04.502 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86352.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86352.log.gz 2024-01-22T05:41:04.502 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79512.log 2024-01-22T05:41:04.503 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75627.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75627.log.gz 2024-01-22T05:41:04.503 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79953.log 2024-01-22T05:41:04.504 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79512.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79512.log.gz 2024-01-22T05:41:04.504 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75676.log 2024-01-22T05:41:04.505 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79953.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.79953.log.gz--verbose 2024-01-22T05:41:04.505 INFO:teuthology.orchestra.run.smithi100.stderr:-- /var/log/ceph/ceph-client.admin.78524.log 2024-01-22T05:41:04.506 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75676.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75676.log.gz 2024-01-22T05:41:04.506 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78418.log 2024-01-22T05:41:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.78524.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78524.log.gz 2024-01-22T05:41:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86954.log 2024-01-22T05:41:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.78418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79610.log 2024-01-22T05:41:04.509 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78418.log.gz 2024-01-22T05:41:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86954.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86954.log.gz 2024-01-22T05:41:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75188.log 2024-01-22T05:41:04.510 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71294.log 2024-01-22T05:41:04.510 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79610.log.gz 2024-01-22T05:41:04.511 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77048.log 2024-01-22T05:41:04.511 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75188.log.gz 2024-01-22T05:41:04.512 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.71294.log: gzip -5 --verbose -- 87.1%/var/log/ceph/ceph-osd.3.log -- replaced with /var/log/ceph/ceph-client.admin.71294.log.gz 2024-01-22T05:41:04.512 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-22T05:41:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77048.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77048.log.gz 2024-01-22T05:41:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76313.log 2024-01-22T05:41:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85035.log 2024-01-22T05:41:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76313.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76313.log.gz 2024-01-22T05:41:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87427.log 2024-01-22T05:41:04.517 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76117.log 2024-01-22T05:41:04.517 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85035.log.gz 2024-01-22T05:41:04.518 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86499.log 2024-01-22T05:41:04.518 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87427.log.gz 2024-01-22T05:41:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76117.log: gzip 88.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.76117.log.gz-- 2024-01-22T05:41:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log 2024-01-22T05:41:04.520 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86499.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86499.log.gz 2024-01-22T05:41:04.520 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85843.log 2024-01-22T05:41:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79463.log 2024-01-22T05:41:04.522 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85843.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85843.log.gz 2024-01-22T05:41:04.523 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85745.log 2024-01-22T05:41:04.524 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77489.log 2024-01-22T05:41:04.524 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79463.log.gz 2024-01-22T05:41:04.525 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85745.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85745.log.gz 2024-01-22T05:41:04.525 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82622.log 2024-01-22T05:41:04.526 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81900.log 2024-01-22T05:41:04.527 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77489.log.gz 2024-01-22T05:41:04.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82622.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82622.log.gz 2024-01-22T05:41:04.528 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81508.log 2024-01-22T05:41:04.529 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89947.log 2024-01-22T05:41:04.529 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81900.log.gz 2024-01-22T05:41:04.530 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81508.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81508.log.gz 2024-01-22T05:41:04.530 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86303.log 2024-01-22T05:41:04.531 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86450.log 2024-01-22T05:41:04.531 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89947.log.gz 2024-01-22T05:41:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89555.log 2024-01-22T05:41:04.533 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86303.log.gz 2024-01-22T05:41:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86450.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86450.log.gz 2024-01-22T05:41:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91176.log 2024-01-22T05:41:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89555.log.gz 2024-01-22T05:41:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79806.log 2024-01-22T05:41:04.537 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91176.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91176.log.gz 2024-01-22T05:41:04.537 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89751.log 2024-01-22T05:41:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79806.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79806.log.gz 2024-01-22T05:41:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81172.log 2024-01-22T05:41:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89751.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89751.log.gz 2024-01-22T05:41:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77685.log 2024-01-22T05:41:04.541 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85427.log 2024-01-22T05:41:04.541 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81172.log.gz 2024-01-22T05:41:04.543 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83097.log 2024-01-22T05:41:04.543 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.77685.log.gz 2024-01-22T05:41:04.543 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85427.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85427.log.gz 2024-01-22T05:41:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90637.log 2024-01-22T05:41:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.83097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80051.log 2024-01-22T05:41:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90637.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90637.log.gz 2024-01-22T05:41:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76411.log 2024-01-22T05:41:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80051.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.83097.log.gz 2024-01-22T05:41:04.548 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80051.log.gz 2024-01-22T05:41:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81370.log 2024-01-22T05:41:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76411.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76411.log.gz 2024-01-22T05:41:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76215.log 2024-01-22T05:41:04.550 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83518.log 2024-01-22T05:41:04.551 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81370.log.gz 2024-01-22T05:41:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76215.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76215.log.gz 2024-01-22T05:41:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76803.log 2024-01-22T05:41:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83518.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83518.log.gz 2024-01-22T05:41:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89358.log 2024-01-22T05:41:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82671.log 2024-01-22T05:41:04.554 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76803.log.gz 2024-01-22T05:41:04.556 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89358.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89358.log.gz 2024-01-22T05:41:04.556 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80345.log 2024-01-22T05:41:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82671.log: gzip 90.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.82671.log.gz 2024-01-22T05:41:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:--verbose -- /var/log/ceph/ceph-client.admin.81655.log 2024-01-22T05:41:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86548.log 2024-01-22T05:41:04.559 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80345.log.gz 2024-01-22T05:41:04.559 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81655.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81655.log.gz 2024-01-22T05:41:04.559 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88506.log 2024-01-22T05:41:04.561 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82426.log 2024-01-22T05:41:04.561 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86548.log.gz 2024-01-22T05:41:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.88506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75823.log 2024-01-22T05:41:04.563 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.0.88506.log.gz 2024-01-22T05:41:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75370.log 2024-01-22T05:41:04.564 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.82426.log.gz 2024-01-22T05:41:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75823.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75823.log.gz 2024-01-22T05:41:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81557.log 2024-01-22T05:41:04.566 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89996.log 2024-01-22T05:41:04.566 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75370.log.gz 2024-01-22T05:41:04.567 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81557.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.81557.log.gz 2024-01-22T05:41:04.567 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82230.log 2024-01-22T05:41:04.568 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75970.log 2024-01-22T05:41:04.569 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89996.log.gz 2024-01-22T05:41:04.569 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82230.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82230.log.gz 2024-01-22T05:41:04.570 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86401.log 2024-01-22T05:41:04.571 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75970.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75970.log.gz 2024-01-22T05:41:04.571 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86650.log 2024-01-22T05:41:04.573 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-22T05:41:04.574 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86401.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86401.log.gz 2024-01-22T05:41:04.574 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81802.log 2024-01-22T05:41:04.574 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86650.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86650.log.gz 2024-01-22T05:41:04.575 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83274.log 2024-01-22T05:41:04.575 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86707.log 2024-01-22T05:41:04.575 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81802.log.gz 2024-01-22T05:41:04.576 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83274.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83274.log.gz 2024-01-22T05:41:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77146.log 2024-01-22T05:41:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86707.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86707.log.gz 2024-01-22T05:41:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79561.log 2024-01-22T05:41:04.579 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82279.log 2024-01-22T05:41:04.579 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77146.log.gz 2024-01-22T05:41:04.580 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79561.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79561.log.gz 2024-01-22T05:41:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83590.log 2024-01-22T05:41:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82279.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.82279.log.gz 2024-01-22T05:41:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85892.log 2024-01-22T05:41:04.583 INFO:teuthology.orchestra.run.smithi169.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-22T05:41:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81007.log 2024-01-22T05:41:04.583 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83590.log.gz 2024-01-22T05:41:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85892.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.85892.log.gz 2024-01-22T05:41:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75578.log 2024-01-22T05:41:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81007.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81007.log.gz 2024-01-22T05:41:04.586 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83325.log 2024-01-22T05:41:04.587 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85476.log 2024-01-22T05:41:04.587 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75578.log.gz 2024-01-22T05:41:04.588 INFO:teuthology.orchestra.run.smithi169.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-22T05:41:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83325.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83325.log.gz 2024-01-22T05:41:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91470.log 2024-01-22T05:41:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76705.log 2024-01-22T05:41:04.590 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85476.log.gz 2024-01-22T05:41:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91470.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91470.log.gz 2024-01-22T05:41:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74942.log 2024-01-22T05:41:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76999.log 2024-01-22T05:41:04.595 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.76705.log.gz 2024-01-22T05:41:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.74942.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74942.log.gz 2024-01-22T05:41:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79855.log 2024-01-22T05:41:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82181.log 2024-01-22T05:41:04.597 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76999.log.gz 2024-01-22T05:41:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79855.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79855.log.gz 2024-01-22T05:41:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80100.log 2024-01-22T05:41:04.598 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75139.log 2024-01-22T05:41:04.598 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-22T05:41:04.600 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82181.log.gz 2024-01-22T05:41:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80100.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80100.log.gz 2024-01-22T05:41:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80713.log 2024-01-22T05:41:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87052.log 2024-01-22T05:41:04.600 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75139.log.gz 2024-01-22T05:41:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80713.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80713.log.gz 2024-01-22T05:41:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91649.log 2024-01-22T05:41:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80247.log 2024-01-22T05:41:04.602 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87052.log.gz 2024-01-22T05:41:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91649.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91649.log.gz 2024-01-22T05:41:04.603 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80860.log 2024-01-22T05:41:04.603 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91698.log 2024-01-22T05:41:04.604 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80247.log.gz 2024-01-22T05:41:04.605 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80860.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80860.log.gz 2024-01-22T05:41:04.605 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75286.log 2024-01-22T05:41:04.606 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79659.log 2024-01-22T05:41:04.606 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91698.log.gz 2024-01-22T05:41:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75286.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75286.log.gz 2024-01-22T05:41:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91323.log 2024-01-22T05:41:04.608 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85941.log 2024-01-22T05:41:04.609 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79659.log.gz 2024-01-22T05:41:04.610 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91323.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91323.log.gz 2024-01-22T05:41:04.610 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90490.log 2024-01-22T05:41:04.611 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90112.log 2024-01-22T05:41:04.611 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85941.log.gz 2024-01-22T05:41:04.612 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76509.log 2024-01-22T05:41:04.612 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90490.log.gz 2024-01-22T05:41:04.614 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90112.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90112.log.gz 2024-01-22T05:41:04.614 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80002.log 2024-01-22T05:41:04.615 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76509.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76509.log.gz 2024-01-22T05:41:04.615 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86599.log 2024-01-22T05:41:04.616 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80002.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-22T05:41:04.617 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80002.log.gz 2024-01-22T05:41:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86599.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86599.log.gz 2024-01-22T05:41:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-22T05:41:04.619 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77342.log 2024-01-22T05:41:04.620 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.a.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-22T05:41:04.620 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88779.log 2024-01-22T05:41:04.621 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77342.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77342.log.gz 2024-01-22T05:41:04.622 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90045.log 2024-01-22T05:41:04.623 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.88779.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88779.log.gz 2024-01-22T05:41:04.623 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85696.log 2024-01-22T05:41:04.624 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90931.log 2024-01-22T05:41:04.625 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90045.log.gz 2024-01-22T05:41:04.625 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85696.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85696.log.gz 2024-01-22T05:41:04.626 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89898.log 2024-01-22T05:41:04.627 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90931.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90931.log.gz 2024-01-22T05:41:04.627 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82475.log 2024-01-22T05:41:04.628 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87475.log 2024-01-22T05:41:04.629 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89898.log.gz 2024-01-22T05:41:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82475.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76264.log 2024-01-22T05:41:04.630 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82475.log.gz 2024-01-22T05:41:04.631 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87475.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85990.log 2024-01-22T05:41:04.632 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87475.log.gz 2024-01-22T05:41:04.633 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88056.log 2024-01-22T05:41:04.633 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76264.log.gz 2024-01-22T05:41:04.634 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85990.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85990.log.gz 2024-01-22T05:41:04.634 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80394.log 2024-01-22T05:41:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.88056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77440.log 2024-01-22T05:41:04.636 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88056.log.gz 2024-01-22T05:41:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80394.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80394.log.gz 2024-01-22T05:41:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85084.log 2024-01-22T05:41:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77440.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-22T05:41:04.639 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77440.log.gz 2024-01-22T05:41:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85084.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85084.log.gz 2024-01-22T05:41:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82377.log 2024-01-22T05:41:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87101.log 2024-01-22T05:41:04.642 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-22T05:41:04.643 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91421.log 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82377.log.gz 2024-01-22T05:41:04.643 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-22T05:41:04.644 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87101.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87101.log.gz 2024-01-22T05:41:04.644 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83423.log 2024-01-22T05:41:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77538.log 2024-01-22T05:41:04.646 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91421.log.gz 2024-01-22T05:41:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83423.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83423.log.gz 2024-01-22T05:41:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89604.log 2024-01-22T05:41:04.648 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77538.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77538.log.gz 2024-01-22T05:41:04.649 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.64287.log 2024-01-22T05:41:04.650 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91078.log 2024-01-22T05:41:04.650 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89604.log.gz 2024-01-22T05:41:04.651 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.64287.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.64287.log.gz 2024-01-22T05:41:04.651 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74991.log 2024-01-22T05:41:04.652 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91078.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91078.log.gz 2024-01-22T05:41:04.653 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81105.log 2024-01-22T05:41:04.654 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.74991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89506.log 2024-01-22T05:41:04.654 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74991.log.gz 2024-01-22T05:41:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81105.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81105.log.gz 2024-01-22T05:41:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74854.log 2024-01-22T05:41:04.656 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89506.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89506.log.gz 2024-01-22T05:41:04.657 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-22T05:41:04.658 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.74854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89849.log 2024-01-22T05:41:04.658 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74854.log.gz 2024-01-22T05:41:04.659 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-22T05:41:04.660 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80664.log 2024-01-22T05:41:04.660 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-22T05:41:04.661 INFO:teuthology.orchestra.run.smithi100.stderr: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-22T05:41:04.661 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89849.log: gzip 88.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.89849.log.gz--verbose 2024-01-22T05:41:04.661 INFO:teuthology.orchestra.run.smithi100.stderr:-- /var/log/ceph/ceph-client.admin.80566.log 2024-01-22T05:41:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91372.log 2024-01-22T05:41:04.662 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80664.log.gz 2024-01-22T05:41:04.663 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80566.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80566.log.gz 2024-01-22T05:41:04.663 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82719.log 2024-01-22T05:41:04.664 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-01-22T05:41:04.664 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m0.259s 2024-01-22T05:41:04.664 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m0.949s 2024-01-22T05:41:04.665 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.182s 2024-01-22T05:41:04.666 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90539.log 2024-01-22T05:41:04.666 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91372.log.gz 2024-01-22T05:41:04.666 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82719.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-22T05:41:04.666 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.82719.log.gz-5 2024-01-22T05:41:04.667 INFO:teuthology.orchestra.run.smithi100.stderr:--verbose -- /var/log/ceph/ceph-client.admin.75529.log 2024-01-22T05:41:04.667 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90539.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90539.log.gz 2024-01-22T05:41:04.668 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86115.log 2024-01-22T05:41:04.669 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75529.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75529.log.gz 2024-01-22T05:41:04.669 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75041.log 2024-01-22T05:41:04.670 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86115.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86115.log.gz 2024-01-22T05:41:04.671 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82081.log 2024-01-22T05:41:04.672 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75041.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75041.log.gz 2024-01-22T05:41:04.672 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76460.log 2024-01-22T05:41:04.673 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82081.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.82081.log.gz 2024-01-22T05:41:04.674 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77244.log 2024-01-22T05:41:04.674 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76460.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76460.log.gz 2024-01-22T05:41:04.675 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84912.log 2024-01-22T05:41:04.676 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77244.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77244.log.gz 2024-01-22T05:41:04.676 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85133.log 2024-01-22T05:41:04.678 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.84912.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84912.log.gz 2024-01-22T05:41:04.678 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85378.log 2024-01-22T05:41:04.679 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85133.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.85133.log.gz 2024-01-22T05:41:04.679 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76019.log 2024-01-22T05:41:04.681 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85378.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.85378.log.gz 2024-01-22T05:41:04.681 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76656.log 2024-01-22T05:41:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76019.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76019.log.gz 2024-01-22T05:41:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75872.log 2024-01-22T05:41:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76656.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76656.log.gz 2024-01-22T05:41:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89800.log 2024-01-22T05:41:04.685 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75872.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75872.log.gz 2024-01-22T05:41:04.685 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77587.log 2024-01-22T05:41:04.686 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89800.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89800.log.gz 2024-01-22T05:41:04.687 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85231.log 2024-01-22T05:41:04.688 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77587.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77587.log.gz 2024-01-22T05:41:04.688 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75725.log 2024-01-22T05:41:04.689 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85231.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85231.log.gz 2024-01-22T05:41:04.690 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80762.log 2024-01-22T05:41:04.691 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75725.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75725.log.gz 2024-01-22T05:41:04.691 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87297.log 2024-01-22T05:41:04.692 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80762.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80762.log.gz 2024-01-22T05:41:04.693 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76362.log 2024-01-22T05:41:04.694 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87297.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87297.log.gz 2024-01-22T05:41:04.695 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75478.log 2024-01-22T05:41:04.696 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76362.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76362.log.gz 2024-01-22T05:41:04.696 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84641.log 2024-01-22T05:41:04.697 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75478.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75478.log.gz 2024-01-22T05:41:04.697 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86805.log 2024-01-22T05:41:04.698 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.84641.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-22T05:41:04.699 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79904.log 2024-01-22T05:41:04.699 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.84641.log.gz 2024-01-22T05:41:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86805.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86805.log.gz 2024-01-22T05:41:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74637.log 2024-01-22T05:41:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79904.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79904.log.gz 2024-01-22T05:41:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87829.log 2024-01-22T05:41:04.702 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.74637.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74637.log.gz 2024-01-22T05:41:04.702 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85280.log 2024-01-22T05:41:04.703 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.87829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75921.log 2024-01-22T05:41:04.704 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85280.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.87829.log.gz 2024-01-22T05:41:04.704 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85280.log.gz 2024-01-22T05:41:04.705 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89157.log 2024-01-22T05:41:04.706 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75921.log.gz 2024-01-22T05:41:04.706 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91519.log 2024-01-22T05:41:04.706 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.89157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86905.log 2024-01-22T05:41:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91519.log: 89.9% -- replaced with /var/log/ceph/ceph-client.0.89157.log.gz 2024-01-22T05:41:04.708 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91519.log.gz 2024-01-22T05:41:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79414.log 2024-01-22T05:41:04.709 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.86905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86905.log.gz 2024-01-22T05:41:04.709 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81998.log 2024-01-22T05:41:04.710 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76166.log 2024-01-22T05:41:04.710 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79414.log.gz 2024-01-22T05:41:04.711 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81998.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81998.log.gz 2024-01-22T05:41:04.711 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87003.log 2024-01-22T05:41:04.712 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76166.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76166.log.gz 2024-01-22T05:41:04.713 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91127.log 2024-01-22T05:41:04.713 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87003.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87003.log.gz 2024-01-22T05:41:04.714 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87354.log 2024-01-22T05:41:04.715 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77097.log 88.7% 2024-01-22T05:41:04.715 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91127.log.gz 2024-01-22T05:41:04.716 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87354.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87354.log.gz 2024-01-22T05:41:04.716 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77195.log 2024-01-22T05:41:04.717 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77097.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77097.log.gz 2024-01-22T05:41:04.717 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79365.log 2024-01-22T05:41:04.718 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87248.log 2024-01-22T05:41:04.718 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77195.log.gz 2024-01-22T05:41:04.719 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.79365.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-22T05:41:04.719 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79365.log.gz 2024-01-22T05:41:04.720 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.87248.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87248.log.gz 2024-01-22T05:41:04.720 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90588.log 2024-01-22T05:41:04.721 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-22T05:41:04.721 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74706.log 2024-01-22T05:41:04.722 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90588.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90588.log.gz 2024-01-22T05:41:04.723 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75774.log 2024-01-22T05:41:04.723 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.74706.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74706.log.gz 2024-01-22T05:41:04.723 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84263.log 2024-01-22T05:41:04.724 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80909.log 2024-01-22T05:41:04.725 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75774.log.gz 2024-01-22T05:41:04.725 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.84263.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84263.log.gz 2024-01-22T05:41:04.726 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82328.log 2024-01-22T05:41:04.726 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80909.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80909.log.gz 2024-01-22T05:41:04.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82328.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82328.log.gz 2024-01-22T05:41:04.854 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-22T05:41:04.863 INFO:teuthology.orchestra.run.smithi100.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-22T05:41:04.866 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-22T05:41:04.866 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.466s 2024-01-22T05:41:04.867 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m1.030s 2024-01-22T05:41:04.867 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.685s 2024-01-22T05:41:04.868 INFO:tasks.ceph:Archiving logs... 2024-01-22T05:41:04.868 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/remote/smithi100/log 2024-01-22T05:41:04.869 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-22T05:41:05.276 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/remote/smithi169/log 2024-01-22T05:41:05.277 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-22T05:41:05.479 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-22T05:41:05.490 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-22T05:41:05.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-22T05:41:05.494 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-22T05:41:05.608 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-22T05:41:05.619 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-22T05:41:05.620 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:41:05.625 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T05:41:05.663 INFO:teuthology.orchestra.run.smithi100.stderr:bash: ntpq: command not found 2024-01-22T05:41:05.667 INFO:teuthology.orchestra.run.smithi169.stderr:bash: ntpq: command not found 2024-01-22T05:41:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T05:41:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-01-22T05:41:05.670 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 +1295us[+1268us] +/- 91ms 2024-01-22T05:41:05.671 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -1009us[-1036us] +/- 53ms 2024-01-22T05:41:05.671 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +324us[ +297us] +/- 72ms 2024-01-22T05:41:05.671 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:41:05.674 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T05:41:05.674 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-01-22T05:41:05.674 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 +1314us[+1290us] +/- 91ms 2024-01-22T05:41:05.675 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 -999us[-1025us] +/- 53ms 2024-01-22T05:41:05.675 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +344us[ +320us] +/- 72ms 2024-01-22T05:41:05.675 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T05:41:05.676 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-22T05:41:05.685 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-22T05:41:05.686 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-22T05:41:05.696 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-22T05:41:05.844 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-22T05:41:05.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T05:41:06.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:41:06.040 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T05:41:06.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:41:06.109 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-22T05:41:06.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-22T05:41:06.129 INFO:teuthology.task.internal:Duration was 2469.176740 seconds 2024-01-22T05:41:06.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-22T05:41:06.139 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-22T05:41:06.139 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-22T05:41:06.144 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-22T05:41:06.250 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T05:41:06.256 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T05:41:06.666 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-22T05:41:06.666 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-01-22T05:41:06.667 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-22T05:41:06.726 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-01-22T05:41:06.727 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-22T05:41:06.785 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-22T05:41:06.786 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-22T05:41:06.790 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-22T05:41:06.874 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-22T05:41:06.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-22T05:41:06.878 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-22T05:41:06.995 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-22T05:41:07.006 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-22T05:41:07.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-22T05:41:07.073 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-22T05:41:07.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-22T05:41:07.150 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:41:07.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:41:07.216 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-01-22T05:41:07.220 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-01-22T05:41:07.253 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:41:07.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:41:07.295 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-22T05:41:07.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T05:41:07.338 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-22T05:41:07.349 INFO:teuthology.task.internal:Transferring archived files... 2024-01-22T05:41:07.349 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/remote/smithi100 2024-01-22T05:41:07.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-22T05:41:07.429 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548/remote/smithi169 2024-01-22T05:41:07.430 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-22T05:41:07.506 INFO:teuthology.task.internal:Removing archive directory... 2024-01-22T05:41:07.506 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-22T05:41:07.510 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-22T05:41:07.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-22T05:41:07.566 INFO:teuthology.task.internal:Not uploading archives. 2024-01-22T05:41:07.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-22T05:41:07.577 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-22T05:41:07.577 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-22T05:41:07.595 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-22T05:41:07.635 INFO:teuthology.orchestra.run.smithi100.stdout: 524306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 22 05:41 /home/ubuntu/cephtest 2024-01-22T05:41:07.639 INFO:teuthology.orchestra.run.smithi169.stdout: 524298 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 22 05:41 /home/ubuntu/cephtest 2024-01-22T05:41:07.642 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-22T05:41:07.653 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-22T05:41:07.677 INFO:teuthology.nuke:Checking targets against current locks 2024-01-22T05:41:07.705 DEBUG:teuthology.nuke:shortname: smithi100 2024-01-22T05:41:07.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T05:41:07.726 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:32:58.469845', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwSizrvfzR8Fk6c0OwIg3nxwin5xjeJagPPR62n77/6m+EfIVl9lOs+/hBP48MzFgVssA3OXOcEF7u9LsoXfKM='} 2024-01-22T05:41:07.730 DEBUG:teuthology.nuke:shortname: smithi169 2024-01-22T05:41:07.730 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T05:41:07.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 04:32:58.468174', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC3AJjPlDunMOVr3M4j8HfyCqaM7PdUExu8sYm7XZNbpc7zDBKM8BTTjL9LkPZZVyk0KF1oHAB6RM1K9fY9uYLk='} 2024-01-22T05:41:07.780 INFO:teuthology.orchestra.console.smithi100:Power off 2024-01-22T05:41:07.780 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T05:41:07.805 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-01-22T05:41:07.806 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:41:07.821 INFO:teuthology.orchestra.console.smithi169:Power off 2024-01-22T05:41:07.822 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T05:41:07.832 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-01-22T05:41:07.844 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-01-22T05:41:07.844 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:41:07.868 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-01-22T05:41:11.834 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:41:11.870 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:41:11.945 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-01-22T05:41:11.980 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-01-22T05:41:15.948 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:41:15.981 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:41:16.061 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-01-22T05:41:16.092 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-22T05:41:16.193 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-01-22T05:41:20.063 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T05:41:20.174 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-01-22T05:41:20.275 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-01-22T05:41:20.380 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 2469.1767399311066 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 mon.b-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=885a8a6aa97847dea7428c68fb5af6d8 status: fail success: false 2024-01-22T05:41:20.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T05:41:20.460 INFO:teuthology.run:FAIL